[ 48.431850][ T478] gre: GRE over IPv4 demultiplexor driver
[ 48.455781][ T478] ip6_gre: GRE over IPv6 tunneling driver
[ 48.619154][ T49] ip6_tunnel: er6 xmit: Local address not yet configured!
[ 48.846680][ T50] ip6_tunnel: gt6 xmit: Local address not yet configured!
[ 49.247670][ T10] ip6_tunnel: er6 xmit: Local address not yet configured!
[ 50.284996][ T488] Mirror/redirect action on
[ 53.535884][ C0]
[ 53.536100][ C0] ========================================================
[ 53.536351][ C0] WARNING: possible irq lock inversion dependency detected
[ 53.536583][ C0] 6.9.0-rc1-virtme #1 Not tainted
[ 53.536745][ C0] --------------------------------------------------------
[ 53.536978][ C0] ksoftirqd/0/15 just changed the state of lock:
[ 53.537168][ C0] ffff8880056420d8 (&qdisc_xmit_lock_key#3){+.-.}-{2:2}, at: sch_direct_xmit+0x2a1/0x11c0
[ 53.537454][ C0] but this lock took another, SOFTIRQ-unsafe lock in the past:
[ 53.537688][ C0] (&p->alloc_lock){+.+.}-{2:2}
[ 53.537692][ C0]
[ 53.537692][ C0]
[ 53.537692][ C0] and interrupts could create inverse lock ordering between them.
[ 53.537692][ C0]
[ 53.538272][ C0]
[ 53.538272][ C0] other info that might help us debug this:
[ 53.538497][ C0] Possible interrupt unsafe locking scenario:
[ 53.538497][ C0]
[ 53.538726][ C0] CPU0 CPU1
[ 53.538885][ C0] ---- ----
[ 53.539037][ C0] lock(&p->alloc_lock);
[ 53.539160][ C0] local_irq_disable();
[ 53.539353][ C0] lock(&qdisc_xmit_lock_key#3);
[ 53.539587][ C0] lock(&p->alloc_lock);
[ 53.539779][ C0] <Interrupt>
[ 53.539897][ C0] lock(&qdisc_xmit_lock_key#3);
[ 53.540054][ C0]
[ 53.540054][ C0] *** DEADLOCK ***
[ 53.540054][ C0]
[ 53.540293][ C0] 3 locks held by ksoftirqd/0/15:
[ 53.540447][ C0] #0: ffffffffa9d66360 (rcu_read_lock){....}-{1:2}, at: process_backlog+0x1f8/0x670
[ 53.540723][ C0] #1: ffffffffa9d66300 (rcu_read_lock_bh){....}-{1:2}, at: __dev_queue_xmit+0x1e5/0x16e0
[ 53.540996][ C0] #2: ffff88800729d258 (dev->qdisc_tx_busylock ?: &qdisc_tx_busylock){+...}-{2:2}, at: __dev_xmit_skb+0x792/0xfa0
[ 53.541346][ C0]
[ 53.541346][ C0] the shortest dependencies between 2nd lock and 1st lock:
[ 53.541626][ C0] -> (&p->alloc_lock){+.+.}-{2:2} {
[ 53.541785][ C0] HARDIRQ-ON-W at:
[ 53.541904][ C0] __lock_acquire+0x797/0x1570
[ 53.542102][ C0] lock_acquire.part.0+0xeb/0x330
[ 53.542302][ C0] _raw_spin_lock+0x30/0x40
[ 53.542497][ C0] set_mems_allowed+0x1d/0x210
[ 53.542697][ C0] kernel_init_freeable+0x72/0x310
[ 53.542897][ C0] kernel_init+0x20/0x200
[ 53.543092][ C0] ret_from_fork+0x31/0x70
[ 53.543292][ C0] ret_from_fork_asm+0x1a/0x30
[ 53.543490][ C0] SOFTIRQ-ON-W at:
[ 53.543610][ C0] __lock_acquire+0x797/0x1570
[ 53.543813][ C0] lock_acquire.part.0+0xeb/0x330
[ 53.544009][ C0] _raw_spin_lock+0x30/0x40
[ 53.544206][ C0] set_mems_allowed+0x1d/0x210
[ 53.544403][ C0] kernel_init_freeable+0x72/0x310
[ 53.544598][ C0] kernel_init+0x20/0x200
[ 53.544795][ C0] ret_from_fork+0x31/0x70
[ 53.545000][ C0] ret_from_fork_asm+0x1a/0x30
[ 53.545199][ C0] INITIAL USE at:
[ 53.545316][ C0] __lock_acquire+0x797/0x1570
[ 53.545512][ C0] lock_acquire.part.0+0xeb/0x330
[ 53.545709][ C0] _raw_spin_lock+0x30/0x40
[ 53.545905][ C0] set_mems_allowed+0x1d/0x210
[ 53.546104][ C0] kernel_init_freeable+0x72/0x310
[ 53.546302][ C0] kernel_init+0x20/0x200
[ 53.546496][ C0] ret_from_fork+0x31/0x70
[ 53.546692][ C0] ret_from_fork_asm+0x1a/0x30
[ 53.546892][ C0] }
[ 53.546976][ C0] ... key at: [<ffffffffab6fcd20>] __key.388+0x0/0x40
[ 53.547209][ C0] ... acquired at:
[ 53.547329][ C0] __lock_acquire+0xaf0/0x1570
[ 53.547488][ C0] lock_acquire.part.0+0xeb/0x330
[ 53.547649][ C0] _raw_spin_lock+0x30/0x40
[ 53.547804][ C0] __get_task_comm+0x27/0x70
[ 53.547964][ C0] ref_tracker_alloc+0x2ee/0x490
[ 53.548121][ C0] ___neigh_create+0x11e/0xe10
[ 53.548282][ C0] ip6_finish_output2+0xabd/0xf60
[ 53.548440][ C0] ip6_finish_output+0x553/0xdf0
[ 53.548600][ C0] ip6_output+0x1f3/0x770
[ 53.548757][ C0] ip6tunnel_xmit.constprop.0+0x16b/0x360
[ 53.548955][ C0] ip6_tnl_xmit+0x1266/0x3490
[ 53.549111][ C0] ip6erspan_tunnel_xmit+0xf63/0x2ce0 [ip6_gre]
[ 53.549313][ C0] dev_hard_start_xmit+0x10e/0x360
[ 53.549472][ C0] sch_direct_xmit+0x203/0x11c0
[ 53.549632][ C0] __dev_xmit_skb+0x936/0xfa0
[ 53.549786][ C0] __dev_queue_xmit+0x8be/0x16e0
[ 53.549943][ C0] ip6_finish_output2+0x59b/0xf60
[ 53.550099][ C0] ip6_finish_output+0x553/0xdf0
[ 53.550255][ C0] ip6_output+0x1f3/0x770
[ 53.550415][ C0] NF_HOOK.constprop.0+0xe2/0x680
[ 53.550571][ C0] mld_sendpack+0x62d/0xbc0
[ 53.550729][ C0] mld_ifc_work+0x32/0x1f0
[ 53.550887][ C0] process_one_work+0xe2c/0x1730
[ 53.551047][ C0] worker_thread+0x587/0xd30
[ 53.551207][ C0] kthread+0x28a/0x350
[ 53.551327][ C0] ret_from_fork+0x31/0x70
[ 53.551489][ C0] ret_from_fork_asm+0x1a/0x30
[ 53.551656][ C0]
[ 53.551736][ C0] -> (&qdisc_xmit_lock_key#3){+.-.}-{2:2} {
[ 53.551934][ C0] HARDIRQ-ON-W at:
[ 53.552053][ C0] __lock_acquire+0x797/0x1570
[ 53.552250][ C0] lock_acquire.part.0+0xeb/0x330
[ 53.552445][ C0] _raw_spin_lock+0x30/0x40
[ 53.552646][ C0] sch_direct_xmit+0x2a1/0x11c0
[ 53.552838][ C0] __dev_xmit_skb+0x936/0xfa0
[ 53.553037][ C0] __dev_queue_xmit+0x8be/0x16e0
[ 53.553236][ C0] ip6_finish_output2+0x512/0xf60
[ 53.553430][ C0] ip6_finish_output+0x553/0xdf0
[ 53.553627][ C0] ip6_output+0x1f3/0x770
[ 53.553827][ C0] NF_HOOK.constprop.0+0xe2/0x680
[ 53.554017][ C0] mld_sendpack+0x62d/0xbc0
[ 53.554210][ C0] mld_ifc_work+0x32/0x1f0
[ 53.554409][ C0] process_one_work+0xe2c/0x1730
[ 53.554606][ C0] worker_thread+0x587/0xd30
[ 53.554804][ C0] kthread+0x28a/0x350
[ 53.554963][ C0] ret_from_fork+0x31/0x70
[ 53.555160][ C0] ret_from_fork_asm+0x1a/0x30
[ 53.555355][ C0] IN-SOFTIRQ-W at:
[ 53.555471][ C0] __lock_acquire+0x797/0x1570
[ 53.555667][ C0] lock_acquire.part.0+0xeb/0x330
[ 53.555861][ C0] _raw_spin_lock+0x30/0x40
[ 53.556056][ C0] sch_direct_xmit+0x2a1/0x11c0
[ 53.556258][ C0] __dev_xmit_skb+0x936/0xfa0
[ 53.556460][ C0] __dev_queue_xmit+0x8be/0x16e0
[ 53.556657][ C0] tcf_mirred_to_dev+0x787/0xdf0 [act_mirred]
[ 53.556899][ C0] tcf_mirred_act+0x33b/0x780 [act_mirred]
[ 53.557144][ C0] tcf_action_exec.part.0+0x112/0x3d0
[ 53.557344][ C0] __tcf_classify.constprop.0+0x17e/0x4e0
[ 53.557584][ C0] tcf_classify+0x72/0xa0
[ 53.557783][ C0] tc_run+0x2be/0x700
[ 53.557941][ C0] __netif_receive_skb_core.constprop.0+0x10ea/0x2d20
[ 53.558174][ C0] __netif_receive_skb_one_core+0xaf/0x1b0
[ 53.558410][ C0] process_backlog+0x103/0x670
[ 53.558609][ C0] __napi_poll.constprop.0+0xa2/0x460
[ 53.558810][ C0] net_rx_action+0x49f/0xc00
[ 53.559008][ C0] __do_softirq+0x1f8/0x5df
[ 53.559208][ C0] run_ksoftirqd+0x2e/0x60
[ 53.559405][ C0] smpboot_thread_fn+0x306/0x840
[ 53.559605][ C0] kthread+0x28a/0x350
[ 53.559764][ C0] ret_from_fork+0x31/0x70
[ 53.559968][ C0] ret_from_fork_asm+0x1a/0x30
[ 53.560164][ C0] INITIAL USE at:
[ 53.560283][ C0] __lock_acquire+0x797/0x1570
[ 53.560482][ C0] lock_acquire.part.0+0xeb/0x330
[ 53.560679][ C0] _raw_spin_lock+0x30/0x40
[ 53.560877][ C0] sch_direct_xmit+0x2a1/0x11c0
[ 53.561074][ C0] __dev_xmit_skb+0x936/0xfa0
[ 53.561276][ C0] __dev_queue_xmit+0x8be/0x16e0
[ 53.561484][ C0] ip6_finish_output2+0x512/0xf60
[ 53.561687][ C0] ip6_finish_output+0x553/0xdf0
[ 53.561883][ C0] ip6_output+0x1f3/0x770
[ 53.562081][ C0] NF_HOOK.constprop.0+0xe2/0x680
[ 53.562277][ C0] mld_sendpack+0x62d/0xbc0
[ 53.562476][ C0] mld_ifc_work+0x32/0x1f0
[ 53.562670][ C0] process_one_work+0xe2c/0x1730
[ 53.562865][ C0] worker_thread+0x587/0xd30
[ 53.563061][ C0] kthread+0x28a/0x350
[ 53.563220][ C0] ret_from_fork+0x31/0x70
[ 53.563418][ C0] ret_from_fork_asm+0x1a/0x30
[ 53.563614][ C0] }
[ 53.563693][ C0] ... key at: [<ffffffffc06106c0>] qdisc_xmit_lock_key.143+0x0/0xffffffffffffb940 [ip6_gre]
[ 53.564013][ C0] ... acquired at:
[ 53.564129][ C0] mark_lock+0x28d/0x3e0
[ 53.564286][ C0] mark_usage+0xd9/0x2a0
[ 53.564445][ C0] __lock_acquire+0x797/0x1570
[ 53.564602][ C0] lock_acquire.part.0+0xeb/0x330
[ 53.564758][ C0] _raw_spin_lock+0x30/0x40
[ 53.564916][ C0] sch_direct_xmit+0x2a1/0x11c0
[ 53.565076][ C0] __dev_xmit_skb+0x936/0xfa0
[ 53.565235][ C0] __dev_queue_xmit+0x8be/0x16e0
[ 53.565393][ C0] tcf_mirred_to_dev+0x787/0xdf0 [act_mirred]
[ 53.565592][ C0] tcf_mirred_act+0x33b/0x780 [act_mirred]
[ 53.565793][ C0] tcf_action_exec.part.0+0x112/0x3d0
[ 53.566124][ C0] __tcf_classify.constprop.0+0x17e/0x4e0
[ 53.566319][ C0] tcf_classify+0x72/0xa0
[ 53.566474][ C0] tc_run+0x2be/0x700
[ 53.566596][ C0] __netif_receive_skb_core.constprop.0+0x10ea/0x2d20
[ 53.566871][ C0] __netif_receive_skb_one_core+0xaf/0x1b0
[ 53.567062][ C0] process_backlog+0x103/0x670
[ 53.567218][ C0] __napi_poll.constprop.0+0xa2/0x460
[ 53.567373][ C0] net_rx_action+0x49f/0xc00
[ 53.567615][ C0] __do_softirq+0x1f8/0x5df
[ 53.567775][ C0] run_ksoftirqd+0x2e/0x60
[ 53.567932][ C0] smpboot_thread_fn+0x306/0x840
[ 53.568092][ C0] kthread+0x28a/0x350
[ 53.568295][ C0] ret_from_fork+0x31/0x70
[ 53.568454][ C0] ret_from_fork_asm+0x1a/0x30
[ 53.568612][ C0]
[ 53.568690][ C0]
[ 53.568690][ C0] stack backtrace:
[ 53.568880][ C0] CPU: 0 PID: 15 Comm: ksoftirqd/0 Not tainted 6.9.0-rc1-virtme #1
[ 53.569195][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014
[ 53.569539][ C0] Call Trace:
[ 53.569747][ C0] <TASK>
[ 53.569827][ C0] dump_stack_lvl+0x82/0xd0
[ 53.569988][ C0] print_irq_inversion_bug.part.0+0x3d9/0x570
[ 53.570182][ C0] ? kernel_text_address+0x17/0xe0
[ 53.570338][ C0] ? __pfx_print_irq_inversion_bug.part.0+0x10/0x10
[ 53.570612][ C0] ? __pfx_usage_skip+0x10/0x10
[ 53.570768][ C0] ? __pfx_usage_match+0x10/0x10
[ 53.570926][ C0] ? arch_stack_walk+0x8c/0xf0
[ 53.571081][ C0] mark_lock_irq+0x4cd/0xa10
[ 53.571326][ C0] ? ret_from_fork_asm+0x1a/0x30
[ 53.571495][ C0] ? __pfx_mark_lock_irq+0x10/0x10
[ 53.571649][ C0] ? __pfx_stack_trace_save+0x10/0x10
[ 53.571809][ C0] ? save_trace+0x8f/0x5b0
[ 53.572050][ C0] mark_lock+0x28d/0x3e0
[ 53.572168][ C0] mark_usage+0xd9/0x2a0
[ 53.572291][ C0] __lock_acquire+0x797/0x1570
[ 53.572448][ C0] ? tcf_mirred_act+0x302/0x780 [act_mirred]
[ 53.572643][ C0] ? arch_stack_walk+0x68/0xf0
[ 53.572883][ C0] lock_acquire.part.0+0xeb/0x330
[ 53.573037][ C0] ? sch_direct_xmit+0x2a1/0x11c0
[ 53.573193][ C0] ? __pfx_lock_acquire.part.0+0x10/0x10
[ 53.573349][ C0] ? trace_lock_acquire+0x135/0x1c0
[ 53.573590][ C0] ? sch_direct_xmit+0x2a1/0x11c0
[ 53.573743][ C0] ? lock_acquire+0x32/0xc0
[ 53.573901][ C0] ? sch_direct_xmit+0x2a1/0x11c0
[ 53.574055][ C0] _raw_spin_lock+0x30/0x40
[ 53.574294][ C0] ? sch_direct_xmit+0x2a1/0x11c0
[ 53.574448][ C0] sch_direct_xmit+0x2a1/0x11c0
[ 53.574603][ C0] ? __pfx_lock_acquire.part.0+0x10/0x10
[ 53.574757][ C0] ? __pfx_sch_direct_xmit+0x10/0x10
[ 53.574994][ C0] ? __dev_xmit_skb+0x792/0xfa0
[ 53.575147][ C0] ? lock_acquire+0x32/0xc0
[ 53.575306][ C0] ? __dev_xmit_skb+0x792/0xfa0
[ 53.575462][ C0] __dev_xmit_skb+0x936/0xfa0
[ 53.575617][ C0] ? __pfx___dev_xmit_skb+0x10/0x10
[ 53.575856][ C0] ? __dev_queue_xmit+0x1e5/0x16e0
[ 53.576010][ C0] ? lock_acquire+0x32/0xc0
[ 53.576165][ C0] ? __dev_queue_xmit+0x1e5/0x16e0
[ 53.576321][ C0] __dev_queue_xmit+0x8be/0x16e0
[ 53.576559][ C0] ? lockdep_hardirqs_on_prepare.part.0+0x14f/0x370
[ 53.576757][ C0] ? __pfx___dev_queue_xmit+0x10/0x10
[ 53.576912][ C0] ? trace_kmem_cache_alloc+0x2a/0xd0
[ 53.577070][ C0] ? kmem_cache_alloc+0x132/0x270
[ 53.577312][ C0] ? __copy_skb_header+0xaf/0x490
[ 53.577472][ C0] ? __skb_clone+0x57a/0x760
[ 53.577628][ C0] tcf_mirred_to_dev+0x787/0xdf0 [act_mirred]
[ 53.577827][ C0] tcf_mirred_act+0x33b/0x780 [act_mirred]
[ 53.578195][ C0] ? kasan_save_track+0x14/0x30
[ 53.578353][ C0] tcf_action_exec.part.0+0x112/0x3d0
[ 53.578509][ C0] ? mall_classify+0x173/0x240 [cls_matchall]
[ 53.578702][ C0] __tcf_classify.constprop.0+0x17e/0x4e0
[ 53.578942][ C0] tcf_classify+0x72/0xa0
[ 53.579059][ C0] ? __pfx_tcf_classify+0x10/0x10
[ 53.579215][ C0] tc_run+0x2be/0x700
[ 53.579333][ C0] ? __pfx___debug_check_no_obj_freed+0x10/0x10
[ 53.579612][ C0] ? __pfx_tc_run+0x10/0x10
[ 53.579779][ C0] __netif_receive_skb_core.constprop.0+0x10ea/0x2d20
[ 53.579973][ C0] ? __lock_acquire+0xaf0/0x1570
[ 53.580128][ C0] ? __pfx___netif_receive_skb_core.constprop.0+0x10/0x10
[ 53.580401][ C0] ? lock_acquire.part.0+0xeb/0x330
[ 53.580555][ C0] ? process_backlog+0x1f8/0x670
[ 53.580709][ C0] __netif_receive_skb_one_core+0xaf/0x1b0
[ 53.580902][ C0] ? __pfx___netif_receive_skb_one_core+0x10/0x10
[ 53.581182][ C0] ? process_backlog+0x1f8/0x670
[ 53.581337][ C0] ? lock_acquire+0x32/0xc0
[ 53.581498][ C0] ? process_backlog+0x1f8/0x670
[ 53.581652][ C0] process_backlog+0x103/0x670
[ 53.581896][ C0] __napi_poll.constprop.0+0xa2/0x460
[ 53.582051][ C0] net_rx_action+0x49f/0xc00
[ 53.582207][ C0] ? __schedule+0x6ea/0x1a20
[ 53.582363][ C0] ? __pfx_net_rx_action+0x10/0x10
[ 53.582602][ C0] ? __pfx_lock_acquire.part.0+0x10/0x10
[ 53.582762][ C0] __do_softirq+0x1f8/0x5df
[ 53.582919][ C0] ? __pfx_run_ksoftirqd+0x10/0x10
[ 53.583074][ C0] run_ksoftirqd+0x2e/0x60
[ 53.583313][ C0] smpboot_thread_fn+0x306/0x840
[ 53.583469][ C0] ? __pfx_smpboot_thread_fn+0x10/0x10
[ 53.583625][ C0] ? __pfx_smpboot_thread_fn+0x10/0x10
[ 53.583779][ C0] kthread+0x28a/0x350
[ 53.583897][ C0] ? __pfx_kthread+0x10/0x10
[ 53.584140][ C0] ret_from_fork+0x31/0x70
[ 53.584296][ C0] ? __pfx_kthread+0x10/0x10
[ 53.584455][ C0] ret_from_fork_asm+0x1a/0x30
[ 53.584613][ C0] </TASK>