[ 63.698519][ T561] Mirror/redirect action on [ 63.821017][ C2] tc mirred to Houston: device veth2 is down [ 64.427614][ C1] tc mirred to Houston: device veth2 is down [ 64.490690][ C2] tc mirred to Houston: device veth2 is down [ 64.554676][ C1] tc mirred to Houston: device veth2 is down [ 64.719687][ C2] tc mirred to Houston: device veth3 is down [ 64.930578][ C0] tc mirred to Houston: device veth3 is down [ 64.962576][ C0] tc mirred to Houston: device veth3 is down [ 69.418489][ C0] [ 69.418750][ C0] ======================================================== [ 69.419135][ C0] WARNING: possible irq lock inversion dependency detected [ 69.419529][ C0] 6.9.0-rc1-virtme #1 Not tainted [ 69.419780][ C0] -------------------------------------------------------- [ 69.420158][ C0] swapper/0/0 just changed the state of lock: [ 69.420474][ C0] ffff88800657d580 (&ndev->lock){++-.}-{2:2}, at: addrconf_rs_timer+0xa9/0x730 [ 69.420937][ C0] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 69.421302][ C0] (&p->alloc_lock){+.+.}-{2:2} [ 69.421310][ C0] [ 69.421310][ C0] [ 69.421310][ C0] and interrupts could create inverse lock ordering between them. [ 69.421310][ C0] [ 69.422231][ C0] [ 69.422231][ C0] other info that might help us debug this: [ 69.422599][ C0] Possible interrupt unsafe locking scenario: [ 69.422599][ C0] [ 69.422969][ C0] CPU0 CPU1 [ 69.423217][ C0] ---- ---- [ 69.423472][ C0] lock(&p->alloc_lock); [ 69.423649][ C0] local_irq_disable(); [ 69.423920][ C0] lock(&ndev->lock); [ 69.424235][ C0] lock(&p->alloc_lock); [ 69.424559][ C0] [ 69.424755][ C0] lock(&ndev->lock); [ 69.424947][ C0] [ 69.424947][ C0] *** DEADLOCK *** [ 69.424947][ C0] [ 69.425315][ C0] 1 lock held by swapper/0/0: [ 69.425571][ C0] #0: ffffc90000007d68 ((&ndev->rs_timer)){+.-.}-{0:0}, at: call_timer_fn+0xe8/0x230 [ 69.426040][ C0] [ 69.426040][ C0] the shortest dependencies between 2nd lock and 1st lock: [ 69.426487][ C0] -> (&p->alloc_lock){+.+.}-{2:2} { [ 69.426750][ C0] HARDIRQ-ON-W at: [ 69.426945][ C0] __lock_acquire+0x797/0x1570 [ 69.427275][ C0] lock_acquire.part.0+0xeb/0x330 [ 69.427595][ C0] _raw_spin_lock+0x30/0x40 [ 69.427923][ C0] set_mems_allowed+0x1d/0x210 [ 69.428252][ C0] kernel_init_freeable+0x72/0x310 [ 69.428579][ C0] kernel_init+0x20/0x200 [ 69.428900][ C0] ret_from_fork+0x31/0x70 [ 69.429217][ C0] ret_from_fork_asm+0x1a/0x30 [ 69.429528][ C0] SOFTIRQ-ON-W at: [ 69.429720][ C0] __lock_acquire+0x797/0x1570 [ 69.430043][ C0] lock_acquire.part.0+0xeb/0x330 [ 69.430371][ C0] _raw_spin_lock+0x30/0x40 [ 69.430696][ C0] set_mems_allowed+0x1d/0x210 [ 69.431006][ C0] kernel_init_freeable+0x72/0x310 [ 69.431323][ C0] kernel_init+0x20/0x200 [ 69.431650][ C0] ret_from_fork+0x31/0x70 [ 69.431975][ C0] ret_from_fork_asm+0x1a/0x30 [ 69.432306][ C0] INITIAL USE at: [ 69.432499][ C0] __lock_acquire+0x797/0x1570 [ 69.432808][ C0] lock_acquire.part.0+0xeb/0x330 [ 69.433135][ C0] _raw_spin_lock+0x30/0x40 [ 69.433452][ C0] set_mems_allowed+0x1d/0x210 [ 69.433765][ C0] kernel_init_freeable+0x72/0x310 [ 69.434092][ C0] kernel_init+0x20/0x200 [ 69.434409][ C0] ret_from_fork+0x31/0x70 [ 69.434731][ C0] ret_from_fork_asm+0x1a/0x30 [ 69.435050][ C0] } [ 69.435181][ C0] ... key at: [] __key.387+0x0/0x40 [ 69.435562][ C0] ... acquired at: [ 69.435752][ C0] __lock_acquire+0xaf0/0x1570 [ 69.436008][ C0] lock_acquire.part.0+0xeb/0x330 [ 69.436272][ C0] _raw_spin_lock+0x30/0x40 [ 69.436527][ C0] __get_task_comm+0x27/0x70 [ 69.436783][ C0] ref_tracker_alloc+0x2ee/0x490 [ 69.437038][ C0] netdev_get_by_index+0x5e/0x80 [ 69.437297][ C0] fib6_nh_init+0x3d8/0x15b0 [ 69.437555][ C0] ip6_route_info_create+0xf18/0x17d0 [ 69.437815][ C0] addrconf_f6i_alloc+0x265/0x560 [ 69.438079][ C0] __ipv6_dev_ac_inc+0x25f/0xb10 [ 69.438339][ C0] addrconf_join_anycast+0x1c0/0x220 [ 69.438594][ C0] __ipv6_ifa_notify+0x6b3/0xaf0 [ 69.438850][ C0] addrconf_dad_completed+0x12b/0xe20 [ 69.439104][ C0] addrconf_dad_work+0x38c/0xab0 [ 69.439359][ C0] process_one_work+0xe2c/0x1730 [ 69.439651][ C0] worker_thread+0x587/0xd30 [ 69.439906][ C0] kthread+0x28a/0x350 [ 69.440105][ C0] ret_from_fork+0x31/0x70 [ 69.440360][ C0] ret_from_fork_asm+0x1a/0x30 [ 69.440624][ C0] [ 69.440761][ C0] -> (&ndev->lock){++-.}-{2:2} { [ 69.441026][ C0] HARDIRQ-ON-W at: [ 69.441213][ C0] __lock_acquire+0x797/0x1570 [ 69.441538][ C0] lock_acquire.part.0+0xeb/0x330 [ 69.441870][ C0] _raw_write_lock_bh+0x38/0x50 [ 69.442193][ C0] addrconf_permanent_addr+0x6e/0x670 [ 69.442510][ C0] addrconf_notify+0x749/0xd60 [ 69.442839][ C0] notifier_call_chain+0xcd/0x150 [ 69.443158][ C0] __dev_notify_flags+0xe6/0x250 [ 69.443473][ C0] dev_change_flags+0xec/0x160 [ 69.443795][ C0] do_setlink+0x7d6/0x21e0 [ 69.444127][ C0] __rtnl_newlink+0xaa7/0xd80 [ 69.444443][ C0] rtnl_newlink+0x63/0xa0 [ 69.444760][ C0] rtnetlink_rcv_msg+0x2fb/0xbf0 [ 69.445086][ C0] netlink_rcv_skb+0x130/0x360 [ 69.445406][ C0] netlink_unicast+0x449/0x710 [ 69.445720][ C0] netlink_sendmsg+0x723/0xbe0 [ 69.446037][ C0] ____sys_sendmsg+0x7b2/0xa10 [ 69.446363][ C0] ___sys_sendmsg+0xee/0x170 [ 69.446680][ C0] __sys_sendmsg+0xcd/0x170 [ 69.446999][ C0] do_syscall_64+0xc6/0x1e0 [ 69.447320][ C0] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 69.447707][ C0] HARDIRQ-ON-R at: [ 69.447899][ C0] __lock_acquire+0x797/0x1570 [ 69.448220][ C0] lock_acquire.part.0+0xeb/0x330 [ 69.448544][ C0] _raw_read_lock_bh+0x44/0x80 [ 69.448865][ C0] inet6_fill_ifla6_attrs+0x516/0x740 [ 69.449183][ C0] inet6_fill_link_af+0x5e/0xe0 [ 69.449511][ C0] rtnl_fill_ifinfo+0x1612/0x29e0 [ 69.449832][ C0] rtmsg_ifinfo_build_skb+0x13c/0x240 [ 69.450148][ C0] rtmsg_ifinfo_event.part.0+0x2d/0x120 [ 69.450540][ C0] rtmsg_ifinfo+0x5b/0xa0 [ 69.450855][ C0] register_netdevice+0x1177/0x1690 [ 69.451171][ C0] register_netdev+0x20/0x40 [ 69.451490][ C0] sit_init_net+0x250/0x4f0 [ 69.451811][ C0] ops_init+0x9b/0x560 [ 69.452067][ C0] register_pernet_operations+0x2db/0x710 [ 69.452466][ C0] register_pernet_device+0x2a/0x60 [ 69.452784][ C0] sit_init+0x23/0xe0 [ 69.453043][ C0] do_one_initcall+0x8d/0x1e0 [ 69.453362][ C0] do_initcalls+0x1b2/0x3e0 [ 69.453682][ C0] kernel_init_freeable+0x232/0x310 [ 69.453999][ C0] kernel_init+0x20/0x200 [ 69.454325][ C0] ret_from_fork+0x31/0x70 [ 69.454641][ C0] ret_from_fork_asm+0x1a/0x30 [ 69.454958][ C0] IN-SOFTIRQ-W at: [ 69.455150][ C0] __lock_acquire+0x797/0x1570 [ 69.455469][ C0] lock_acquire.part.0+0xeb/0x330 [ 69.455784][ C0] _raw_write_lock+0x30/0x40 [ 69.456104][ C0] addrconf_rs_timer+0xa9/0x730 [ 69.456431][ C0] call_timer_fn+0x13b/0x230 [ 69.456752][ C0] __run_timers+0x545/0x810 [ 69.457070][ C0] run_timer_softirq+0xe8/0x1b0 [ 69.457386][ C0] __do_softirq+0x1f8/0x5df [ 69.457703][ C0] irq_exit_rcu+0x97/0xc0 [ 69.458030][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 69.458408][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 69.458793][ C0] default_idle+0xf/0x20 [ 69.459109][ C0] default_idle_call+0x6d/0xb0 [ 69.459503][ C0] cpuidle_idle_call+0x1f4/0x280 [ 69.459746][ C0] do_idle+0xf9/0x160 [ 69.459909][ C0] cpu_startup_entry+0x54/0x60 [ 69.460114][ C0] rest_init+0x14f/0x260 [ 69.460324][ C0] start_kernel+0x318/0x3d0 [ 69.460528][ C0] x86_64_start_reservations+0x18/0x30 [ 69.460730][ C0] x86_64_start_kernel+0xba/0x110 [ 69.460927][ C0] common_startup_64+0x12c/0x138 [ 69.461125][ C0] INITIAL USE at: [ 69.461252][ C0] __lock_acquire+0x797/0x1570 [ 69.461457][ C0] lock_acquire.part.0+0xeb/0x330 [ 69.461665][ C0] _raw_write_lock_bh+0x38/0x50 [ 69.461878][ C0] addrconf_permanent_addr+0x6e/0x670 [ 69.462078][ C0] addrconf_notify+0x749/0xd60 [ 69.462284][ C0] notifier_call_chain+0xcd/0x150 [ 69.462485][ C0] __dev_notify_flags+0xe6/0x250 [ 69.462687][ C0] dev_change_flags+0xec/0x160 [ 69.462891][ C0] do_setlink+0x7d6/0x21e0 [ 69.463094][ C0] __rtnl_newlink+0xaa7/0xd80 [ 69.463295][ C0] rtnl_newlink+0x63/0xa0 [ 69.463506][ C0] rtnetlink_rcv_msg+0x2fb/0xbf0 [ 69.463706][ C0] netlink_rcv_skb+0x130/0x360 [ 69.463907][ C0] netlink_unicast+0x449/0x710 [ 69.464113][ C0] netlink_sendmsg+0x723/0xbe0 [ 69.464320][ C0] ____sys_sendmsg+0x7b2/0xa10 [ 69.464524][ C0] ___sys_sendmsg+0xee/0x170 [ 69.464727][ C0] __sys_sendmsg+0xcd/0x170 [ 69.464929][ C0] do_syscall_64+0xc6/0x1e0 [ 69.465142][ C0] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 69.465384][ C0] INITIAL READ USE at: [ 69.465515][ C0] __lock_acquire+0x797/0x1570 [ 69.465719][ C0] lock_acquire.part.0+0xeb/0x330 [ 69.465920][ C0] _raw_read_lock_bh+0x44/0x80 [ 69.466119][ C0] inet6_fill_ifla6_attrs+0x516/0x740 [ 69.466361][ C0] inet6_fill_link_af+0x5e/0xe0 [ 69.466560][ C0] rtnl_fill_ifinfo+0x1612/0x29e0 [ 69.466767][ C0] rtmsg_ifinfo_build_skb+0x13c/0x240 [ 69.467110][ C0] rtmsg_ifinfo_event.part.0+0x2d/0x120 [ 69.467350][ C0] rtmsg_ifinfo+0x5b/0xa0 [ 69.467548][ C0] register_netdevice+0x1177/0x1690 [ 69.467877][ C0] register_netdev+0x20/0x40 [ 69.468081][ C0] sit_init_net+0x250/0x4f0 [ 69.468289][ C0] ops_init+0x9b/0x560 [ 69.468487][ C0] register_pernet_operations+0x2db/0x710 [ 69.468814][ C0] register_pernet_device+0x2a/0x60 [ 69.469054][ C0] sit_init+0x23/0xe0 [ 69.469254][ C0] do_one_initcall+0x8d/0x1e0 [ 69.469575][ C0] do_initcalls+0x1b2/0x3e0 [ 69.469781][ C0] kernel_init_freeable+0x232/0x310 [ 69.470019][ C0] kernel_init+0x20/0x200 [ 69.470315][ C0] ret_from_fork+0x31/0x70 [ 69.470515][ C0] ret_from_fork_asm+0x1a/0x30 [ 69.470714][ C0] } [ 69.470795][ C0] ... key at: [] __key.37+0x0/0x40 [ 69.471128][ C0] ... acquired at: [ 69.471246][ C0] mark_lock+0x28d/0x3e0 [ 69.471415][ C0] mark_usage+0xd9/0x2a0 [ 69.471581][ C0] __lock_acquire+0x797/0x1570 [ 69.471831][ C0] lock_acquire.part.0+0xeb/0x330 [ 69.471988][ C0] _raw_write_lock+0x30/0x40 [ 69.472148][ C0] addrconf_rs_timer+0xa9/0x730 [ 69.472307][ C0] call_timer_fn+0x13b/0x230 [ 69.472554][ C0] __run_timers+0x545/0x810 [ 69.472727][ C0] run_timer_softirq+0xe8/0x1b0 [ 69.472887][ C0] __do_softirq+0x1f8/0x5df [ 69.473044][ C0] irq_exit_rcu+0x97/0xc0 [ 69.473205][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 69.473501][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 69.473698][ C0] default_idle+0xf/0x20 [ 69.473856][ C0] default_idle_call+0x6d/0xb0 [ 69.474023][ C0] cpuidle_idle_call+0x1f4/0x280 [ 69.474185][ C0] do_idle+0xf9/0x160 [ 69.474308][ C0] cpu_startup_entry+0x54/0x60 [ 69.474466][ C0] rest_init+0x14f/0x260 [ 69.474622][ C0] start_kernel+0x318/0x3d0 [ 69.474867][ C0] x86_64_start_reservations+0x18/0x30 [ 69.475039][ C0] x86_64_start_kernel+0xba/0x110 [ 69.475197][ C0] common_startup_64+0x12c/0x138 [ 69.475358][ C0] [ 69.475438][ C0] [ 69.475438][ C0] stack backtrace: [ 69.475725][ C0] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 6.9.0-rc1-virtme #1 [ 69.475968][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 69.476410][ C0] Call Trace: [ 69.476530][ C0] [ 69.476612][ C0] dump_stack_lvl+0x82/0xd0 [ 69.476780][ C0] print_irq_inversion_bug.part.0+0x3d9/0x570 [ 69.476981][ C0] ? kernel_text_address+0x17/0xe0 [ 69.477152][ C0] ? __pfx_print_irq_inversion_bug.part.0+0x10/0x10 [ 69.477350][ C0] ? __pfx_usage_skip+0x10/0x10 [ 69.477509][ C0] ? __pfx_usage_match+0x10/0x10 [ 69.477665][ C0] ? arch_stack_walk+0x8c/0xf0 [ 69.477912][ C0] mark_lock_irq+0x4cd/0xa10 [ 69.478068][ C0] ? common_startup_64+0x12c/0x138 [ 69.478226][ C0] ? __pfx_mark_lock_irq+0x10/0x10 [ 69.478383][ C0] ? __pfx_stack_trace_save+0x10/0x10 [ 69.478637][ C0] ? save_trace+0x8f/0x5b0 [ 69.478794][ C0] mark_lock+0x28d/0x3e0 [ 69.478914][ C0] ? __pfx_stack_trace_save+0x10/0x10 [ 69.479070][ C0] mark_usage+0xd9/0x2a0 [ 69.479194][ C0] __lock_acquire+0x797/0x1570 [ 69.479470][ C0] ? __pfx_validate_chain+0x10/0x10 [ 69.479630][ C0] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 69.479787][ C0] lock_acquire.part.0+0xeb/0x330 [ 69.479953][ C0] ? addrconf_rs_timer+0xa9/0x730 [ 69.480119][ C0] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 69.480276][ C0] ? trace_lock_acquire+0x135/0x1c0 [ 69.480433][ C0] ? addrconf_rs_timer+0xa9/0x730 [ 69.480589][ C0] ? lock_acquire+0x32/0xc0 [ 69.480746][ C0] ? addrconf_rs_timer+0xa9/0x730 [ 69.480904][ C0] _raw_write_lock+0x30/0x40 [ 69.481063][ C0] ? addrconf_rs_timer+0xa9/0x730 [ 69.481227][ C0] addrconf_rs_timer+0xa9/0x730 [ 69.481475][ C0] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 69.481633][ C0] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 69.481789][ C0] ? call_timer_fn+0xe8/0x230 [ 69.481947][ C0] ? lock_acquire+0x32/0xc0 [ 69.482104][ C0] ? call_timer_fn+0xe8/0x230 [ 69.482348][ C0] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 69.482507][ C0] call_timer_fn+0x13b/0x230 [ 69.482664][ C0] ? call_timer_fn+0xe8/0x230 [ 69.482826][ C0] ? call_timer_fn+0xe8/0x230 [ 69.483073][ C0] ? __pfx_call_timer_fn+0x10/0x10 [ 69.483242][ C0] ? mark_lock+0x38/0x3e0 [ 69.483366][ C0] __run_timers+0x545/0x810 [ 69.483522][ C0] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 69.483769][ C0] ? __pfx___run_timers+0x10/0x10 [ 69.483927][ C0] ? do_raw_spin_lock+0x131/0x270 [ 69.484082][ C0] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 69.484244][ C0] ? lock_acquire+0x32/0xc0 [ 69.484403][ C0] ? run_timer_softirq+0xe0/0x1b0 [ 69.484650][ C0] run_timer_softirq+0xe8/0x1b0 [ 69.484808][ C0] __do_softirq+0x1f8/0x5df [ 69.484967][ C0] irq_exit_rcu+0x97/0xc0 [ 69.485087][ C0] sysvec_apic_timer_interrupt+0x75/0x80 [ 69.485432][ C0] [ 69.485515][ C0] [ 69.485595][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 69.485796][ C0] RIP: 0010:default_idle+0xf/0x20 [ 69.485961][ C0] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d a3 30 35 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 69.486524][ C0] RSP: 0018:ffffffffbce07e00 EFLAGS: 00000246 [ 69.486732][ C0] RAX: 000000000012d7a5 RBX: 1ffffffff79c0fc2 RCX: ffffffffbbf0e9d5 [ 69.487060][ C0] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffffffb98aa4a4 [ 69.487302][ C0] RBP: 0000000000000000 R08: 0000000000000001 R09: ffffed1006c0709c [ 69.487628][ C0] R10: ffff8880360384e3 R11: ffff88803602d9b0 R12: 0000000000000000 [ 69.487864][ C0] R13: ffffffffbce1d000 R14: dffffc0000000000 R15: 0000000000014770 [ 69.488102][ C0] ? ct_kernel_exit.constprop.0+0xc5/0xf0 [ 69.488262][ C0] ? cpuidle_idle_call+0x1f4/0x280 [ 69.488517][ C0] default_idle_call+0x6d/0xb0 [ 69.488675][ C0] cpuidle_idle_call+0x1f4/0x280 [ 69.488830][ C0] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 69.488989][ C0] ? tsc_verify_tsc_adjust+0x5e/0x2b0 [ 69.489148][ C0] do_idle+0xf9/0x160 [ 69.489268][ C0] cpu_startup_entry+0x54/0x60 [ 69.489434][ C0] rest_init+0x14f/0x260 [ 69.489563][ C0] start_kernel+0x318/0x3d0 [ 69.489727][ C0] x86_64_start_reservations+0x18/0x30 [ 69.489974][ C0] x86_64_start_kernel+0xba/0x110 [ 69.490131][ C0] common_startup_64+0x12c/0x138 [ 69.490300][ C0]