[ 25.827653][ T259] ip (259) used greatest stack depth: 23856 bytes left [ 28.264452][ T281] 8021q: 802.1Q VLAN Support v1.8 [ 33.263075][ T328] gre: GRE over IPv4 demultiplexor driver [ 33.279130][ T328] ip_gre: GRE over IPv4 tunneling driver [ 34.693225][ T345] lag: Mode changed to "loadbalance" [ 35.007172][ T348] lag: Port device veth2 added [ 35.442115][ T351] lag: Port device veth4 added [ 35.707071][ T353] 8021q: adding VLAN 0 to HW filter on device lag [ 35.826495][ T354] br1: port 1(lag) entered blocking state [ 35.826781][ T354] br1: port 1(lag) entered disabled state [ 35.827152][ T354] lag: entered allmulticast mode [ 35.827331][ T354] veth2: entered allmulticast mode [ 35.827645][ T354] veth4: entered allmulticast mode [ 35.830624][ T354] veth2: entered promiscuous mode [ 35.831017][ T354] veth4: entered promiscuous mode [ 35.956576][ T355] br1: port 1(lag) entered blocking state [ 35.956990][ T355] br1: port 1(lag) entered forwarding state [ 36.954239][ T364] GACT probability NOT on [ 37.762105][ C3] [ 37.762273][ C3] ======================================================== [ 37.762613][ C3] WARNING: possible irq lock inversion dependency detected [ 37.762957][ C3] 6.9.0-rc1-virtme #1 Not tainted [ 37.763189][ C3] -------------------------------------------------------- [ 37.763519][ C3] swapper/3/0 just changed the state of lock: [ 37.763801][ C3] ffff888006682580 (&ndev->lock){++-.}-{2:2}, at: addrconf_rs_timer+0xa9/0x730 [ 37.764216][ C3] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 37.764547][ C3] (&p->alloc_lock){+.+.}-{2:2} [ 37.764554][ C3] [ 37.764554][ C3] [ 37.764554][ C3] and interrupts could create inverse lock ordering between them. [ 37.764554][ C3] [ 37.765167][ C3] [ 37.765167][ C3] other info that might help us debug this: [ 37.765387][ C3] Possible interrupt unsafe locking scenario: [ 37.765387][ C3] [ 37.765606][ C3] CPU0 CPU1 [ 37.765764][ C3] ---- ---- [ 37.765920][ C3] lock(&p->alloc_lock); [ 37.766034][ C3] local_irq_disable(); [ 37.766220][ C3] lock(&ndev->lock); [ 37.766407][ C3] lock(&p->alloc_lock); [ 37.766599][ C3] [ 37.766734][ C3] lock(&ndev->lock); [ 37.766851][ C3] [ 37.766851][ C3] *** DEADLOCK *** [ 37.766851][ C3] [ 37.767073][ C3] 1 lock held by swapper/3/0: [ 37.767220][ C3] #0: ffffc90000288d68 ((&ndev->rs_timer)){+.-.}-{0:0}, at: call_timer_fn+0xe8/0x230 [ 37.767502][ C3] [ 37.767502][ C3] the shortest dependencies between 2nd lock and 1st lock: [ 37.767771][ C3] -> (&p->alloc_lock){+.+.}-{2:2} { [ 37.767925][ C3] HARDIRQ-ON-W at: [ 37.768049][ C3] __lock_acquire+0x797/0x1570 [ 37.768245][ C3] lock_acquire.part.0+0xeb/0x330 [ 37.768437][ C3] _raw_spin_lock+0x30/0x40 [ 37.768634][ C3] set_mems_allowed+0x1d/0x210 [ 37.768826][ C3] kernel_init_freeable+0x72/0x310 [ 37.769014][ C3] kernel_init+0x20/0x200 [ 37.769210][ C3] ret_from_fork+0x31/0x70 [ 37.769413][ C3] ret_from_fork_asm+0x1a/0x30 [ 37.769600][ C3] SOFTIRQ-ON-W at: [ 37.769727][ C3] __lock_acquire+0x797/0x1570 [ 37.769922][ C3] lock_acquire.part.0+0xeb/0x330 [ 37.770105][ C3] _raw_spin_lock+0x30/0x40 [ 37.770290][ C3] set_mems_allowed+0x1d/0x210 [ 37.770479][ C3] kernel_init_freeable+0x72/0x310 [ 37.770669][ C3] kernel_init+0x20/0x200 [ 37.770855][ C3] ret_from_fork+0x31/0x70 [ 37.771053][ C3] ret_from_fork_asm+0x1a/0x30 [ 37.771239][ C3] INITIAL USE at: [ 37.771349][ C3] __lock_acquire+0x797/0x1570 [ 37.771549][ C3] lock_acquire.part.0+0xeb/0x330 [ 37.771744][ C3] _raw_spin_lock+0x30/0x40 [ 37.771926][ C3] set_mems_allowed+0x1d/0x210 [ 37.772113][ C3] kernel_init_freeable+0x72/0x310 [ 37.772307][ C3] kernel_init+0x20/0x200 [ 37.772494][ C3] ret_from_fork+0x31/0x70 [ 37.772693][ C3] ret_from_fork_asm+0x1a/0x30 [ 37.772884][ C3] } [ 37.772963][ C3] ... key at: [] __key.387+0x0/0x40 [ 37.773189][ C3] ... acquired at: [ 37.773298][ C3] __lock_acquire+0xaf0/0x1570 [ 37.773449][ C3] lock_acquire.part.0+0xeb/0x330 [ 37.773603][ C3] _raw_spin_lock+0x30/0x40 [ 37.773842][ C3] __get_task_comm+0x27/0x70 [ 37.774042][ C3] ref_tracker_alloc+0x2ee/0x490 [ 37.774194][ C3] netdev_get_by_index+0x5e/0x80 [ 37.774347][ C3] fib6_nh_init+0x3d8/0x15b0 [ 37.774499][ C3] ip6_route_info_create+0xf18/0x17d0 [ 37.774656][ C3] addrconf_f6i_alloc+0x265/0x560 [ 37.774804][ C3] __ipv6_dev_ac_inc+0x25f/0xb10 [ 37.775043][ C3] addrconf_join_anycast+0x1c0/0x220 [ 37.775196][ C3] dev_forward_change+0x2a6/0x7b0 [ 37.775344][ C3] addrconf_fixup_forwarding+0x23f/0x460 [ 37.775620][ C3] addrconf_sysctl_forward+0x212/0x2b0 [ 37.775938][ C3] proc_sys_call_handler+0x403/0x5e0 [ 37.776087][ C3] vfs_write+0x9e5/0x10a0 [ 37.776241][ C3] ksys_write+0xf5/0x1e0 [ 37.776473][ C3] do_syscall_64+0xc6/0x1e0 [ 37.776633][ C3] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 37.776824][ C3] [ 37.776900][ C3] -> (&ndev->lock){++-.}-{2:2} { [ 37.777060][ C3] HARDIRQ-ON-W at: [ 37.777251][ C3] __lock_acquire+0x797/0x1570 [ 37.777435][ C3] lock_acquire.part.0+0xeb/0x330 [ 37.777629][ C3] _raw_write_lock_bh+0x38/0x50 [ 37.777821][ C3] addrconf_permanent_addr+0x6e/0x670 [ 37.778090][ C3] addrconf_notify+0x749/0xd60 [ 37.778279][ C3] notifier_call_chain+0xcd/0x150 [ 37.778468][ C3] __dev_notify_flags+0xe6/0x250 [ 37.778745][ C3] dev_change_flags+0xec/0x160 [ 37.778932][ C3] do_setlink+0x7d6/0x21e0 [ 37.779114][ C3] __rtnl_newlink+0xaa7/0xd80 [ 37.779300][ C3] rtnl_newlink+0x63/0xa0 [ 37.779487][ C3] rtnetlink_rcv_msg+0x2fb/0xbf0 [ 37.779756][ C3] netlink_rcv_skb+0x130/0x360 [ 37.779942][ C3] netlink_unicast+0x449/0x710 [ 37.780122][ C3] netlink_sendmsg+0x723/0xbe0 [ 37.780384][ C3] ____sys_sendmsg+0x7b2/0xa10 [ 37.780567][ C3] ___sys_sendmsg+0xee/0x170 [ 37.780760][ C3] __sys_sendmsg+0xcd/0x170 [ 37.780948][ C3] do_syscall_64+0xc6/0x1e0 [ 37.781205][ C3] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 37.781446][ C3] HARDIRQ-ON-R at: [ 37.781557][ C3] __lock_acquire+0x797/0x1570 [ 37.781825][ C3] lock_acquire.part.0+0xeb/0x330 [ 37.782007][ C3] _raw_read_lock_bh+0x44/0x80 [ 37.782181][ C3] inet6_fill_ifla6_attrs+0x516/0x740 [ 37.782349][ C3] inet6_fill_link_af+0x5e/0xe0 [ 37.782594][ C3] rtnl_fill_ifinfo+0x1612/0x29e0 [ 37.782772][ C3] rtmsg_ifinfo_build_skb+0x13c/0x240 [ 37.782937][ C3] rtmsg_ifinfo_event.part.0+0x2d/0x120 [ 37.783209][ C3] rtmsg_ifinfo+0x5b/0xa0 [ 37.783380][ C3] register_netdevice+0x1177/0x1690 [ 37.783548][ C3] register_netdev+0x20/0x40 [ 37.783873][ C3] sit_init_net+0x250/0x4f0 [ 37.784047][ C3] ops_init+0x9b/0x560 [ 37.784182][ C3] register_pernet_operations+0x2db/0x710 [ 37.784385][ C3] register_pernet_device+0x2a/0x60 [ 37.784636][ C3] sit_init+0x23/0xe0 [ 37.784773][ C3] do_one_initcall+0x8d/0x1e0 [ 37.784944][ C3] do_initcalls+0x1b2/0x3e0 [ 37.785197][ C3] kernel_init_freeable+0x232/0x310 [ 37.785367][ C3] kernel_init+0x20/0x200 [ 37.785534][ C3] ret_from_fork+0x31/0x70 [ 37.785713][ C3] ret_from_fork_asm+0x1a/0x30 [ 37.785977][ C3] IN-SOFTIRQ-W at: [ 37.786079][ C3] __lock_acquire+0x797/0x1570 [ 37.786251][ C3] lock_acquire.part.0+0xeb/0x330 [ 37.786418][ C3] _raw_write_lock+0x30/0x40 [ 37.786670][ C3] addrconf_rs_timer+0xa9/0x730 [ 37.786845][ C3] call_timer_fn+0x13b/0x230 [ 37.787016][ C3] __run_timers+0x545/0x810 [ 37.787272][ C3] run_timer_softirq+0xe8/0x1b0 [ 37.787442][ C3] __do_softirq+0x1f8/0x5df [ 37.787617][ C3] irq_exit_rcu+0x97/0xc0 [ 37.787875][ C3] sysvec_apic_timer_interrupt+0x75/0x80 [ 37.788080][ C3] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 37.788281][ C3] default_idle+0xf/0x20 [ 37.788534][ C3] default_idle_call+0x6d/0xb0 [ 37.788715][ C3] cpuidle_idle_call+0x1f4/0x280 [ 37.788892][ C3] do_idle+0xf9/0x160 [ 37.789028][ C3] cpu_startup_entry+0x54/0x60 [ 37.789273][ C3] start_secondary+0x21c/0x2b0 [ 37.789450][ C3] common_startup_64+0x12c/0x138 [ 37.789627][ C3] INITIAL USE at: [ 37.789737][ C3] __lock_acquire+0x797/0x1570 [ 37.789987][ C3] lock_acquire.part.0+0xeb/0x330 [ 37.790153][ C3] _raw_write_lock_bh+0x38/0x50 [ 37.790318][ C3] addrconf_permanent_addr+0x6e/0x670 [ 37.790562][ C3] addrconf_notify+0x749/0xd60 [ 37.790737][ C3] notifier_call_chain+0xcd/0x150 [ 37.790912][ C3] __dev_notify_flags+0xe6/0x250 [ 37.791078][ C3] dev_change_flags+0xec/0x160 [ 37.791325][ C3] do_setlink+0x7d6/0x21e0 [ 37.791502][ C3] __rtnl_newlink+0xaa7/0xd80 [ 37.791687][ C3] rtnl_newlink+0x63/0xa0 [ 37.791947][ C3] rtnetlink_rcv_msg+0x2fb/0xbf0 [ 37.792116][ C3] netlink_rcv_skb+0x130/0x360 [ 37.792297][ C3] netlink_unicast+0x449/0x710 [ 37.792540][ C3] netlink_sendmsg+0x723/0xbe0 [ 37.792721][ C3] ____sys_sendmsg+0x7b2/0xa10 [ 37.792894][ C3] ___sys_sendmsg+0xee/0x170 [ 37.793065][ C3] __sys_sendmsg+0xcd/0x170 [ 37.793312][ C3] do_syscall_64+0xc6/0x1e0 [ 37.793482][ C3] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 37.793706][ C3] INITIAL READ USE at: [ 37.793892][ C3] __lock_acquire+0x797/0x1570 [ 37.794060][ C3] lock_acquire.part.0+0xeb/0x330 [ 37.794229][ C3] _raw_read_lock_bh+0x44/0x80 [ 37.794399][ C3] inet6_fill_ifla6_attrs+0x516/0x740 [ 37.794768][ C3] inet6_fill_link_af+0x5e/0xe0 [ 37.794943][ C3] rtnl_fill_ifinfo+0x1612/0x29e0 [ 37.795110][ C3] rtmsg_ifinfo_build_skb+0x13c/0x240 [ 37.795385][ C3] rtmsg_ifinfo_event.part.0+0x2d/0x120 [ 37.795586][ C3] rtmsg_ifinfo+0x5b/0xa0 [ 37.795766][ C3] register_netdevice+0x1177/0x1690 [ 37.796055][ C3] register_netdev+0x20/0x40 [ 37.796224][ C3] sit_init_net+0x250/0x4f0 [ 37.796394][ C3] ops_init+0x9b/0x560 [ 37.796645][ C3] register_pernet_operations+0x2db/0x710 [ 37.796853][ C3] register_pernet_device+0x2a/0x60 [ 37.797054][ C3] sit_init+0x23/0xe0 [ 37.797305][ C3] do_one_initcall+0x8d/0x1e0 [ 37.797473][ C3] do_initcalls+0x1b2/0x3e0 [ 37.797654][ C3] kernel_init_freeable+0x232/0x310 [ 37.797935][ C3] kernel_init+0x20/0x200 [ 37.798103][ C3] ret_from_fork+0x31/0x70 [ 37.798275][ C3] ret_from_fork_asm+0x1a/0x30 [ 37.798451][ C3] } [ 37.798595][ C3] ... key at: [] __key.37+0x0/0x40 [ 37.798815][ C3] ... acquired at: [ 37.798914][ C3] mark_lock+0x28d/0x3e0 [ 37.799056][ C3] mark_usage+0xd9/0x2a0 [ 37.799268][ C3] __lock_acquire+0x797/0x1570 [ 37.799401][ C3] lock_acquire.part.0+0xeb/0x330 [ 37.799535][ C3] _raw_write_lock+0x30/0x40 [ 37.799678][ C3] addrconf_rs_timer+0xa9/0x730 [ 37.799826][ C3] call_timer_fn+0x13b/0x230 [ 37.800037][ C3] __run_timers+0x545/0x810 [ 37.800171][ C3] run_timer_softirq+0xe8/0x1b0 [ 37.800306][ C3] __do_softirq+0x1f8/0x5df [ 37.800439][ C3] irq_exit_rcu+0x97/0xc0 [ 37.800675][ C3] sysvec_apic_timer_interrupt+0x75/0x80 [ 37.800858][ C3] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 37.801026][ C3] default_idle+0xf/0x20 [ 37.801161][ C3] default_idle_call+0x6d/0xb0 [ 37.801376][ C3] cpuidle_idle_call+0x1f4/0x280 [ 37.801518][ C3] do_idle+0xf9/0x160 [ 37.801626][ C3] cpu_startup_entry+0x54/0x60 [ 37.801765][ C3] start_secondary+0x21c/0x2b0 [ 37.801979][ C3] common_startup_64+0x12c/0x138 [ 37.802117][ C3] [ 37.802185][ C3] [ 37.802185][ C3] stack backtrace: [ 37.802355][ C3] CPU: 3 PID: 0 Comm: swapper/3 Not tainted 6.9.0-rc1-virtme #1 [ 37.802648][ C3] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 37.802952][ C3] Call Trace: [ 37.803056][ C3] [ 37.803136][ C3] dump_stack_lvl+0x82/0xd0 [ 37.803360][ C3] print_irq_inversion_bug.part.0+0x3d9/0x570 [ 37.803525][ C3] ? kernel_text_address+0x17/0xe0 [ 37.803676][ C3] ? __pfx_print_irq_inversion_bug.part.0+0x10/0x10 [ 37.803852][ C3] ? __pfx_usage_skip+0x10/0x10 [ 37.804064][ C3] ? __pfx_usage_match+0x10/0x10 [ 37.804199][ C3] ? arch_stack_walk+0x8c/0xf0 [ 37.804335][ C3] mark_lock_irq+0x4cd/0xa10 [ 37.804472][ C3] ? common_startup_64+0x12c/0x138 [ 37.804609][ C3] ? __pfx_mark_lock_irq+0x10/0x10 [ 37.804759][ C3] ? __pfx_stack_trace_save+0x10/0x10 [ 37.804899][ C3] ? save_trace+0x8f/0x5b0 [ 37.805040][ C3] mark_lock+0x28d/0x3e0 [ 37.805144][ C3] ? __pfx_stack_trace_save+0x10/0x10 [ 37.805279][ C3] mark_usage+0xd9/0x2a0 [ 37.805385][ C3] __lock_acquire+0x797/0x1570 [ 37.805519][ C3] ? __pfx_validate_chain+0x10/0x10 [ 37.805665][ C3] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 37.805881][ C3] lock_acquire.part.0+0xeb/0x330 [ 37.806019][ C3] ? addrconf_rs_timer+0xa9/0x730 [ 37.806157][ C3] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 37.806294][ C3] ? trace_lock_acquire+0x135/0x1c0 [ 37.806507][ C3] ? addrconf_rs_timer+0xa9/0x730 [ 37.806651][ C3] ? lock_acquire+0x32/0xc0 [ 37.806793][ C3] ? addrconf_rs_timer+0xa9/0x730 [ 37.806928][ C3] _raw_write_lock+0x30/0x40 [ 37.807137][ C3] ? addrconf_rs_timer+0xa9/0x730 [ 37.807271][ C3] addrconf_rs_timer+0xa9/0x730 [ 37.807405][ C3] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 37.807553][ C3] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 37.807695][ C3] ? call_timer_fn+0xe8/0x230 [ 37.807911][ C3] ? lock_acquire+0x32/0xc0 [ 37.808046][ C3] ? call_timer_fn+0xe8/0x230 [ 37.808185][ C3] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 37.808319][ C3] call_timer_fn+0x13b/0x230 [ 37.808529][ C3] ? call_timer_fn+0xe8/0x230 [ 37.808673][ C3] ? call_timer_fn+0xe8/0x230 [ 37.808817][ C3] ? __pfx_call_timer_fn+0x10/0x10 [ 37.808957][ C3] ? mark_lock+0x38/0x3e0 [ 37.809139][ C3] __run_timers+0x545/0x810 [ 37.809278][ C3] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 37.809414][ C3] ? __pfx___run_timers+0x10/0x10 [ 37.809552][ C3] ? do_raw_spin_lock+0x131/0x270 [ 37.809697][ C3] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 37.809909][ C3] ? lock_acquire+0x32/0xc0 [ 37.810052][ C3] ? run_timer_softirq+0xe0/0x1b0 [ 37.810188][ C3] run_timer_softirq+0xe8/0x1b0 [ 37.810326][ C3] __do_softirq+0x1f8/0x5df [ 37.810540][ C3] irq_exit_rcu+0x97/0xc0 [ 37.810655][ C3] sysvec_apic_timer_interrupt+0x75/0x80 [ 37.810795][ C3] [ 37.810866][ C3] [ 37.810934][ C3] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 37.811179][ C3] RIP: 0010:default_idle+0xf/0x20 [ 37.811326][ C3] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d a3 30 35 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 37.811905][ C3] RSP: 0018:ffffc9000016fdf8 EFLAGS: 00000242 [ 37.812082][ C3] RAX: 0000000000093d19 RBX: 1ffff9200002dfc1 RCX: ffffffffb3d0e9d5 [ 37.812286][ C3] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffffffb16aa4a4 [ 37.812575][ C3] RBP: 0000000000000000 R08: 0000000000000001 R09: ffffed1006c3709c [ 37.812791][ C3] R10: ffff8880361b84e3 R11: ffff8880361bdc80 R12: 0000000000000000 [ 37.813000][ C3] R13: ffff888001b88040 R14: dffffc0000000000 R15: 0000000000000000 [ 37.813282][ C3] ? ct_kernel_exit.constprop.0+0xc5/0xf0 [ 37.813418][ C3] ? cpuidle_idle_call+0x1f4/0x280 [ 37.813554][ C3] default_idle_call+0x6d/0xb0 [ 37.813705][ C3] cpuidle_idle_call+0x1f4/0x280 [ 37.813926][ C3] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 37.814058][ C3] ? tsc_verify_tsc_adjust+0x5e/0x2b0 [ 37.814195][ C3] do_idle+0xf9/0x160 [ 37.814295][ C3] cpu_startup_entry+0x54/0x60 [ 37.814503][ C3] start_secondary+0x21c/0x2b0 [ 37.814642][ C3] ? __pfx_start_secondary+0x10/0x10 [ 37.814780][ C3] common_startup_64+0x12c/0x138 [ 37.814930][ C3] [ 44.525572][ T393] Mirror/redirect action on [ 59.494560][ T7] br1: port 1(lag) entered disabled state [ 65.606683][ T51] br1: port 1(lag) entered blocking state [ 65.606892][ T51] br1: port 1(lag) entered forwarding state [ 80.946059][ T49] br1: port 1(lag) entered disabled state [ 87.055917][ T51] br1: port 1(lag) entered blocking state [ 87.056164][ T51] br1: port 1(lag) entered forwarding state [ 88.232110][ T487] lag: left allmulticast mode [ 88.232294][ T487] veth2: left allmulticast mode [ 88.232442][ T487] veth4: left allmulticast mode [ 88.232596][ T487] veth2: left promiscuous mode [ 88.232752][ T487] veth4: left promiscuous mode [ 88.232897][ T487] br1: port 1(lag) entered disabled state [ 88.361190][ T345] lag: Port device veth4 removed [ 88.363621][ T345] lag: Port device veth2 removed