[ 28.412610][ T283] 8021q: 802.1Q VLAN Support v1.8 [ 33.615953][ T330] gre: GRE over IPv4 demultiplexor driver [ 33.632487][ T330] ip_gre: GRE over IPv4 tunneling driver [ 34.964288][ T347] lag: Mode changed to "loadbalance" [ 35.129888][ T349] ip (349) used greatest stack depth: 24448 bytes left [ 35.298001][ T350] lag: Port device veth2 added [ 35.677555][ T354] lag: Port device veth4 added [ 35.909821][ T356] 8021q: adding VLAN 0 to HW filter on device lag [ 36.043416][ T357] br1: port 1(lag) entered blocking state [ 36.043695][ T357] br1: port 1(lag) entered disabled state [ 36.044865][ T357] lag: entered allmulticast mode [ 36.045063][ T357] veth2: entered allmulticast mode [ 36.045348][ T357] veth4: entered allmulticast mode [ 36.047697][ T357] veth2: entered promiscuous mode [ 36.048017][ T357] veth4: entered promiscuous mode [ 36.177350][ T358] br1: port 1(lag) entered blocking state [ 36.177701][ T358] br1: port 1(lag) entered forwarding state [ 37.141091][ T367] GACT probability NOT on [ 37.938953][ C2] [ 37.939073][ C2] ======================================================== [ 37.939311][ C2] WARNING: possible irq lock inversion dependency detected [ 37.939516][ C2] 6.9.0-rc1-virtme #1 Not tainted [ 37.939652][ C2] -------------------------------------------------------- [ 37.939851][ C2] swapper/2/0 just changed the state of lock: [ 37.940039][ C2] ffff888007f18d80 (&ndev->lock){++-.}-{2:2}, at: addrconf_rs_timer+0xa9/0x730 [ 37.940306][ C2] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 37.940518][ C2] (&p->alloc_lock){+.+.}-{2:2} [ 37.940522][ C2] [ 37.940522][ C2] [ 37.940522][ C2] and interrupts could create inverse lock ordering between them. [ 37.940522][ C2] [ 37.941012][ C2] [ 37.941012][ C2] other info that might help us debug this: [ 37.941210][ C2] Possible interrupt unsafe locking scenario: [ 37.941210][ C2] [ 37.941425][ C2] CPU0 CPU1 [ 37.941569][ C2] ---- ---- [ 37.941706][ C2] lock(&p->alloc_lock); [ 37.941809][ C2] local_irq_disable(); [ 37.942006][ C2] lock(&ndev->lock); [ 37.942189][ C2] lock(&p->alloc_lock); [ 37.942409][ C2] [ 37.942512][ C2] lock(&ndev->lock); [ 37.942621][ C2] [ 37.942621][ C2] *** DEADLOCK *** [ 37.942621][ C2] [ 37.942814][ C2] 1 lock held by swapper/2/0: [ 37.942988][ C2] #0: ffffc90000230d68 ((&ndev->rs_timer)){+.-.}-{0:0}, at: call_timer_fn+0xe8/0x230 [ 37.943272][ C2] [ 37.943272][ C2] the shortest dependencies between 2nd lock and 1st lock: [ 37.943500][ C2] -> (&p->alloc_lock){+.+.}-{2:2} { [ 37.943642][ C2] HARDIRQ-ON-W at: [ 37.943743][ C2] __lock_acquire+0x797/0x1570 [ 37.943920][ C2] lock_acquire.part.0+0xeb/0x330 [ 37.944088][ C2] _raw_spin_lock+0x30/0x40 [ 37.944339][ C2] set_mems_allowed+0x1d/0x210 [ 37.944573][ C2] kernel_init_freeable+0x72/0x310 [ 37.944749][ C2] kernel_init+0x20/0x200 [ 37.944940][ C2] ret_from_fork+0x31/0x70 [ 37.945113][ C2] ret_from_fork_asm+0x1a/0x30 [ 37.945294][ C2] SOFTIRQ-ON-W at: [ 37.945393][ C2] __lock_acquire+0x797/0x1570 [ 37.945564][ C2] lock_acquire.part.0+0xeb/0x330 [ 37.945730][ C2] _raw_spin_lock+0x30/0x40 [ 37.945908][ C2] set_mems_allowed+0x1d/0x210 [ 37.946073][ C2] kernel_init_freeable+0x72/0x310 [ 37.946251][ C2] kernel_init+0x20/0x200 [ 37.946419][ C2] ret_from_fork+0x31/0x70 [ 37.946588][ C2] ret_from_fork_asm+0x1a/0x30 [ 37.946752][ C2] INITIAL USE at: [ 37.946851][ C2] __lock_acquire+0x797/0x1570 [ 37.947025][ C2] lock_acquire.part.0+0xeb/0x330 [ 37.947200][ C2] _raw_spin_lock+0x30/0x40 [ 37.947364][ C2] set_mems_allowed+0x1d/0x210 [ 37.947529][ C2] kernel_init_freeable+0x72/0x310 [ 37.947698][ C2] kernel_init+0x20/0x200 [ 37.947864][ C2] ret_from_fork+0x31/0x70 [ 37.948033][ C2] ret_from_fork_asm+0x1a/0x30 [ 37.948245][ C2] } [ 37.948316][ C2] ... key at: [] __key.387+0x0/0x40 [ 37.948515][ C2] ... acquired at: [ 37.948614][ C2] __lock_acquire+0xaf0/0x1570 [ 37.948750][ C2] lock_acquire.part.0+0xeb/0x330 [ 37.948895][ C2] _raw_spin_lock+0x30/0x40 [ 37.949058][ C2] __get_task_comm+0x27/0x70 [ 37.949223][ C2] ref_tracker_alloc+0x2ee/0x490 [ 37.949374][ C2] netdev_get_by_index+0x5e/0x80 [ 37.949516][ C2] fib6_nh_init+0x3d8/0x15b0 [ 37.949670][ C2] ip6_route_info_create+0xf18/0x17d0 [ 37.949819][ C2] addrconf_f6i_alloc+0x265/0x560 [ 37.949975][ C2] __ipv6_dev_ac_inc+0x25f/0xb10 [ 37.950116][ C2] addrconf_join_anycast+0x1c0/0x220 [ 37.950267][ C2] dev_forward_change+0x2a6/0x7b0 [ 37.950400][ C2] addrconf_fixup_forwarding+0x23f/0x460 [ 37.950565][ C2] addrconf_sysctl_forward+0x212/0x2b0 [ 37.950701][ C2] proc_sys_call_handler+0x403/0x5e0 [ 37.950836][ C2] vfs_write+0x9e5/0x10a0 [ 37.950971][ C2] ksys_write+0xf5/0x1e0 [ 37.951102][ C2] do_syscall_64+0xc6/0x1e0 [ 37.951248][ C2] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 37.951421][ C2] [ 37.951491][ C2] -> (&ndev->lock){++-.}-{2:2} { [ 37.951632][ C2] HARDIRQ-ON-W at: [ 37.951753][ C2] __lock_acquire+0x797/0x1570 [ 37.951929][ C2] lock_acquire.part.0+0xeb/0x330 [ 37.952126][ C2] _raw_write_lock_bh+0x38/0x50 [ 37.952305][ C2] addrconf_permanent_addr+0x6e/0x670 [ 37.952595][ C2] addrconf_notify+0x749/0xd60 [ 37.952777][ C2] notifier_call_chain+0xcd/0x150 [ 37.952964][ C2] __dev_notify_flags+0xe6/0x250 [ 37.953175][ C2] dev_change_flags+0xec/0x160 [ 37.953424][ C2] do_setlink+0x7d6/0x21e0 [ 37.953609][ C2] __rtnl_newlink+0xaa7/0xd80 [ 37.953784][ C2] rtnl_newlink+0x63/0xa0 [ 37.954048][ C2] rtnetlink_rcv_msg+0x2fb/0xbf0 [ 37.954242][ C2] netlink_rcv_skb+0x130/0x360 [ 37.954410][ C2] netlink_unicast+0x449/0x710 [ 37.954576][ C2] netlink_sendmsg+0x723/0xbe0 [ 37.954816][ C2] ____sys_sendmsg+0x7b2/0xa10 [ 37.954986][ C2] ___sys_sendmsg+0xee/0x170 [ 37.955175][ C2] __sys_sendmsg+0xcd/0x170 [ 37.955437][ C2] do_syscall_64+0xc6/0x1e0 [ 37.955606][ C2] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 37.955816][ C2] HARDIRQ-ON-R at: [ 37.955925][ C2] __lock_acquire+0x797/0x1570 [ 37.956187][ C2] lock_acquire.part.0+0xeb/0x330 [ 37.956386][ C2] _raw_read_lock_bh+0x44/0x80 [ 37.956572][ C2] inet6_fill_ifla6_attrs+0x516/0x740 [ 37.956823][ C2] inet6_fill_link_af+0x5e/0xe0 [ 37.957002][ C2] rtnl_fill_ifinfo+0x1612/0x29e0 [ 37.957183][ C2] rtmsg_ifinfo_build_skb+0x13c/0x240 [ 37.957424][ C2] rtmsg_ifinfo_event.part.0+0x2d/0x120 [ 37.957640][ C2] rtmsg_ifinfo+0x5b/0xa0 [ 37.957821][ C2] register_netdevice+0x1177/0x1690 [ 37.958003][ C2] register_netdev+0x20/0x40 [ 37.958264][ C2] sit_init_net+0x250/0x4f0 [ 37.958430][ C2] ops_init+0x9b/0x560 [ 37.958562][ C2] register_pernet_operations+0x2db/0x710 [ 37.958852][ C2] register_pernet_device+0x2a/0x60 [ 37.959036][ C2] sit_init+0x23/0xe0 [ 37.959170][ C2] do_one_initcall+0x8d/0x1e0 [ 37.959370][ C2] do_initcalls+0x1b2/0x3e0 [ 37.959651][ C2] kernel_init_freeable+0x232/0x310 [ 37.959823][ C2] kernel_init+0x20/0x200 [ 37.960003][ C2] ret_from_fork+0x31/0x70 [ 37.960289][ C2] ret_from_fork_asm+0x1a/0x30 [ 37.960477][ C2] IN-SOFTIRQ-W at: [ 37.960608][ C2] __lock_acquire+0x797/0x1570 [ 37.960798][ C2] lock_acquire.part.0+0xeb/0x330 [ 37.961060][ C2] _raw_write_lock+0x30/0x40 [ 37.961245][ C2] addrconf_rs_timer+0xa9/0x730 [ 37.961413][ C2] call_timer_fn+0x13b/0x230 [ 37.961625][ C2] __run_timers+0x545/0x810 [ 37.961818][ C2] run_timer_softirq+0xe8/0x1b0 [ 37.962002][ C2] __do_softirq+0x1f8/0x5df [ 37.962190][ C2] irq_exit_rcu+0x97/0xc0 [ 37.962458][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 37.962688][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 37.962926][ C2] default_idle+0xf/0x20 [ 37.963199][ C2] default_idle_call+0x6d/0xb0 [ 37.963364][ C2] cpuidle_idle_call+0x1f4/0x280 [ 37.963532][ C2] do_idle+0xf9/0x160 [ 37.963761][ C2] cpu_startup_entry+0x54/0x60 [ 37.963954][ C2] start_secondary+0x21c/0x2b0 [ 37.964123][ C2] common_startup_64+0x12c/0x138 [ 37.964309][ C2] INITIAL USE at: [ 37.964517][ C2] __lock_acquire+0x797/0x1570 [ 37.964686][ C2] lock_acquire.part.0+0xeb/0x330 [ 37.964867][ C2] _raw_write_lock_bh+0x38/0x50 [ 37.965129][ C2] addrconf_permanent_addr+0x6e/0x670 [ 37.965295][ C2] addrconf_notify+0x749/0xd60 [ 37.965458][ C2] notifier_call_chain+0xcd/0x150 [ 37.965648][ C2] __dev_notify_flags+0xe6/0x250 [ 37.965913][ C2] dev_change_flags+0xec/0x160 [ 37.966081][ C2] do_setlink+0x7d6/0x21e0 [ 37.966273][ C2] __rtnl_newlink+0xaa7/0xd80 [ 37.966548][ C2] rtnl_newlink+0x63/0xa0 [ 37.966738][ C2] rtnetlink_rcv_msg+0x2fb/0xbf0 [ 37.966924][ C2] netlink_rcv_skb+0x130/0x360 [ 37.967115][ C2] netlink_unicast+0x449/0x710 [ 37.967392][ C2] netlink_sendmsg+0x723/0xbe0 [ 37.967556][ C2] ____sys_sendmsg+0x7b2/0xa10 [ 37.967751][ C2] ___sys_sendmsg+0xee/0x170 [ 37.968022][ C2] __sys_sendmsg+0xcd/0x170 [ 37.968186][ C2] do_syscall_64+0xc6/0x1e0 [ 37.968358][ C2] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 37.968559][ C2] INITIAL READ USE at: [ 37.968658][ C2] __lock_acquire+0x797/0x1570 [ 37.968823][ C2] lock_acquire.part.0+0xeb/0x330 [ 37.968990][ C2] _raw_read_lock_bh+0x44/0x80 [ 37.969159][ C2] inet6_fill_ifla6_attrs+0x516/0x740 [ 37.969362][ C2] inet6_fill_link_af+0x5e/0xe0 [ 37.969526][ C2] rtnl_fill_ifinfo+0x1612/0x29e0 [ 37.969770][ C2] rtmsg_ifinfo_build_skb+0x13c/0x240 [ 37.969966][ C2] rtmsg_ifinfo_event.part.0+0x2d/0x120 [ 37.970166][ C2] rtmsg_ifinfo+0x5b/0xa0 [ 37.970407][ C2] register_netdevice+0x1177/0x1690 [ 37.970629][ C2] register_netdev+0x20/0x40 [ 37.970794][ C2] sit_init_net+0x250/0x4f0 [ 37.971048][ C2] ops_init+0x9b/0x560 [ 37.971231][ C2] register_pernet_operations+0x2db/0x710 [ 37.971443][ C2] register_pernet_device+0x2a/0x60 [ 37.971734][ C2] sit_init+0x23/0xe0 [ 37.971905][ C2] do_one_initcall+0x8d/0x1e0 [ 37.972088][ C2] do_initcalls+0x1b2/0x3e0 [ 37.972264][ C2] kernel_init_freeable+0x232/0x310 [ 37.972589][ C2] kernel_init+0x20/0x200 [ 37.972755][ C2] ret_from_fork+0x31/0x70 [ 37.972928][ C2] ret_from_fork_asm+0x1a/0x30 [ 37.973261][ C2] } [ 37.973328][ C2] ... key at: [] __key.37+0x0/0x40 [ 37.973528][ C2] ... acquired at: [ 37.973627][ C2] mark_lock+0x28d/0x3e0 [ 37.973836][ C2] mark_usage+0xd9/0x2a0 [ 37.973968][ C2] __lock_acquire+0x797/0x1570 [ 37.974125][ C2] lock_acquire.part.0+0xeb/0x330 [ 37.974278][ C2] _raw_write_lock+0x30/0x40 [ 37.974416][ C2] addrconf_rs_timer+0xa9/0x730 [ 37.974644][ C2] call_timer_fn+0x13b/0x230 [ 37.974780][ C2] __run_timers+0x545/0x810 [ 37.974924][ C2] run_timer_softirq+0xe8/0x1b0 [ 37.975057][ C2] __do_softirq+0x1f8/0x5df [ 37.975296][ C2] irq_exit_rcu+0x97/0xc0 [ 37.975430][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 37.975593][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 37.975758][ C2] default_idle+0xf/0x20 [ 37.975972][ C2] default_idle_call+0x6d/0xb0 [ 37.976126][ C2] cpuidle_idle_call+0x1f4/0x280 [ 37.976260][ C2] do_idle+0xf9/0x160 [ 37.976380][ C2] cpu_startup_entry+0x54/0x60 [ 37.976515][ C2] start_secondary+0x21c/0x2b0 [ 37.976658][ C2] common_startup_64+0x12c/0x138 [ 37.976793][ C2] [ 37.976885][ C2] [ 37.976885][ C2] stack backtrace: [ 37.977052][ C2] CPU: 2 PID: 0 Comm: swapper/2 Not tainted 6.9.0-rc1-virtme #1 [ 37.977295][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 37.977618][ C2] Call Trace: [ 37.977819][ C2] [ 37.977892][ C2] dump_stack_lvl+0x82/0xd0 [ 37.978032][ C2] print_irq_inversion_bug.part.0+0x3d9/0x570 [ 37.978200][ C2] ? kernel_text_address+0x17/0xe0 [ 37.978366][ C2] ? __pfx_print_irq_inversion_bug.part.0+0x10/0x10 [ 37.978652][ C2] ? __pfx_usage_skip+0x10/0x10 [ 37.978787][ C2] ? __pfx_usage_match+0x10/0x10 [ 37.978943][ C2] ? arch_stack_walk+0x8c/0xf0 [ 37.979097][ C2] mark_lock_irq+0x4cd/0xa10 [ 37.979326][ C2] ? common_startup_64+0x12c/0x138 [ 37.979462][ C2] ? __pfx_mark_lock_irq+0x10/0x10 [ 37.979620][ C2] ? __pfx_stack_trace_save+0x10/0x10 [ 37.979764][ C2] ? save_trace+0x8f/0x5b0 [ 37.980016][ C2] mark_lock+0x28d/0x3e0 [ 37.980124][ C2] ? __pfx_stack_trace_save+0x10/0x10 [ 37.980257][ C2] mark_usage+0xd9/0x2a0 [ 37.980384][ C2] __lock_acquire+0x797/0x1570 [ 37.980522][ C2] ? __pfx_validate_chain+0x10/0x10 [ 37.980664][ C2] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 37.980799][ C2] lock_acquire.part.0+0xeb/0x330 [ 37.980960][ C2] ? addrconf_rs_timer+0xa9/0x730 [ 37.981099][ C2] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 37.981236][ C2] ? trace_lock_acquire+0x135/0x1c0 [ 37.981401][ C2] ? addrconf_rs_timer+0xa9/0x730 [ 37.981535][ C2] ? lock_acquire+0x32/0xc0 [ 37.981699][ C2] ? addrconf_rs_timer+0xa9/0x730 [ 37.981936][ C2] _raw_write_lock+0x30/0x40 [ 37.982066][ C2] ? addrconf_rs_timer+0xa9/0x730 [ 37.982209][ C2] addrconf_rs_timer+0xa9/0x730 [ 37.982365][ C2] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 37.982514][ C2] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 37.982664][ C2] ? call_timer_fn+0xe8/0x230 [ 37.982802][ C2] ? lock_acquire+0x32/0xc0 [ 37.982955][ C2] ? call_timer_fn+0xe8/0x230 [ 37.983148][ C2] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 37.983360][ C2] call_timer_fn+0x13b/0x230 [ 37.983569][ C2] ? call_timer_fn+0xe8/0x230 [ 37.983791][ C2] ? call_timer_fn+0xe8/0x230 [ 37.983991][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 37.984429][ C2] ? mark_lock+0x38/0x3e0 [ 37.984569][ C2] __run_timers+0x545/0x810 [ 37.984777][ C2] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 37.984988][ C2] ? __pfx___run_timers+0x10/0x10 [ 37.985202][ C2] ? do_raw_spin_lock+0x131/0x270 [ 37.985516][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 37.985727][ C2] ? lock_acquire+0x32/0xc0 [ 37.985939][ C2] ? run_timer_softirq+0xe0/0x1b0 [ 37.986153][ C2] run_timer_softirq+0xe8/0x1b0 [ 37.986496][ C2] __do_softirq+0x1f8/0x5df [ 37.986711][ C2] irq_exit_rcu+0x97/0xc0 [ 37.986877][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 37.987087][ C2] [ 37.987197][ C2] [ 37.987444][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 37.987707][ C2] RIP: 0010:default_idle+0xf/0x20 [ 37.987935][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 20 35 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 37.988835][ C2] RSP: 0018:ffffc9000015fdf8 EFLAGS: 00000246 [ 37.989098][ C2] RAX: 0000000000103771 RBX: 1ffff9200002bfc1 RCX: ffffffffb810f9e5 [ 37.989557][ C2] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffffffb5aaa4a4 [ 37.989877][ C2] RBP: 0000000000000000 R08: 0000000000000001 R09: ffffed1005f2709c [ 37.990196][ C2] R10: ffff88802f9384e3 R11: ffff88802f93dc80 R12: 0000000000000000 [ 37.990654][ C2] R13: ffff888001b7c5c0 R14: dffffc0000000000 R15: 0000000000000000 [ 37.990973][ C2] ? ct_kernel_exit.constprop.0+0xc5/0xf0 [ 37.991186][ C2] ? cpuidle_idle_call+0x1f4/0x280 [ 37.991404][ C2] default_idle_call+0x6d/0xb0 [ 37.991760][ C2] cpuidle_idle_call+0x1f4/0x280 [ 37.991971][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 37.992184][ C2] ? tsc_verify_tsc_adjust+0x5e/0x2b0 [ 37.992400][ C2] do_idle+0xf9/0x160 [ 37.992701][ C2] cpu_startup_entry+0x54/0x60 [ 37.992911][ C2] start_secondary+0x21c/0x2b0 [ 37.993126][ C2] ? __pfx_start_secondary+0x10/0x10 [ 37.993263][ C2] common_startup_64+0x12c/0x138 [ 37.993410][ C2] [ 44.558401][ T397] Mirror/redirect action on [ 59.421036][ T9] br1: port 1(lag) entered disabled state [ 65.504931][ T9] br1: port 1(lag) entered blocking state [ 65.505159][ T9] br1: port 1(lag) entered forwarding state [ 80.818982][ T50] br1: port 1(lag) entered disabled state [ 86.980300][ T49] br1: port 1(lag) entered blocking state [ 86.980510][ T49] br1: port 1(lag) entered forwarding state [ 88.032131][ T491] lag: left allmulticast mode [ 88.032329][ T491] veth2: left allmulticast mode [ 88.032481][ T491] veth4: left allmulticast mode [ 88.032660][ T491] veth2: left promiscuous mode [ 88.032858][ T491] veth4: left promiscuous mode [ 88.033021][ T491] br1: port 1(lag) entered disabled state [ 88.154411][ T347] lag: Port device veth4 removed [ 88.158107][ T347] lag: Port device veth2 removed