[ 25.979956][ T269] veth0: entered allmulticast mode [ 25.981153][ T269] veth1: entered allmulticast mode [ 25.981470][ T269] veth2: entered allmulticast mode [ 25.981756][ T269] veth3: entered allmulticast mode [ 34.603447][ C3] [ 34.603660][ C3] ======================================================== [ 34.603894][ C3] WARNING: possible irq lock inversion dependency detected [ 34.604121][ C3] 6.9.0-rc1-virtme #1 Not tainted [ 34.604273][ C3] -------------------------------------------------------- [ 34.604493][ C3] swapper/3/0 just changed the state of lock: [ 34.604681][ C3] ffff88800642a580 (&ndev->lock){++-.}-{2:2}, at: addrconf_rs_timer+0xa9/0x730 [ 34.604966][ C3] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 34.605184][ C3] (&p->alloc_lock){+.+.}-{2:2} [ 34.605188][ C3] [ 34.605188][ C3] [ 34.605188][ C3] and interrupts could create inverse lock ordering between them. [ 34.605188][ C3] [ 34.605747][ C3] [ 34.605747][ C3] other info that might help us debug this: [ 34.605989][ C3] Possible interrupt unsafe locking scenario: [ 34.605989][ C3] [ 34.606216][ C3] CPU0 CPU1 [ 34.606372][ C3] ---- ---- [ 34.606520][ C3] lock(&p->alloc_lock); [ 34.606642][ C3] local_irq_disable(); [ 34.606835][ C3] lock(&ndev->lock); [ 34.607019][ C3] lock(&p->alloc_lock); [ 34.607208][ C3] [ 34.607323][ C3] lock(&ndev->lock); [ 34.607434][ C3] [ 34.607434][ C3] *** DEADLOCK *** [ 34.607434][ C3] [ 34.607650][ C3] 1 lock held by swapper/3/0: [ 34.607794][ C3] #0: ffffc90000288b68 ((&ndev->rs_timer)){+.-.}-{0:0}, at: call_timer_fn+0xe8/0x230 [ 34.608071][ C3] [ 34.608071][ C3] the shortest dependencies between 2nd lock and 1st lock: [ 34.608321][ C3] -> (&p->alloc_lock){+.+.}-{2:2} { [ 34.608477][ C3] HARDIRQ-ON-W at: [ 34.608588][ C3] __lock_acquire+0x797/0x1570 [ 34.608780][ C3] lock_acquire.part.0+0xeb/0x330 [ 34.608961][ C3] _raw_spin_lock+0x30/0x40 [ 34.609152][ C3] set_mems_allowed+0x1d/0x210 [ 34.609338][ C3] kernel_init_freeable+0x72/0x310 [ 34.609532][ C3] kernel_init+0x20/0x200 [ 34.609721][ C3] ret_from_fork+0x31/0x70 [ 34.609915][ C3] ret_from_fork_asm+0x1a/0x30 [ 34.610101][ C3] SOFTIRQ-ON-W at: [ 34.610219][ C3] __lock_acquire+0x797/0x1570 [ 34.610413][ C3] lock_acquire.part.0+0xeb/0x330 [ 34.610603][ C3] _raw_spin_lock+0x30/0x40 [ 34.610794][ C3] set_mems_allowed+0x1d/0x210 [ 34.610999][ C3] kernel_init_freeable+0x72/0x310 [ 34.611191][ C3] kernel_init+0x20/0x200 [ 34.611382][ C3] ret_from_fork+0x31/0x70 [ 34.611575][ C3] ret_from_fork_asm+0x1a/0x30 [ 34.611767][ C3] INITIAL USE at: [ 34.611879][ C3] __lock_acquire+0x797/0x1570 [ 34.612065][ C3] lock_acquire.part.0+0xeb/0x330 [ 34.612253][ C3] _raw_spin_lock+0x30/0x40 [ 34.612443][ C3] set_mems_allowed+0x1d/0x210 [ 34.612635][ C3] kernel_init_freeable+0x72/0x310 [ 34.612820][ C3] kernel_init+0x20/0x200 [ 34.613007][ C3] ret_from_fork+0x31/0x70 [ 34.613190][ C3] ret_from_fork_asm+0x1a/0x30 [ 34.613372][ C3] } [ 34.613451][ C3] ... key at: [] __key.387+0x0/0x40 [ 34.613689][ C3] ... acquired at: [ 34.613801][ C3] __lock_acquire+0xaf0/0x1570 [ 34.613954][ C3] lock_acquire.part.0+0xeb/0x330 [ 34.614101][ C3] _raw_spin_lock+0x30/0x40 [ 34.614248][ C3] __get_task_comm+0x27/0x70 [ 34.614399][ C3] ref_tracker_alloc+0x2ee/0x490 [ 34.614545][ C3] netdev_get_by_index+0x5e/0x80 [ 34.614690][ C3] fib6_nh_init+0x3d8/0x15b0 [ 34.614836][ C3] ip6_route_info_create+0xf18/0x17d0 [ 34.614992][ C3] addrconf_f6i_alloc+0x265/0x560 [ 34.615138][ C3] __ipv6_dev_ac_inc+0x25f/0xb10 [ 34.615288][ C3] addrconf_join_anycast+0x1c0/0x220 [ 34.615442][ C3] dev_forward_change+0x2a6/0x7b0 [ 34.615595][ C3] addrconf_fixup_forwarding+0x23f/0x460 [ 34.615782][ C3] addrconf_sysctl_forward+0x212/0x2b0 [ 34.615930][ C3] proc_sys_call_handler+0x403/0x5e0 [ 34.616082][ C3] vfs_write+0x9e5/0x10a0 [ 34.616231][ C3] ksys_write+0xf5/0x1e0 [ 34.616380][ C3] do_syscall_64+0xc6/0x1e0 [ 34.616530][ C3] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 34.616716][ C3] [ 34.616793][ C3] -> (&ndev->lock){++-.}-{2:2} { [ 34.616947][ C3] HARDIRQ-ON-W at: [ 34.617058][ C3] __lock_acquire+0x797/0x1570 [ 34.617245][ C3] lock_acquire.part.0+0xeb/0x330 [ 34.617437][ C3] _raw_write_lock_bh+0x38/0x50 [ 34.617627][ C3] addrconf_permanent_addr+0x6e/0x670 [ 34.617815][ C3] addrconf_notify+0x749/0xd60 [ 34.618003][ C3] notifier_call_chain+0xcd/0x150 [ 34.618197][ C3] __dev_notify_flags+0xe6/0x250 [ 34.618383][ C3] dev_change_flags+0xec/0x160 [ 34.618572][ C3] do_setlink+0x7d6/0x21e0 [ 34.618766][ C3] __rtnl_newlink+0xaa7/0xd80 [ 34.618953][ C3] rtnl_newlink+0x63/0xa0 [ 34.619136][ C3] rtnetlink_rcv_msg+0x2fb/0xbf0 [ 34.619318][ C3] netlink_rcv_skb+0x130/0x360 [ 34.619506][ C3] netlink_unicast+0x449/0x710 [ 34.619693][ C3] netlink_sendmsg+0x723/0xbe0 [ 34.619876][ C3] ____sys_sendmsg+0x7b2/0xa10 [ 34.620066][ C3] ___sys_sendmsg+0xee/0x170 [ 34.620250][ C3] __sys_sendmsg+0xcd/0x170 [ 34.620433][ C3] do_syscall_64+0xc6/0x1e0 [ 34.620616][ C3] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 34.620834][ C3] HARDIRQ-ON-R at: [ 34.620949][ C3] __lock_acquire+0x797/0x1570 [ 34.621131][ C3] lock_acquire.part.0+0xeb/0x330 [ 34.621324][ C3] _raw_read_lock_bh+0x44/0x80 [ 34.621519][ C3] inet6_fill_ifla6_attrs+0x516/0x740 [ 34.621706][ C3] inet6_fill_link_af+0x5e/0xe0 [ 34.621893][ C3] rtnl_fill_ifinfo+0x1612/0x29e0 [ 34.622083][ C3] rtmsg_ifinfo_build_skb+0x13c/0x240 [ 34.622269][ C3] rtmsg_ifinfo_event.part.0+0x2d/0x120 [ 34.622492][ C3] rtmsg_ifinfo+0x5b/0xa0 [ 34.622682][ C3] register_netdevice+0x1177/0x1690 [ 34.622869][ C3] register_netdev+0x20/0x40 [ 34.623060][ C3] sit_init_net+0x250/0x4f0 [ 34.623250][ C3] ops_init+0x9b/0x560 [ 34.623406][ C3] register_pernet_operations+0x2db/0x710 [ 34.623651][ C3] register_pernet_device+0x2a/0x60 [ 34.623837][ C3] sit_init+0x23/0xe0 [ 34.623992][ C3] do_one_initcall+0x8d/0x1e0 [ 34.624184][ C3] do_initcalls+0x1b2/0x3e0 [ 34.624372][ C3] kernel_init_freeable+0x232/0x310 [ 34.624565][ C3] kernel_init+0x20/0x200 [ 34.624757][ C3] ret_from_fork+0x31/0x70 [ 34.624949][ C3] ret_from_fork_asm+0x1a/0x30 [ 34.625136][ C3] IN-SOFTIRQ-W at: [ 34.625251][ C3] __lock_acquire+0x797/0x1570 [ 34.625434][ C3] lock_acquire.part.0+0xeb/0x330 [ 34.625616][ C3] _raw_write_lock+0x30/0x40 [ 34.625807][ C3] addrconf_rs_timer+0xa9/0x730 [ 34.625992][ C3] call_timer_fn+0x13b/0x230 [ 34.626179][ C3] __run_timers+0x545/0x810 [ 34.626364][ C3] timer_expire_remote+0x9b/0xe0 [ 34.626557][ C3] tmigr_handle_remote_cpu+0x270/0x430 [ 34.626744][ C3] tmigr_handle_remote_up+0x19f/0x2e0 [ 34.626929][ C3] tmigr_handle_remote+0x21d/0x3a0 [ 34.627114][ C3] __do_softirq+0x1f8/0x5df [ 34.627300][ C3] irq_exit_rcu+0x97/0xc0 [ 34.627484][ C3] sysvec_apic_timer_interrupt+0x75/0x80 [ 34.627703][ C3] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 34.627928][ C3] default_idle+0xf/0x20 [ 34.628120][ C3] default_idle_call+0x6d/0xb0 [ 34.628309][ C3] cpuidle_idle_call+0x1f4/0x280 [ 34.628502][ C3] do_idle+0xf9/0x160 [ 34.628652][ C3] cpu_startup_entry+0x54/0x60 [ 34.628841][ C3] start_secondary+0x21c/0x2b0 [ 34.629030][ C3] common_startup_64+0x12c/0x138 [ 34.629217][ C3] INITIAL USE at: [ 34.629331][ C3] __lock_acquire+0x797/0x1570 [ 34.629516][ C3] lock_acquire.part.0+0xeb/0x330 [ 34.629705][ C3] _raw_write_lock_bh+0x38/0x50 [ 34.629890][ C3] addrconf_permanent_addr+0x6e/0x670 [ 34.630076][ C3] addrconf_notify+0x749/0xd60 [ 34.630265][ C3] notifier_call_chain+0xcd/0x150 [ 34.630455][ C3] __dev_notify_flags+0xe6/0x250 [ 34.630640][ C3] dev_change_flags+0xec/0x160 [ 34.630827][ C3] do_setlink+0x7d6/0x21e0 [ 34.631013][ C3] __rtnl_newlink+0xaa7/0xd80 [ 34.631199][ C3] rtnl_newlink+0x63/0xa0 [ 34.631379][ C3] rtnetlink_rcv_msg+0x2fb/0xbf0 [ 34.631564][ C3] netlink_rcv_skb+0x130/0x360 [ 34.631748][ C3] netlink_unicast+0x449/0x710 [ 34.631928][ C3] netlink_sendmsg+0x723/0xbe0 [ 34.632110][ C3] ____sys_sendmsg+0x7b2/0xa10 [ 34.632294][ C3] ___sys_sendmsg+0xee/0x170 [ 34.632476][ C3] __sys_sendmsg+0xcd/0x170 [ 34.632657][ C3] do_syscall_64+0xc6/0x1e0 [ 34.632841][ C3] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 34.633065][ C3] INITIAL READ USE at: [ 34.633175][ C3] __lock_acquire+0x797/0x1570 [ 34.633355][ C3] lock_acquire.part.0+0xeb/0x330 [ 34.633550][ C3] _raw_read_lock_bh+0x44/0x80 [ 34.633737][ C3] inet6_fill_ifla6_attrs+0x516/0x740 [ 34.633959][ C3] inet6_fill_link_af+0x5e/0xe0 [ 34.634150][ C3] rtnl_fill_ifinfo+0x1612/0x29e0 [ 34.634336][ C3] rtmsg_ifinfo_build_skb+0x13c/0x240 [ 34.634559][ C3] rtmsg_ifinfo_event.part.0+0x2d/0x120 [ 34.634784][ C3] rtmsg_ifinfo+0x5b/0xa0 [ 34.634974][ C3] register_netdevice+0x1177/0x1690 [ 34.635202][ C3] register_netdev+0x20/0x40 [ 34.635392][ C3] sit_init_net+0x250/0x4f0 [ 34.635581][ C3] ops_init+0x9b/0x560 [ 34.635766][ C3] register_pernet_operations+0x2db/0x710 [ 34.635988][ C3] register_pernet_device+0x2a/0x60 [ 34.636210][ C3] sit_init+0x23/0xe0 [ 34.636400][ C3] do_one_initcall+0x8d/0x1e0 [ 34.636588][ C3] do_initcalls+0x1b2/0x3e0 [ 34.636774][ C3] kernel_init_freeable+0x232/0x310 [ 34.636996][ C3] kernel_init+0x20/0x200 [ 34.637182][ C3] ret_from_fork+0x31/0x70 [ 34.637369][ C3] ret_from_fork_asm+0x1a/0x30 [ 34.637553][ C3] } [ 34.637628][ C3] ... key at: [] __key.37+0x0/0x40 [ 34.637849][ C3] ... acquired at: [ 34.637956][ C3] mark_lock+0x28d/0x3e0 [ 34.638105][ C3] mark_usage+0xd9/0x2a0 [ 34.638251][ C3] __lock_acquire+0x797/0x1570 [ 34.638398][ C3] lock_acquire.part.0+0xeb/0x330 [ 34.638547][ C3] _raw_write_lock+0x30/0x40 [ 34.638694][ C3] addrconf_rs_timer+0xa9/0x730 [ 34.638842][ C3] call_timer_fn+0x13b/0x230 [ 34.638994][ C3] __run_timers+0x545/0x810 [ 34.639141][ C3] timer_expire_remote+0x9b/0xe0 [ 34.639287][ C3] tmigr_handle_remote_cpu+0x270/0x430 [ 34.639432][ C3] tmigr_handle_remote_up+0x19f/0x2e0 [ 34.639578][ C3] tmigr_handle_remote+0x21d/0x3a0 [ 34.639726][ C3] __do_softirq+0x1f8/0x5df [ 34.639871][ C3] irq_exit_rcu+0x97/0xc0 [ 34.640024][ C3] sysvec_apic_timer_interrupt+0x75/0x80 [ 34.640207][ C3] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 34.640395][ C3] default_idle+0xf/0x20 [ 34.640545][ C3] default_idle_call+0x6d/0xb0 [ 34.640695][ C3] cpuidle_idle_call+0x1f4/0x280 [ 34.640850][ C3] do_idle+0xf9/0x160 [ 34.640961][ C3] cpu_startup_entry+0x54/0x60 [ 34.641113][ C3] start_secondary+0x21c/0x2b0 [ 34.641266][ C3] common_startup_64+0x12c/0x138 [ 34.641416][ C3] [ 34.641493][ C3] [ 34.641493][ C3] stack backtrace: [ 34.641685][ C3] CPU: 3 PID: 0 Comm: swapper/3 Not tainted 6.9.0-rc1-virtme #1 [ 34.641910][ C3] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 34.642244][ C3] Call Trace: [ 34.642361][ C3] [ 34.642444][ C3] dump_stack_lvl+0x82/0xd0 [ 34.642601][ C3] print_irq_inversion_bug.part.0+0x3d9/0x570 [ 34.642788][ C3] ? kernel_text_address+0x17/0xe0 [ 34.642947][ C3] ? __pfx_print_irq_inversion_bug.part.0+0x10/0x10 [ 34.643134][ C3] ? __pfx_usage_skip+0x10/0x10 [ 34.643284][ C3] ? __pfx_usage_match+0x10/0x10 [ 34.643428][ C3] ? arch_stack_walk+0x8c/0xf0 [ 34.643588][ C3] mark_lock_irq+0x4cd/0xa10 [ 34.643743][ C3] ? common_startup_64+0x12c/0x138 [ 34.643889][ C3] ? __pfx_mark_lock_irq+0x10/0x10 [ 34.644035][ C3] ? __pfx_stack_trace_save+0x10/0x10 [ 34.644184][ C3] ? save_trace+0x8f/0x5b0 [ 34.644333][ C3] mark_lock+0x28d/0x3e0 [ 34.644442][ C3] ? __pfx_stack_trace_save+0x10/0x10 [ 34.644585][ C3] mark_usage+0xd9/0x2a0 [ 34.644694][ C3] __lock_acquire+0x797/0x1570 [ 34.644846][ C3] ? __pfx_validate_chain+0x10/0x10 [ 34.644991][ C3] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 34.645137][ C3] lock_acquire.part.0+0xeb/0x330 [ 34.645285][ C3] ? addrconf_rs_timer+0xa9/0x730 [ 34.645431][ C3] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 34.645581][ C3] ? trace_lock_acquire+0x135/0x1c0 [ 34.645726][ C3] ? addrconf_rs_timer+0xa9/0x730 [ 34.645869][ C3] ? lock_acquire+0x32/0xc0 [ 34.646020][ C3] ? addrconf_rs_timer+0xa9/0x730 [ 34.646172][ C3] _raw_write_lock+0x30/0x40 [ 34.646322][ C3] ? addrconf_rs_timer+0xa9/0x730 [ 34.646471][ C3] addrconf_rs_timer+0xa9/0x730 [ 34.646621][ C3] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 34.646775][ C3] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 34.646925][ C3] ? call_timer_fn+0xe8/0x230 [ 34.647077][ C3] ? lock_acquire+0x32/0xc0 [ 34.647227][ C3] ? call_timer_fn+0xe8/0x230 [ 34.647381][ C3] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 34.647530][ C3] call_timer_fn+0x13b/0x230 [ 34.647679][ C3] ? call_timer_fn+0xe8/0x230 [ 34.647829][ C3] ? call_timer_fn+0xe8/0x230 [ 34.647979][ C3] ? __pfx_call_timer_fn+0x10/0x10 [ 34.648134][ C3] ? mark_lock+0x38/0x3e0 [ 34.648251][ C3] __run_timers+0x545/0x810 [ 34.648400][ C3] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 34.648550][ C3] ? __pfx___run_timers+0x10/0x10 [ 34.648699][ C3] ? __lock_release+0x103/0x460 [ 34.648846][ C3] ? do_raw_spin_lock+0x131/0x270 [ 34.648997][ C3] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 34.649145][ C3] ? lock_acquire+0x32/0xc0 [ 34.649295][ C3] ? timer_expire_remote+0x93/0xe0 [ 34.649441][ C3] timer_expire_remote+0x9b/0xe0 [ 34.649586][ C3] tmigr_handle_remote_cpu+0x270/0x430 [ 34.649733][ C3] ? __pfx_tmigr_handle_remote_cpu+0x10/0x10 [ 34.649921][ C3] tmigr_handle_remote_up+0x19f/0x2e0 [ 34.650066][ C3] tmigr_handle_remote+0x21d/0x3a0 [ 34.650211][ C3] ? __pfx_tmigr_handle_remote+0x10/0x10 [ 34.650361][ C3] __do_softirq+0x1f8/0x5df [ 34.650509][ C3] irq_exit_rcu+0x97/0xc0 [ 34.650622][ C3] sysvec_apic_timer_interrupt+0x75/0x80 [ 34.650768][ C3] [ 34.650843][ C3] [ 34.650919][ C3] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 34.651102][ C3] RIP: 0010:default_idle+0xf/0x20 [ 34.651262][ C3] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d a3 30 35 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 34.651777][ C3] RSP: 0018:ffffc9000016fdf8 EFLAGS: 00000246 [ 34.651964][ C3] RAX: 00000000000715bb RBX: 1ffff9200002dfc1 RCX: ffffffff8510e9d5 [ 34.652192][ C3] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffffff82aaa4a4 [ 34.652417][ C3] RBP: 0000000000000000 R08: 0000000000000001 R09: ffffed1006c3709c [ 34.652644][ C3] R10: ffff8880361b84e3 R11: ffff8880361ad9b0 R12: 0000000000000000 [ 34.652881][ C3] R13: ffff888001b88040 R14: dffffc0000000000 R15: 0000000000000000 [ 34.653113][ C3] ? ct_kernel_exit.constprop.0+0xc5/0xf0 [ 34.653261][ C3] ? cpuidle_idle_call+0x1f4/0x280 [ 34.653409][ C3] default_idle_call+0x6d/0xb0 [ 34.653577][ C3] cpuidle_idle_call+0x1f4/0x280 [ 34.653731][ C3] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 34.653883][ C3] ? tsc_verify_tsc_adjust+0x5e/0x2b0 [ 34.654035][ C3] do_idle+0xf9/0x160 [ 34.654149][ C3] cpu_startup_entry+0x54/0x60 [ 34.654302][ C3] start_secondary+0x21c/0x2b0 [ 34.654459][ C3] ? __pfx_start_secondary+0x10/0x10 [ 34.654612][ C3] common_startup_64+0x12c/0x138 [ 34.654765][ C3] [ 39.478320][ T339] GACT probability NOT on [ 49.439359][ T269] veth0: left allmulticast mode [ 49.439579][ T269] veth1: left allmulticast mode [ 49.439758][ T269] veth2: left allmulticast mode [ 49.439930][ T269] veth3: left allmulticast mode