[ 27.574590][ T272] veth0: entered allmulticast mode [ 27.575193][ T272] veth1: entered allmulticast mode [ 27.575662][ T272] veth2: entered allmulticast mode [ 27.575973][ T272] veth3: entered allmulticast mode [ 27.576281][ T272] veth4: entered allmulticast mode [ 27.576583][ T272] veth5: entered allmulticast mode [ 30.033961][ T293] ip (293) used greatest stack depth: 23696 bytes left [ 38.064065][ C3] [ 38.064220][ C3] ======================================================== [ 38.064434][ C3] WARNING: possible irq lock inversion dependency detected [ 38.064647][ C3] 6.9.0-rc1-virtme #1 Not tainted [ 38.064783][ C3] -------------------------------------------------------- [ 38.064983][ C3] swapper/3/0 just changed the state of lock: [ 38.065159][ C3] ffff88800284d580 (&ndev->lock){++-.}-{2:2}, at: addrconf_rs_timer+0xa9/0x730 [ 38.065409][ C3] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 38.065609][ C3] (&p->alloc_lock){+.+.}-{2:2} [ 38.065613][ C3] [ 38.065613][ C3] [ 38.065613][ C3] and interrupts could create inverse lock ordering between them. [ 38.065613][ C3] [ 38.066107][ C3] [ 38.066107][ C3] other info that might help us debug this: [ 38.066305][ C3] Possible interrupt unsafe locking scenario: [ 38.066305][ C3] [ 38.066504][ C3] CPU0 CPU1 [ 38.066638][ C3] ---- ---- [ 38.066774][ C3] lock(&p->alloc_lock); [ 38.066882][ C3] local_irq_disable(); [ 38.067050][ C3] lock(&ndev->lock); [ 38.067226][ C3] lock(&p->alloc_lock); [ 38.067404][ C3] [ 38.067508][ C3] lock(&ndev->lock); [ 38.067613][ C3] [ 38.067613][ C3] *** DEADLOCK *** [ 38.067613][ C3] [ 38.067814][ C3] 1 lock held by swapper/3/0: [ 38.067950][ C3] #0: ffffc90000288b68 ((&ndev->rs_timer)){+.-.}-{0:0}, at: call_timer_fn+0xe8/0x230 [ 38.068198][ C3] [ 38.068198][ C3] the shortest dependencies between 2nd lock and 1st lock: [ 38.068436][ C3] -> (&p->alloc_lock){+.+.}-{2:2} { [ 38.068578][ C3] HARDIRQ-ON-W at: [ 38.068809][ C3] __lock_acquire+0x797/0x1570 [ 38.068987][ C3] lock_acquire.part.0+0xeb/0x330 [ 38.069159][ C3] _raw_spin_lock+0x30/0x40 [ 38.069331][ C3] set_mems_allowed+0x1d/0x210 [ 38.069525][ C3] kernel_init_freeable+0x72/0x310 [ 38.069701][ C3] kernel_init+0x20/0x200 [ 38.069877][ C3] ret_from_fork+0x31/0x70 [ 38.070053][ C3] ret_from_fork_asm+0x1a/0x30 [ 38.070223][ C3] SOFTIRQ-ON-W at: [ 38.070325][ C3] __lock_acquire+0x797/0x1570 [ 38.070505][ C3] lock_acquire.part.0+0xeb/0x330 [ 38.070678][ C3] _raw_spin_lock+0x30/0x40 [ 38.070850][ C3] set_mems_allowed+0x1d/0x210 [ 38.071025][ C3] kernel_init_freeable+0x72/0x310 [ 38.071198][ C3] kernel_init+0x20/0x200 [ 38.071372][ C3] ret_from_fork+0x31/0x70 [ 38.071543][ C3] ret_from_fork_asm+0x1a/0x30 [ 38.071719][ C3] INITIAL USE at: [ 38.071823][ C3] __lock_acquire+0x797/0x1570 [ 38.072001][ C3] lock_acquire.part.0+0xeb/0x330 [ 38.072171][ C3] _raw_spin_lock+0x30/0x40 [ 38.072343][ C3] set_mems_allowed+0x1d/0x210 [ 38.072526][ C3] kernel_init_freeable+0x72/0x310 [ 38.072697][ C3] kernel_init+0x20/0x200 [ 38.072876][ C3] ret_from_fork+0x31/0x70 [ 38.073055][ C3] ret_from_fork_asm+0x1a/0x30 [ 38.073227][ C3] } [ 38.073304][ C3] ... key at: [] __key.387+0x0/0x40 [ 38.073511][ C3] ... acquired at: [ 38.073616][ C3] __lock_acquire+0xaf0/0x1570 [ 38.073757][ C3] lock_acquire.part.0+0xeb/0x330 [ 38.073900][ C3] _raw_spin_lock+0x30/0x40 [ 38.074040][ C3] __get_task_comm+0x27/0x70 [ 38.074189][ C3] ref_tracker_alloc+0x2ee/0x490 [ 38.074327][ C3] netdev_get_by_index+0x5e/0x80 [ 38.074464][ C3] fib6_nh_init+0x3d8/0x15b0 [ 38.074601][ C3] ip6_route_info_create+0xf18/0x17d0 [ 38.074738][ C3] addrconf_f6i_alloc+0x265/0x560 [ 38.074874][ C3] __ipv6_dev_ac_inc+0x25f/0xb10 [ 38.075016][ C3] addrconf_join_anycast+0x1c0/0x220 [ 38.075153][ C3] dev_forward_change+0x2a6/0x7b0 [ 38.075294][ C3] addrconf_fixup_forwarding+0x23f/0x460 [ 38.075464][ C3] addrconf_sysctl_forward+0x212/0x2b0 [ 38.075601][ C3] proc_sys_call_handler+0x403/0x5e0 [ 38.075737][ C3] vfs_write+0x9e5/0x10a0 [ 38.075875][ C3] ksys_write+0xf5/0x1e0 [ 38.076014][ C3] do_syscall_64+0xc6/0x1e0 [ 38.076158][ C3] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 38.076334][ C3] [ 38.076408][ C3] -> (&ndev->lock){++-.}-{2:2} { [ 38.076553][ C3] HARDIRQ-ON-W at: [ 38.076657][ C3] __lock_acquire+0x797/0x1570 [ 38.076831][ C3] lock_acquire.part.0+0xeb/0x330 [ 38.077002][ C3] _raw_write_lock_bh+0x38/0x50 [ 38.077175][ C3] addrconf_permanent_addr+0x6e/0x670 [ 38.077349][ C3] addrconf_notify+0x749/0xd60 [ 38.077526][ C3] notifier_call_chain+0xcd/0x150 [ 38.077700][ C3] __dev_notify_flags+0xe6/0x250 [ 38.077871][ C3] dev_change_flags+0xec/0x160 [ 38.078044][ C3] do_setlink+0x7d6/0x21e0 [ 38.078217][ C3] __rtnl_newlink+0xaa7/0xd80 [ 38.078395][ C3] rtnl_newlink+0x63/0xa0 [ 38.078580][ C3] rtnetlink_rcv_msg+0x2fb/0xbf0 [ 38.078751][ C3] netlink_rcv_skb+0x130/0x360 [ 38.078925][ C3] netlink_unicast+0x449/0x710 [ 38.079096][ C3] netlink_sendmsg+0x723/0xbe0 [ 38.079268][ C3] ____sys_sendmsg+0x7b2/0xa10 [ 38.079439][ C3] ___sys_sendmsg+0xee/0x170 [ 38.079621][ C3] __sys_sendmsg+0xcd/0x170 [ 38.079796][ C3] do_syscall_64+0xc6/0x1e0 [ 38.079967][ C3] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 38.080171][ C3] HARDIRQ-ON-R at: [ 38.080273][ C3] __lock_acquire+0x797/0x1570 [ 38.080445][ C3] lock_acquire.part.0+0xeb/0x330 [ 38.080616][ C3] _raw_read_lock_bh+0x44/0x80 [ 38.080789][ C3] inet6_fill_ifla6_attrs+0x516/0x740 [ 38.080963][ C3] inet6_fill_link_af+0x5e/0xe0 [ 38.081134][ C3] rtnl_fill_ifinfo+0x1612/0x29e0 [ 38.081310][ C3] rtmsg_ifinfo_build_skb+0x13c/0x240 [ 38.081481][ C3] rtmsg_ifinfo_event.part.0+0x2d/0x120 [ 38.081684][ C3] rtmsg_ifinfo+0x5b/0xa0 [ 38.081858][ C3] register_netdevice+0x1177/0x1690 [ 38.082029][ C3] register_netdev+0x20/0x40 [ 38.082200][ C3] sit_init_net+0x250/0x4f0 [ 38.082371][ C3] ops_init+0x9b/0x560 [ 38.082510][ C3] register_pernet_operations+0x2db/0x710 [ 38.082713][ C3] register_pernet_device+0x2a/0x60 [ 38.082883][ C3] sit_init+0x23/0xe0 [ 38.083027][ C3] do_one_initcall+0x8d/0x1e0 [ 38.083199][ C3] do_initcalls+0x1b2/0x3e0 [ 38.083379][ C3] kernel_init_freeable+0x232/0x310 [ 38.083556][ C3] kernel_init+0x20/0x200 [ 38.083729][ C3] ret_from_fork+0x31/0x70 [ 38.083920][ C3] ret_from_fork_asm+0x1a/0x30 [ 38.084167][ C3] IN-SOFTIRQ-W at: [ 38.084326][ C3] __lock_acquire+0x797/0x1570 [ 38.084577][ C3] lock_acquire.part.0+0xeb/0x330 [ 38.084837][ C3] _raw_write_lock+0x30/0x40 [ 38.085104][ C3] addrconf_rs_timer+0xa9/0x730 [ 38.085370][ C3] call_timer_fn+0x13b/0x230 [ 38.085643][ C3] __run_timers+0x545/0x810 [ 38.085925][ C3] timer_expire_remote+0x9b/0xe0 [ 38.086198][ C3] tmigr_handle_remote_cpu+0x270/0x430 [ 38.086475][ C3] tmigr_handle_remote_up+0x19f/0x2e0 [ 38.086750][ C3] tmigr_handle_remote+0x21d/0x3a0 [ 38.087034][ C3] __do_softirq+0x1f8/0x5df [ 38.087305][ C3] irq_exit_rcu+0x97/0xc0 [ 38.087593][ C3] sysvec_apic_timer_interrupt+0x75/0x80 [ 38.087924][ C3] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 38.088256][ C3] default_idle+0xf/0x20 [ 38.088532][ C3] default_idle_call+0x6d/0xb0 [ 38.088808][ C3] cpuidle_idle_call+0x1f4/0x280 [ 38.089087][ C3] do_idle+0xf9/0x160 [ 38.089315][ C3] cpu_startup_entry+0x54/0x60 [ 38.089576][ C3] start_secondary+0x21c/0x2b0 [ 38.089842][ C3] common_startup_64+0x12c/0x138 [ 38.090037][ C3] INITIAL USE at: [ 38.090168][ C3] __lock_acquire+0x797/0x1570 [ 38.090348][ C3] lock_acquire.part.0+0xeb/0x330 [ 38.090522][ C3] _raw_write_lock_bh+0x38/0x50 [ 38.090701][ C3] addrconf_permanent_addr+0x6e/0x670 [ 38.090873][ C3] addrconf_notify+0x749/0xd60 [ 38.091045][ C3] notifier_call_chain+0xcd/0x150 [ 38.091227][ C3] __dev_notify_flags+0xe6/0x250 [ 38.091401][ C3] dev_change_flags+0xec/0x160 [ 38.091571][ C3] do_setlink+0x7d6/0x21e0 [ 38.091746][ C3] __rtnl_newlink+0xaa7/0xd80 [ 38.091919][ C3] rtnl_newlink+0x63/0xa0 [ 38.092091][ C3] rtnetlink_rcv_msg+0x2fb/0xbf0 [ 38.092267][ C3] netlink_rcv_skb+0x130/0x360 [ 38.092440][ C3] netlink_unicast+0x449/0x710 [ 38.092613][ C3] netlink_sendmsg+0x723/0xbe0 [ 38.092784][ C3] ____sys_sendmsg+0x7b2/0xa10 [ 38.092962][ C3] ___sys_sendmsg+0xee/0x170 [ 38.093136][ C3] __sys_sendmsg+0xcd/0x170 [ 38.093319][ C3] do_syscall_64+0xc6/0x1e0 [ 38.093493][ C3] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 38.093697][ C3] INITIAL READ USE at: [ 38.093800][ C3] __lock_acquire+0x797/0x1570 [ 38.093970][ C3] lock_acquire.part.0+0xeb/0x330 [ 38.094155][ C3] _raw_read_lock_bh+0x44/0x80 [ 38.094386][ C3] inet6_fill_ifla6_attrs+0x516/0x740 [ 38.094592][ C3] inet6_fill_link_af+0x5e/0xe0 [ 38.094764][ C3] rtnl_fill_ifinfo+0x1612/0x29e0 [ 38.094934][ C3] rtmsg_ifinfo_build_skb+0x13c/0x240 [ 38.095148][ C3] rtmsg_ifinfo_event.part.0+0x2d/0x120 [ 38.095442][ C3] rtmsg_ifinfo+0x5b/0xa0 [ 38.095615][ C3] register_netdevice+0x1177/0x1690 [ 38.095818][ C3] register_netdev+0x20/0x40 [ 38.095989][ C3] sit_init_net+0x250/0x4f0 [ 38.096251][ C3] ops_init+0x9b/0x560 [ 38.096425][ C3] register_pernet_operations+0x2db/0x710 [ 38.096628][ C3] register_pernet_device+0x2a/0x60 [ 38.096910][ C3] sit_init+0x23/0xe0 [ 38.097081][ C3] do_one_initcall+0x8d/0x1e0 [ 38.097260][ C3] do_initcalls+0x1b2/0x3e0 [ 38.097511][ C3] kernel_init_freeable+0x232/0x310 [ 38.097717][ C3] kernel_init+0x20/0x200 [ 38.097892][ C3] ret_from_fork+0x31/0x70 [ 38.098156][ C3] ret_from_fork_asm+0x1a/0x30 [ 38.098331][ C3] } [ 38.098401][ C3] ... key at: [] __key.37+0x0/0x40 [ 38.098603][ C3] ... acquired at: [ 38.098780][ C3] mark_lock+0x28d/0x3e0 [ 38.098918][ C3] mark_usage+0xd9/0x2a0 [ 38.099059][ C3] __lock_acquire+0x797/0x1570 [ 38.099208][ C3] lock_acquire.part.0+0xeb/0x330 [ 38.099345][ C3] _raw_write_lock+0x30/0x40 [ 38.099650][ C3] addrconf_rs_timer+0xa9/0x730 [ 38.099787][ C3] call_timer_fn+0x13b/0x230 [ 38.099923][ C3] __run_timers+0x545/0x810 [ 38.100057][ C3] timer_expire_remote+0x9b/0xe0 [ 38.100310][ C3] tmigr_handle_remote_cpu+0x270/0x430 [ 38.100454][ C3] tmigr_handle_remote_up+0x19f/0x2e0 [ 38.100589][ C3] tmigr_handle_remote+0x21d/0x3a0 [ 38.100726][ C3] __do_softirq+0x1f8/0x5df [ 38.100940][ C3] irq_exit_rcu+0x97/0xc0 [ 38.101080][ C3] sysvec_apic_timer_interrupt+0x75/0x80 [ 38.101257][ C3] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 38.101451][ C3] default_idle+0xf/0x20 [ 38.101666][ C3] default_idle_call+0x6d/0xb0 [ 38.101808][ C3] cpuidle_idle_call+0x1f4/0x280 [ 38.101944][ C3] do_idle+0xf9/0x160 [ 38.102046][ C3] cpu_startup_entry+0x54/0x60 [ 38.102271][ C3] start_secondary+0x21c/0x2b0 [ 38.102409][ C3] common_startup_64+0x12c/0x138 [ 38.102552][ C3] [ 38.102621][ C3] [ 38.102621][ C3] stack backtrace: [ 38.102788][ C3] CPU: 3 PID: 0 Comm: swapper/3 Not tainted 6.9.0-rc1-virtme #1 [ 38.103078][ C3] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 38.103385][ C3] Call Trace: [ 38.103490][ C3] [ 38.103648][ C3] dump_stack_lvl+0x82/0xd0 [ 38.103789][ C3] print_irq_inversion_bug.part.0+0x3d9/0x570 [ 38.103958][ C3] ? kernel_text_address+0x17/0xe0 [ 38.104100][ C3] ? __pfx_print_irq_inversion_bug.part.0+0x10/0x10 [ 38.104363][ C3] ? __pfx_usage_skip+0x10/0x10 [ 38.104499][ C3] ? __pfx_usage_match+0x10/0x10 [ 38.104639][ C3] ? arch_stack_walk+0x8c/0xf0 [ 38.104779][ C3] mark_lock_irq+0x4cd/0xa10 [ 38.104993][ C3] ? common_startup_64+0x12c/0x138 [ 38.105129][ C3] ? __pfx_mark_lock_irq+0x10/0x10 [ 38.105273][ C3] ? __pfx_stack_trace_save+0x10/0x10 [ 38.105410][ C3] ? save_trace+0x8f/0x5b0 [ 38.105632][ C3] mark_lock+0x28d/0x3e0 [ 38.105734][ C3] ? __pfx_stack_trace_save+0x10/0x10 [ 38.105884][ C3] mark_usage+0xd9/0x2a0 [ 38.105987][ C3] __lock_acquire+0x797/0x1570 [ 38.106126][ C3] ? __pfx_validate_chain+0x10/0x10 [ 38.106351][ C3] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 38.106487][ C3] lock_acquire.part.0+0xeb/0x330 [ 38.106623][ C3] ? addrconf_rs_timer+0xa9/0x730 [ 38.106770][ C3] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 38.106987][ C3] ? trace_lock_acquire+0x135/0x1c0 [ 38.107125][ C3] ? addrconf_rs_timer+0xa9/0x730 [ 38.107266][ C3] ? lock_acquire+0x32/0xc0 [ 38.107403][ C3] ? addrconf_rs_timer+0xa9/0x730 [ 38.107539][ C3] _raw_write_lock+0x30/0x40 [ 38.107753][ C3] ? addrconf_rs_timer+0xa9/0x730 [ 38.107887][ C3] addrconf_rs_timer+0xa9/0x730 [ 38.108022][ C3] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 38.108169][ C3] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 38.108382][ C3] ? call_timer_fn+0xe8/0x230 [ 38.108519][ C3] ? lock_acquire+0x32/0xc0 [ 38.108669][ C3] ? call_timer_fn+0xe8/0x230 [ 38.108817][ C3] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 38.109043][ C3] call_timer_fn+0x13b/0x230 [ 38.109202][ C3] ? call_timer_fn+0xe8/0x230 [ 38.109337][ C3] ? call_timer_fn+0xe8/0x230 [ 38.109478][ C3] ? __pfx_call_timer_fn+0x10/0x10 [ 38.109706][ C3] ? mark_lock+0x38/0x3e0 [ 38.109814][ C3] __run_timers+0x545/0x810 [ 38.109949][ C3] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 38.110085][ C3] ? __pfx___run_timers+0x10/0x10 [ 38.110229][ C3] ? __lock_release+0x103/0x460 [ 38.110520][ C3] ? do_raw_spin_lock+0x131/0x270 [ 38.110680][ C3] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 38.110814][ C3] ? lock_acquire+0x32/0xc0 [ 38.110966][ C3] ? timer_expire_remote+0x93/0xe0 [ 38.111188][ C3] timer_expire_remote+0x9b/0xe0 [ 38.111335][ C3] tmigr_handle_remote_cpu+0x270/0x430 [ 38.111471][ C3] ? __pfx_tmigr_handle_remote_cpu+0x10/0x10 [ 38.111662][ C3] tmigr_handle_remote_up+0x19f/0x2e0 [ 38.111908][ C3] tmigr_handle_remote+0x21d/0x3a0 [ 38.112044][ C3] ? __pfx_tmigr_handle_remote+0x10/0x10 [ 38.112195][ C3] __do_softirq+0x1f8/0x5df [ 38.112333][ C3] irq_exit_rcu+0x97/0xc0 [ 38.112454][ C3] sysvec_apic_timer_interrupt+0x75/0x80 [ 38.112679][ C3] [ 38.112763][ C3] [ 38.112837][ C3] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 38.113008][ C3] RIP: 0010:default_idle+0xf/0x20 [ 38.113159][ C3] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d a3 30 35 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 38.113777][ C3] RSP: 0018:ffffc9000016fdf8 EFLAGS: 00000246 [ 38.114044][ C3] RAX: 0000000000080303 RBX: 1ffff9200002dfc1 RCX: ffffffffb4d0e9d5 [ 38.114273][ C3] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffffffb26aa4a4 [ 38.114475][ C3] RBP: 0000000000000000 R08: 0000000000000001 R09: ffffed1006c3709c [ 38.114782][ C3] R10: ffff8880361b84e3 R11: ffff8880361ad9b0 R12: 0000000000000000 [ 38.114995][ C3] R13: ffff888001b88040 R14: dffffc0000000000 R15: 0000000000000000 [ 38.115222][ C3] ? ct_kernel_exit.constprop.0+0xc5/0xf0 [ 38.115438][ C3] ? cpuidle_idle_call+0x1f4/0x280 [ 38.115576][ C3] default_idle_call+0x6d/0xb0 [ 38.115713][ C3] cpuidle_idle_call+0x1f4/0x280 [ 38.115851][ C3] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 38.116066][ C3] ? tsc_verify_tsc_adjust+0x5e/0x2b0 [ 38.116212][ C3] do_idle+0xf9/0x160 [ 38.116316][ C3] cpu_startup_entry+0x54/0x60 [ 38.116452][ C3] start_secondary+0x21c/0x2b0 [ 38.116587][ C3] ? __pfx_start_secondary+0x10/0x10 [ 38.116801][ C3] common_startup_64+0x12c/0x138 [ 38.116940][ C3] [ 41.217868][ T356] GACT probability NOT on [ 76.488758][ T272] veth0: left allmulticast mode [ 76.488992][ T272] veth1: left allmulticast mode [ 76.489162][ T272] veth2: left allmulticast mode [ 76.489337][ T272] veth3: left allmulticast mode [ 76.494855][ T272] veth4: left allmulticast mode [ 76.495277][ T272] veth5: left allmulticast mode