[ 59.524916][ T491] veth0: entered allmulticast mode [ 59.525523][ T491] veth1: entered allmulticast mode [ 59.525835][ T491] veth2: entered allmulticast mode [ 59.526197][ T491] veth3: entered allmulticast mode [ 68.397059][ C1] [ 68.397214][ C1] ======================================================== [ 68.397429][ C1] WARNING: possible irq lock inversion dependency detected [ 68.397639][ C1] 6.9.0-rc1-virtme #1 Not tainted [ 68.397779][ C1] -------------------------------------------------------- [ 68.397987][ C1] swapper/1/0 just changed the state of lock: [ 68.398162][ C1] ffff888004875580 (&ndev->lock){++-.}-{2:2}, at: addrconf_rs_timer+0xa9/0x730 [ 68.398437][ C1] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 68.398640][ C1] (&p->alloc_lock){+.+.}-{2:2} [ 68.398645][ C1] [ 68.398645][ C1] [ 68.398645][ C1] and interrupts could create inverse lock ordering between them. [ 68.398645][ C1] [ 68.399144][ C1] [ 68.399144][ C1] other info that might help us debug this: [ 68.399350][ C1] Possible interrupt unsafe locking scenario: [ 68.399350][ C1] [ 68.399558][ C1] CPU0 CPU1 [ 68.399693][ C1] ---- ---- [ 68.399847][ C1] lock(&p->alloc_lock); [ 68.399950][ C1] local_irq_disable(); [ 68.400116][ C1] lock(&ndev->lock); [ 68.400292][ C1] lock(&p->alloc_lock); [ 68.400460][ C1] [ 68.400571][ C1] lock(&ndev->lock); [ 68.400676][ C1] [ 68.400676][ C1] *** DEADLOCK *** [ 68.400676][ C1] [ 68.400882][ C1] 1 lock held by swapper/1/0: [ 68.401030][ C1] #0: ffffc900001d8b68 ((&ndev->rs_timer)){+.-.}-{0:0}, at: call_timer_fn+0xe8/0x230 [ 68.401281][ C1] [ 68.401281][ C1] the shortest dependencies between 2nd lock and 1st lock: [ 68.401514][ C1] -> (&p->alloc_lock){+.+.}-{2:2} { [ 68.401661][ C1] HARDIRQ-ON-W at: [ 68.401766][ C1] __lock_acquire+0x797/0x1570 [ 68.401950][ C1] lock_acquire.part.0+0xeb/0x330 [ 68.402128][ C1] _raw_spin_lock+0x30/0x40 [ 68.402308][ C1] set_mems_allowed+0x1d/0x210 [ 68.402485][ C1] kernel_init_freeable+0x72/0x310 [ 68.402657][ C1] kernel_init+0x20/0x200 [ 68.402833][ C1] ret_from_fork+0x31/0x70 [ 68.403017][ C1] ret_from_fork_asm+0x1a/0x30 [ 68.403203][ C1] SOFTIRQ-ON-W at: [ 68.403305][ C1] __lock_acquire+0x797/0x1570 [ 68.403495][ C1] lock_acquire.part.0+0xeb/0x330 [ 68.403667][ C1] _raw_spin_lock+0x30/0x40 [ 68.403842][ C1] set_mems_allowed+0x1d/0x210 [ 68.404022][ C1] kernel_init_freeable+0x72/0x310 [ 68.404193][ C1] kernel_init+0x20/0x200 [ 68.404371][ C1] ret_from_fork+0x31/0x70 [ 68.404549][ C1] ret_from_fork_asm+0x1a/0x30 [ 68.404722][ C1] INITIAL USE at: [ 68.404838][ C1] __lock_acquire+0x797/0x1570 [ 68.405008][ C1] lock_acquire.part.0+0xeb/0x330 [ 68.405187][ C1] _raw_spin_lock+0x30/0x40 [ 68.405362][ C1] set_mems_allowed+0x1d/0x210 [ 68.405532][ C1] kernel_init_freeable+0x72/0x310 [ 68.405700][ C1] kernel_init+0x20/0x200 [ 68.405871][ C1] ret_from_fork+0x31/0x70 [ 68.406044][ C1] ret_from_fork_asm+0x1a/0x30 [ 68.406236][ C1] } [ 68.406307][ C1] ... key at: [] __key.387+0x0/0x40 [ 68.406515][ C1] ... acquired at: [ 68.406621][ C1] __lock_acquire+0xaf0/0x1570 [ 68.406759][ C1] lock_acquire.part.0+0xeb/0x330 [ 68.406897][ C1] _raw_spin_lock+0x30/0x40 [ 68.407036][ C1] __get_task_comm+0x27/0x70 [ 68.407174][ C1] ref_tracker_alloc+0x2ee/0x490 [ 68.407314][ C1] netdev_get_by_index+0x5e/0x80 [ 68.407451][ C1] fib6_nh_init+0x3d8/0x15b0 [ 68.407590][ C1] ip6_route_info_create+0xf18/0x17d0 [ 68.407727][ C1] addrconf_f6i_alloc+0x265/0x560 [ 68.407862][ C1] __ipv6_dev_ac_inc+0x25f/0xb10 [ 68.408003][ C1] addrconf_join_anycast+0x1c0/0x220 [ 68.408138][ C1] __ipv6_ifa_notify+0x6b3/0xaf0 [ 68.408279][ C1] addrconf_dad_completed+0x12b/0xe20 [ 68.408414][ C1] addrconf_dad_work+0x38c/0xab0 [ 68.408548][ C1] process_one_work+0xe2c/0x1730 [ 68.408684][ C1] worker_thread+0x587/0xd30 [ 68.408820][ C1] kthread+0x28a/0x350 [ 68.408924][ C1] ret_from_fork+0x31/0x70 [ 68.409065][ C1] ret_from_fork_asm+0x1a/0x30 [ 68.409209][ C1] [ 68.409282][ C1] -> (&ndev->lock){++-.}-{2:2} { [ 68.409428][ C1] HARDIRQ-ON-W at: [ 68.409537][ C1] __lock_acquire+0x797/0x1570 [ 68.409708][ C1] lock_acquire.part.0+0xeb/0x330 [ 68.409876][ C1] _raw_write_lock_bh+0x38/0x50 [ 68.410048][ C1] addrconf_permanent_addr+0x6e/0x670 [ 68.410219][ C1] addrconf_notify+0x749/0xd60 [ 68.410389][ C1] notifier_call_chain+0xcd/0x150 [ 68.410564][ C1] __dev_notify_flags+0xe6/0x250 [ 68.410735][ C1] dev_change_flags+0xec/0x160 [ 68.410904][ C1] do_setlink+0x7d6/0x21e0 [ 68.411076][ C1] __rtnl_newlink+0xaa7/0xd80 [ 68.411245][ C1] rtnl_newlink+0x63/0xa0 [ 68.411414][ C1] rtnetlink_rcv_msg+0x2fb/0xbf0 [ 68.411586][ C1] netlink_rcv_skb+0x130/0x360 [ 68.411759][ C1] netlink_unicast+0x449/0x710 [ 68.411927][ C1] netlink_sendmsg+0x723/0xbe0 [ 68.412095][ C1] ____sys_sendmsg+0x7b2/0xa10 [ 68.412266][ C1] ___sys_sendmsg+0xee/0x170 [ 68.412435][ C1] __sys_sendmsg+0xcd/0x170 [ 68.412607][ C1] do_syscall_64+0xc6/0x1e0 [ 68.412779][ C1] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 68.412988][ C1] HARDIRQ-ON-R at: [ 68.413090][ C1] __lock_acquire+0x797/0x1570 [ 68.413261][ C1] lock_acquire.part.0+0xeb/0x330 [ 68.413432][ C1] _raw_read_lock_bh+0x44/0x80 [ 68.413603][ C1] inet6_fill_ifla6_attrs+0x516/0x740 [ 68.413773][ C1] inet6_fill_link_af+0x5e/0xe0 [ 68.413942][ C1] rtnl_fill_ifinfo+0x1612/0x29e0 [ 68.414112][ C1] rtmsg_ifinfo_build_skb+0x13c/0x240 [ 68.414280][ C1] rtmsg_ifinfo_event.part.0+0x2d/0x120 [ 68.414482][ C1] rtmsg_ifinfo+0x5b/0xa0 [ 68.414659][ C1] register_netdevice+0x1177/0x1690 [ 68.414837][ C1] register_netdev+0x20/0x40 [ 68.415005][ C1] sit_init_net+0x250/0x4f0 [ 68.415178][ C1] ops_init+0x9b/0x560 [ 68.415315][ C1] register_pernet_operations+0x2db/0x710 [ 68.415515][ C1] register_pernet_device+0x2a/0x60 [ 68.415682][ C1] sit_init+0x23/0xe0 [ 68.415820][ C1] do_one_initcall+0x8d/0x1e0 [ 68.415994][ C1] do_initcalls+0x1b2/0x3e0 [ 68.416177][ C1] kernel_init_freeable+0x232/0x310 [ 68.416348][ C1] kernel_init+0x20/0x200 [ 68.416517][ C1] ret_from_fork+0x31/0x70 [ 68.416685][ C1] ret_from_fork_asm+0x1a/0x30 [ 68.416855][ C1] IN-SOFTIRQ-W at: [ 68.416957][ C1] __lock_acquire+0x797/0x1570 [ 68.417130][ C1] lock_acquire.part.0+0xeb/0x330 [ 68.417299][ C1] _raw_write_lock+0x30/0x40 [ 68.417469][ C1] addrconf_rs_timer+0xa9/0x730 [ 68.417638][ C1] call_timer_fn+0x13b/0x230 [ 68.417809][ C1] __run_timers+0x545/0x810 [ 68.417993][ C1] timer_expire_remote+0x9b/0xe0 [ 68.418169][ C1] tmigr_handle_remote_cpu+0x270/0x430 [ 68.418357][ C1] tmigr_handle_remote_up+0x19f/0x2e0 [ 68.418525][ C1] tmigr_handle_remote+0x21d/0x3a0 [ 68.418696][ C1] __do_softirq+0x1f8/0x5df [ 68.418864][ C1] irq_exit_rcu+0x97/0xc0 [ 68.419034][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 68.419237][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 68.419440][ C1] default_idle+0xf/0x20 [ 68.419608][ C1] default_idle_call+0x6d/0xb0 [ 68.419776][ C1] cpuidle_idle_call+0x1f4/0x280 [ 68.419945][ C1] do_idle+0xf9/0x160 [ 68.420081][ C1] cpu_startup_entry+0x54/0x60 [ 68.420253][ C1] start_secondary+0x21c/0x2b0 [ 68.420424][ C1] common_startup_64+0x12c/0x138 [ 68.420593][ C1] INITIAL USE at: [ 68.420696][ C1] __lock_acquire+0x797/0x1570 [ 68.420864][ C1] lock_acquire.part.0+0xeb/0x330 [ 68.421034][ C1] _raw_write_lock_bh+0x38/0x50 [ 68.421204][ C1] addrconf_permanent_addr+0x6e/0x670 [ 68.421376][ C1] addrconf_notify+0x749/0xd60 [ 68.421544][ C1] notifier_call_chain+0xcd/0x150 [ 68.421715][ C1] __dev_notify_flags+0xe6/0x250 [ 68.421884][ C1] dev_change_flags+0xec/0x160 [ 68.422052][ C1] do_setlink+0x7d6/0x21e0 [ 68.422222][ C1] __rtnl_newlink+0xaa7/0xd80 [ 68.422394][ C1] rtnl_newlink+0x63/0xa0 [ 68.422563][ C1] rtnetlink_rcv_msg+0x2fb/0xbf0 [ 68.422734][ C1] netlink_rcv_skb+0x130/0x360 [ 68.422905][ C1] netlink_unicast+0x449/0x710 [ 68.423073][ C1] netlink_sendmsg+0x723/0xbe0 [ 68.423241][ C1] ____sys_sendmsg+0x7b2/0xa10 [ 68.423416][ C1] ___sys_sendmsg+0xee/0x170 [ 68.423590][ C1] __sys_sendmsg+0xcd/0x170 [ 68.423764][ C1] do_syscall_64+0xc6/0x1e0 [ 68.423939][ C1] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 68.424158][ C1] INITIAL READ USE at: [ 68.424266][ C1] __lock_acquire+0x797/0x1570 [ 68.424458][ C1] lock_acquire.part.0+0xeb/0x330 [ 68.424643][ C1] _raw_read_lock_bh+0x44/0x80 [ 68.424833][ C1] inet6_fill_ifla6_attrs+0x516/0x740 [ 68.425048][ C1] inet6_fill_link_af+0x5e/0xe0 [ 68.425217][ C1] rtnl_fill_ifinfo+0x1612/0x29e0 [ 68.425386][ C1] rtmsg_ifinfo_build_skb+0x13c/0x240 [ 68.425589][ C1] rtmsg_ifinfo_event.part.0+0x2d/0x120 [ 68.425885][ C1] rtmsg_ifinfo+0x5b/0xa0 [ 68.426060][ C1] register_netdevice+0x1177/0x1690 [ 68.426275][ C1] register_netdev+0x20/0x40 [ 68.426528][ C1] sit_init_net+0x250/0x4f0 [ 68.426696][ C1] ops_init+0x9b/0x560 [ 68.426866][ C1] register_pernet_operations+0x2db/0x710 [ 68.427086][ C1] register_pernet_device+0x2a/0x60 [ 68.427374][ C1] sit_init+0x23/0xe0 [ 68.427546][ C1] do_one_initcall+0x8d/0x1e0 [ 68.427715][ C1] do_initcalls+0x1b2/0x3e0 [ 68.427965][ C1] kernel_init_freeable+0x232/0x310 [ 68.428168][ C1] kernel_init+0x20/0x200 [ 68.428343][ C1] ret_from_fork+0x31/0x70 [ 68.428598][ C1] ret_from_fork_asm+0x1a/0x30 [ 68.428766][ C1] } [ 68.428835][ C1] ... key at: [] __key.37+0x0/0x40 [ 68.429042][ C1] ... acquired at: [ 68.429222][ C1] mark_lock+0x28d/0x3e0 [ 68.429360][ C1] mark_usage+0xd9/0x2a0 [ 68.429505][ C1] __lock_acquire+0x797/0x1570 [ 68.429645][ C1] lock_acquire.part.0+0xeb/0x330 [ 68.429858][ C1] _raw_write_lock+0x30/0x40 [ 68.429998][ C1] addrconf_rs_timer+0xa9/0x730 [ 68.430134][ C1] call_timer_fn+0x13b/0x230 [ 68.430271][ C1] __run_timers+0x545/0x810 [ 68.430407][ C1] timer_expire_remote+0x9b/0xe0 [ 68.430621][ C1] tmigr_handle_remote_cpu+0x270/0x430 [ 68.430766][ C1] tmigr_handle_remote_up+0x19f/0x2e0 [ 68.430905][ C1] tmigr_handle_remote+0x21d/0x3a0 [ 68.431049][ C1] __do_softirq+0x1f8/0x5df [ 68.431262][ C1] irq_exit_rcu+0x97/0xc0 [ 68.431397][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 68.431566][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 68.431754][ C1] default_idle+0xf/0x20 [ 68.432051][ C1] default_idle_call+0x6d/0xb0 [ 68.432185][ C1] cpuidle_idle_call+0x1f4/0x280 [ 68.432323][ C1] do_idle+0xf9/0x160 [ 68.432425][ C1] cpu_startup_entry+0x54/0x60 [ 68.432565][ C1] start_secondary+0x21c/0x2b0 [ 68.432699][ C1] common_startup_64+0x12c/0x138 [ 68.432836][ C1] [ 68.432910][ C1] [ 68.432910][ C1] stack backtrace: [ 68.433078][ C1] CPU: 1 PID: 0 Comm: swapper/1 Not tainted 6.9.0-rc1-virtme #1 [ 68.433365][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 68.433681][ C1] Call Trace: [ 68.433874][ C1] [ 68.433949][ C1] dump_stack_lvl+0x82/0xd0 [ 68.434094][ C1] print_irq_inversion_bug.part.0+0x3d9/0x570 [ 68.434260][ C1] ? kernel_text_address+0x17/0xe0 [ 68.434399][ C1] ? __pfx_print_irq_inversion_bug.part.0+0x10/0x10 [ 68.434650][ C1] ? __pfx_usage_skip+0x10/0x10 [ 68.434790][ C1] ? __pfx_usage_match+0x10/0x10 [ 68.434925][ C1] ? arch_stack_walk+0x8c/0xf0 [ 68.435062][ C1] mark_lock_irq+0x4cd/0xa10 [ 68.435276][ C1] ? common_startup_64+0x12c/0x138 [ 68.435413][ C1] ? __pfx_mark_lock_irq+0x10/0x10 [ 68.435549][ C1] ? __pfx_stack_trace_save+0x10/0x10 [ 68.435687][ C1] ? save_trace+0x8f/0x5b0 [ 68.435912][ C1] mark_lock+0x28d/0x3e0 [ 68.436020][ C1] ? __pfx_stack_trace_save+0x10/0x10 [ 68.436168][ C1] mark_usage+0xd9/0x2a0 [ 68.436273][ C1] __lock_acquire+0x797/0x1570 [ 68.436411][ C1] ? __pfx_validate_chain+0x10/0x10 [ 68.436628][ C1] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 68.436762][ C1] lock_acquire.part.0+0xeb/0x330 [ 68.436902][ C1] ? addrconf_rs_timer+0xa9/0x730 [ 68.437039][ C1] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 68.437260][ C1] ? trace_lock_acquire+0x135/0x1c0 [ 68.437397][ C1] ? addrconf_rs_timer+0xa9/0x730 [ 68.437530][ C1] ? lock_acquire+0x32/0xc0 [ 68.437663][ C1] ? addrconf_rs_timer+0xa9/0x730 [ 68.437875][ C1] _raw_write_lock+0x30/0x40 [ 68.438011][ C1] ? addrconf_rs_timer+0xa9/0x730 [ 68.438146][ C1] addrconf_rs_timer+0xa9/0x730 [ 68.438297][ C1] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 68.438435][ C1] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 68.438657][ C1] ? call_timer_fn+0xe8/0x230 [ 68.438798][ C1] ? lock_acquire+0x32/0xc0 [ 68.438932][ C1] ? call_timer_fn+0xe8/0x230 [ 68.439074][ C1] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 68.439288][ C1] call_timer_fn+0x13b/0x230 [ 68.439422][ C1] ? call_timer_fn+0xe8/0x230 [ 68.439559][ C1] ? call_timer_fn+0xe8/0x230 [ 68.439694][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 68.439928][ C1] ? mark_lock+0x38/0x3e0 [ 68.440036][ C1] __run_timers+0x545/0x810 [ 68.440171][ C1] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 68.440311][ C1] ? __pfx___run_timers+0x10/0x10 [ 68.440452][ C1] ? __lock_release+0x103/0x460 [ 68.440673][ C1] ? do_raw_spin_lock+0x131/0x270 [ 68.440810][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 68.440944][ C1] ? lock_acquire+0x32/0xc0 [ 68.441077][ C1] ? timer_expire_remote+0x93/0xe0 [ 68.441296][ C1] timer_expire_remote+0x9b/0xe0 [ 68.441431][ C1] tmigr_handle_remote_cpu+0x270/0x430 [ 68.441567][ C1] ? __pfx_tmigr_handle_remote_cpu+0x10/0x10 [ 68.441736][ C1] tmigr_handle_remote_up+0x19f/0x2e0 [ 68.441950][ C1] tmigr_handle_remote+0x21d/0x3a0 [ 68.442083][ C1] ? do_raw_spin_lock+0x131/0x270 [ 68.442216][ C1] ? __pfx_tmigr_handle_remote+0x10/0x10 [ 68.442352][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 68.442644][ C1] ? lockdep_hardirqs_on_prepare.part.0+0x14f/0x370 [ 68.442812][ C1] __do_softirq+0x1f8/0x5df [ 68.442947][ C1] irq_exit_rcu+0x97/0xc0 [ 68.443049][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 68.443260][ C1] [ 68.443330][ C1] [ 68.443398][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 68.443564][ C1] RIP: 0010:default_idle+0xf/0x20 [ 68.443718][ C1] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d a3 30 35 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 68.444281][ C1] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000242 [ 68.444453][ C1] RAX: 00000000000d4967 RBX: 1ffff92000029fc1 RCX: ffffffffb270e9d5 [ 68.444654][ C1] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffffffb00aa4a4 [ 68.444860][ C1] RBP: 0000000000000000 R08: 0000000000000001 R09: ffffed1006c1709c [ 68.445069][ C1] R10: ffff8880360b84e3 R11: ffff8880360ad9b0 R12: 0000000000000000 [ 68.445352][ C1] R13: ffff888001b7a300 R14: dffffc0000000000 R15: 0000000000000000 [ 68.445553][ C1] ? ct_kernel_exit.constprop.0+0xc5/0xf0 [ 68.445689][ C1] ? cpuidle_idle_call+0x1f4/0x280 [ 68.445910][ C1] default_idle_call+0x6d/0xb0 [ 68.446052][ C1] cpuidle_idle_call+0x1f4/0x280 [ 68.446201][ C1] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 68.446335][ C1] ? tsc_verify_tsc_adjust+0x5e/0x2b0 [ 68.446559][ C1] do_idle+0xf9/0x160 [ 68.446663][ C1] cpu_startup_entry+0x54/0x60 [ 68.446797][ C1] start_secondary+0x21c/0x2b0 [ 68.446932][ C1] ? __pfx_start_secondary+0x10/0x10 [ 68.447074][ C1] common_startup_64+0x12c/0x138 [ 68.447291][ C1] [ 72.768881][ T561] GACT probability NOT on [ 82.858431][ T491] veth0: left allmulticast mode [ 82.858779][ T491] veth1: left allmulticast mode [ 82.865955][ T491] veth2: left allmulticast mode [ 82.866327][ T491] veth3: left allmulticast mode