[ 25.319566][ T237] ip (237) used greatest stack depth: 24000 bytes left [ 25.816029][ T250] ip (250) used greatest stack depth: 23488 bytes left [ 27.472145][ T273] veth0: entered allmulticast mode [ 27.472753][ T273] veth1: entered allmulticast mode [ 27.473511][ T273] veth2: entered allmulticast mode [ 27.473834][ T273] veth3: entered allmulticast mode [ 27.474159][ T273] veth4: entered allmulticast mode [ 27.474471][ T273] veth5: entered allmulticast mode [ 38.769028][ C2] [ 38.769189][ C2] ======================================================== [ 38.769394][ C2] WARNING: possible irq lock inversion dependency detected [ 38.769586][ C2] 6.9.0-rc1-virtme #1 Not tainted [ 38.769716][ C2] -------------------------------------------------------- [ 38.769905][ C2] swapper/2/0 just changed the state of lock: [ 38.770088][ C2] ffff888006dd8d80 (&ndev->lock){++-.}-{2:2}, at: addrconf_rs_timer+0xa9/0x730 [ 38.770323][ C2] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 38.770514][ C2] (&p->alloc_lock){+.+.}-{2:2} [ 38.770519][ C2] [ 38.770519][ C2] [ 38.770519][ C2] and interrupts could create inverse lock ordering between them. [ 38.770519][ C2] [ 38.770984][ C2] [ 38.770984][ C2] other info that might help us debug this: [ 38.771178][ C2] Possible interrupt unsafe locking scenario: [ 38.771178][ C2] [ 38.771370][ C2] CPU0 CPU1 [ 38.771509][ C2] ---- ---- [ 38.771639][ C2] lock(&p->alloc_lock); [ 38.771738][ C2] local_irq_disable(); [ 38.771898][ C2] lock(&ndev->lock); [ 38.772065][ C2] lock(&p->alloc_lock); [ 38.772227][ C2] [ 38.772326][ C2] lock(&ndev->lock); [ 38.772425][ C2] [ 38.772425][ C2] *** DEADLOCK *** [ 38.772425][ C2] [ 38.772645][ C2] 1 lock held by swapper/2/0: [ 38.772775][ C2] #0: ffffc90000230d68 ((&ndev->rs_timer)){+.-.}-{0:0}, at: call_timer_fn+0xe8/0x230 [ 38.773013][ C2] [ 38.773013][ C2] the shortest dependencies between 2nd lock and 1st lock: [ 38.773242][ C2] -> (&p->alloc_lock){+.+.}-{2:2} { [ 38.773377][ C2] HARDIRQ-ON-W at: [ 38.773481][ C2] __lock_acquire+0x797/0x1570 [ 38.773648][ C2] lock_acquire.part.0+0xeb/0x330 [ 38.773815][ C2] _raw_spin_lock+0x30/0x40 [ 38.773980][ C2] set_mems_allowed+0x1d/0x210 [ 38.774150][ C2] kernel_init_freeable+0x72/0x310 [ 38.774316][ C2] kernel_init+0x20/0x200 [ 38.774480][ C2] ret_from_fork+0x31/0x70 [ 38.774650][ C2] ret_from_fork_asm+0x1a/0x30 [ 38.774813][ C2] SOFTIRQ-ON-W at: [ 38.774911][ C2] __lock_acquire+0x797/0x1570 [ 38.775081][ C2] lock_acquire.part.0+0xeb/0x330 [ 38.775248][ C2] _raw_spin_lock+0x30/0x40 [ 38.775412][ C2] set_mems_allowed+0x1d/0x210 [ 38.775575][ C2] kernel_init_freeable+0x72/0x310 [ 38.775740][ C2] kernel_init+0x20/0x200 [ 38.775903][ C2] ret_from_fork+0x31/0x70 [ 38.776073][ C2] ret_from_fork_asm+0x1a/0x30 [ 38.776236][ C2] INITIAL USE at: [ 38.776336][ C2] __lock_acquire+0x797/0x1570 [ 38.776499][ C2] lock_acquire.part.0+0xeb/0x330 [ 38.776663][ C2] _raw_spin_lock+0x30/0x40 [ 38.776828][ C2] set_mems_allowed+0x1d/0x210 [ 38.776998][ C2] kernel_init_freeable+0x72/0x310 [ 38.777163][ C2] kernel_init+0x20/0x200 [ 38.777329][ C2] ret_from_fork+0x31/0x70 [ 38.777495][ C2] ret_from_fork_asm+0x1a/0x30 [ 38.777658][ C2] } [ 38.777727][ C2] ... key at: [] __key.387+0x0/0x40 [ 38.777927][ C2] ... acquired at: [ 38.778032][ C2] __lock_acquire+0xaf0/0x1570 [ 38.778165][ C2] lock_acquire.part.0+0xeb/0x330 [ 38.778295][ C2] _raw_spin_lock+0x30/0x40 [ 38.778428][ C2] __get_task_comm+0x27/0x70 [ 38.778564][ C2] ref_tracker_alloc+0x2ee/0x490 [ 38.778696][ C2] netdev_get_by_index+0x5e/0x80 [ 38.778827][ C2] fib6_nh_init+0x3d8/0x15b0 [ 38.778961][ C2] ip6_route_info_create+0xf18/0x17d0 [ 38.779095][ C2] addrconf_f6i_alloc+0x265/0x560 [ 38.779227][ C2] __ipv6_dev_ac_inc+0x25f/0xb10 [ 38.779357][ C2] addrconf_join_anycast+0x1c0/0x220 [ 38.779488][ C2] dev_forward_change+0x2a6/0x7b0 [ 38.779620][ C2] addrconf_fixup_forwarding+0x23f/0x460 [ 38.779787][ C2] addrconf_sysctl_forward+0x212/0x2b0 [ 38.779920][ C2] proc_sys_call_handler+0x403/0x5e0 [ 38.780062][ C2] vfs_write+0x9e5/0x10a0 [ 38.780194][ C2] ksys_write+0xf5/0x1e0 [ 38.780326][ C2] do_syscall_64+0xc6/0x1e0 [ 38.780459][ C2] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 38.780626][ C2] [ 38.780693][ C2] -> (&ndev->lock){++-.}-{2:2} { [ 38.780830][ C2] HARDIRQ-ON-W at: [ 38.780928][ C2] __lock_acquire+0x797/0x1570 [ 38.781093][ C2] lock_acquire.part.0+0xeb/0x330 [ 38.781261][ C2] _raw_write_lock_bh+0x38/0x50 [ 38.781428][ C2] addrconf_permanent_addr+0x6e/0x670 [ 38.781607][ C2] addrconf_notify+0x749/0xd60 [ 38.781776][ C2] notifier_call_chain+0xcd/0x150 [ 38.781941][ C2] __dev_notify_flags+0xe6/0x250 [ 38.782106][ C2] dev_change_flags+0xec/0x160 [ 38.782272][ C2] do_setlink+0x7d6/0x21e0 [ 38.782436][ C2] __rtnl_newlink+0xaa7/0xd80 [ 38.782605][ C2] rtnl_newlink+0x63/0xa0 [ 38.782768][ C2] rtnetlink_rcv_msg+0x2fb/0xbf0 [ 38.782930][ C2] netlink_rcv_skb+0x130/0x360 [ 38.783095][ C2] netlink_unicast+0x449/0x710 [ 38.783259][ C2] netlink_sendmsg+0x723/0xbe0 [ 38.783425][ C2] ____sys_sendmsg+0x7b2/0xa10 [ 38.783590][ C2] ___sys_sendmsg+0xee/0x170 [ 38.783756][ C2] __sys_sendmsg+0xcd/0x170 [ 38.783920][ C2] do_syscall_64+0xc6/0x1e0 [ 38.784082][ C2] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 38.784285][ C2] HARDIRQ-ON-R at: [ 38.784383][ C2] __lock_acquire+0x797/0x1570 [ 38.784551][ C2] lock_acquire.part.0+0xeb/0x330 [ 38.784715][ C2] _raw_read_lock_bh+0x44/0x80 [ 38.784884][ C2] inet6_fill_ifla6_attrs+0x516/0x740 [ 38.785050][ C2] inet6_fill_link_af+0x5e/0xe0 [ 38.785213][ C2] rtnl_fill_ifinfo+0x1612/0x29e0 [ 38.785378][ C2] rtmsg_ifinfo_build_skb+0x13c/0x240 [ 38.785545][ C2] rtmsg_ifinfo_event.part.0+0x2d/0x120 [ 38.785743][ C2] rtmsg_ifinfo+0x5b/0xa0 [ 38.785911][ C2] register_netdevice+0x1177/0x1690 [ 38.786074][ C2] register_netdev+0x20/0x40 [ 38.786238][ C2] sit_init_net+0x250/0x4f0 [ 38.786404][ C2] ops_init+0x9b/0x560 [ 38.786543][ C2] register_pernet_operations+0x2db/0x710 [ 38.786739][ C2] register_pernet_device+0x2a/0x60 [ 38.786904][ C2] sit_init+0x23/0xe0 [ 38.787039][ C2] do_one_initcall+0x8d/0x1e0 [ 38.787203][ C2] do_initcalls+0x1b2/0x3e0 [ 38.787370][ C2] kernel_init_freeable+0x232/0x310 [ 38.787535][ C2] kernel_init+0x20/0x200 [ 38.787699][ C2] ret_from_fork+0x31/0x70 [ 38.787863][ C2] ret_from_fork_asm+0x1a/0x30 [ 38.788028][ C2] IN-SOFTIRQ-W at: [ 38.788127][ C2] __lock_acquire+0x797/0x1570 [ 38.788300][ C2] lock_acquire.part.0+0xeb/0x330 [ 38.788465][ C2] _raw_write_lock+0x30/0x40 [ 38.788635][ C2] addrconf_rs_timer+0xa9/0x730 [ 38.788801][ C2] call_timer_fn+0x13b/0x230 [ 38.788968][ C2] __run_timers+0x545/0x810 [ 38.789132][ C2] run_timer_softirq+0xe8/0x1b0 [ 38.789301][ C2] __do_softirq+0x1f8/0x5df [ 38.789466][ C2] irq_exit_rcu+0x97/0xc0 [ 38.789632][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 38.789832][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 38.790032][ C2] default_idle+0xf/0x20 [ 38.790197][ C2] default_idle_call+0x6d/0xb0 [ 38.790364][ C2] cpuidle_idle_call+0x1f4/0x280 [ 38.790531][ C2] do_idle+0xf9/0x160 [ 38.790663][ C2] cpu_startup_entry+0x54/0x60 [ 38.790832][ C2] start_secondary+0x21c/0x2b0 [ 38.791001][ C2] common_startup_64+0x12c/0x138 [ 38.791166][ C2] INITIAL USE at: [ 38.791264][ C2] __lock_acquire+0x797/0x1570 [ 38.791429][ C2] lock_acquire.part.0+0xeb/0x330 [ 38.791761][ C2] _raw_write_lock_bh+0x38/0x50 [ 38.791926][ C2] addrconf_permanent_addr+0x6e/0x670 [ 38.792095][ C2] addrconf_notify+0x749/0xd60 [ 38.792258][ C2] notifier_call_chain+0xcd/0x150 [ 38.792422][ C2] __dev_notify_flags+0xe6/0x250 [ 38.792586][ C2] dev_change_flags+0xec/0x160 [ 38.792767][ C2] do_setlink+0x7d6/0x21e0 [ 38.792935][ C2] __rtnl_newlink+0xaa7/0xd80 [ 38.793104][ C2] rtnl_newlink+0x63/0xa0 [ 38.793269][ C2] rtnetlink_rcv_msg+0x2fb/0xbf0 [ 38.793445][ C2] netlink_rcv_skb+0x130/0x360 [ 38.793610][ C2] netlink_unicast+0x449/0x710 [ 38.793773][ C2] netlink_sendmsg+0x723/0xbe0 [ 38.793938][ C2] ____sys_sendmsg+0x7b2/0xa10 [ 38.794104][ C2] ___sys_sendmsg+0xee/0x170 [ 38.794273][ C2] __sys_sendmsg+0xcd/0x170 [ 38.794440][ C2] do_syscall_64+0xc6/0x1e0 [ 38.794610][ C2] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 38.794810][ C2] INITIAL READ USE at: [ 38.794909][ C2] __lock_acquire+0x797/0x1570 [ 38.795073][ C2] lock_acquire.part.0+0xeb/0x330 [ 38.795245][ C2] _raw_read_lock_bh+0x44/0x80 [ 38.795409][ C2] inet6_fill_ifla6_attrs+0x516/0x740 [ 38.795607][ C2] inet6_fill_link_af+0x5e/0xe0 [ 38.795772][ C2] rtnl_fill_ifinfo+0x1612/0x29e0 [ 38.795935][ C2] rtmsg_ifinfo_build_skb+0x13c/0x240 [ 38.796132][ C2] rtmsg_ifinfo_event.part.0+0x2d/0x120 [ 38.796337][ C2] rtmsg_ifinfo+0x5b/0xa0 [ 38.796502][ C2] register_netdevice+0x1177/0x1690 [ 38.796699][ C2] register_netdev+0x20/0x40 [ 38.796940][ C2] sit_init_net+0x250/0x4f0 [ 38.797104][ C2] ops_init+0x9b/0x560 [ 38.797267][ C2] register_pernet_operations+0x2db/0x710 [ 38.797465][ C2] register_pernet_device+0x2a/0x60 [ 38.797736][ C2] sit_init+0x23/0xe0 [ 38.797899][ C2] do_one_initcall+0x8d/0x1e0 [ 38.798062][ C2] do_initcalls+0x1b2/0x3e0 [ 38.798302][ C2] kernel_init_freeable+0x232/0x310 [ 38.798497][ C2] kernel_init+0x20/0x200 [ 38.798664][ C2] ret_from_fork+0x31/0x70 [ 38.798906][ C2] ret_from_fork_asm+0x1a/0x30 [ 38.799069][ C2] } [ 38.799135][ C2] ... key at: [] __key.37+0x0/0x40 [ 38.799331][ C2] ... acquired at: [ 38.799501][ C2] mark_lock+0x28d/0x3e0 [ 38.799632][ C2] mark_usage+0xd9/0x2a0 [ 38.799770][ C2] __lock_acquire+0x797/0x1570 [ 38.799902][ C2] lock_acquire.part.0+0xeb/0x330 [ 38.800112][ C2] _raw_write_lock+0x30/0x40 [ 38.800243][ C2] addrconf_rs_timer+0xa9/0x730 [ 38.800374][ C2] call_timer_fn+0x13b/0x230 [ 38.800507][ C2] __run_timers+0x545/0x810 [ 38.800643][ C2] run_timer_softirq+0xe8/0x1b0 [ 38.800925][ C2] __do_softirq+0x1f8/0x5df [ 38.801055][ C2] irq_exit_rcu+0x97/0xc0 [ 38.801191][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 38.801355][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 38.801604][ C2] default_idle+0xf/0x20 [ 38.801734][ C2] default_idle_call+0x6d/0xb0 [ 38.801864][ C2] cpuidle_idle_call+0x1f4/0x280 [ 38.802034][ C2] do_idle+0xf9/0x160 [ 38.802210][ C2] cpu_startup_entry+0x54/0x60 [ 38.802340][ C2] start_secondary+0x21c/0x2b0 [ 38.802471][ C2] common_startup_64+0x12c/0x138 [ 38.802605][ C2] [ 38.802671][ C2] [ 38.802671][ C2] stack backtrace: [ 38.802902][ C2] CPU: 2 PID: 0 Comm: swapper/2 Not tainted 6.9.0-rc1-virtme #1 [ 38.803102][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 38.803466][ C2] Call Trace: [ 38.803566][ C2] [ 38.803637][ C2] dump_stack_lvl+0x82/0xd0 [ 38.803776][ C2] print_irq_inversion_bug.part.0+0x3d9/0x570 [ 38.803940][ C2] ? kernel_text_address+0x17/0xe0 [ 38.804166][ C2] ? __pfx_print_irq_inversion_bug.part.0+0x10/0x10 [ 38.804328][ C2] ? __pfx_usage_skip+0x10/0x10 [ 38.804462][ C2] ? __pfx_usage_match+0x10/0x10 [ 38.804594][ C2] ? arch_stack_walk+0x8c/0xf0 [ 38.804805][ C2] mark_lock_irq+0x4cd/0xa10 [ 38.804936][ C2] ? common_startup_64+0x12c/0x138 [ 38.805071][ C2] ? __pfx_mark_lock_irq+0x10/0x10 [ 38.805202][ C2] ? __pfx_stack_trace_save+0x10/0x10 [ 38.805420][ C2] ? save_trace+0x8f/0x5b0 [ 38.805552][ C2] mark_lock+0x28d/0x3e0 [ 38.805651][ C2] ? __pfx_stack_trace_save+0x10/0x10 [ 38.805780][ C2] mark_usage+0xd9/0x2a0 [ 38.805879][ C2] __lock_acquire+0x797/0x1570 [ 38.806012][ C2] ? __pfx_validate_chain+0x10/0x10 [ 38.806146][ C2] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 38.806274][ C2] lock_acquire.part.0+0xeb/0x330 [ 38.806405][ C2] ? addrconf_rs_timer+0xa9/0x730 [ 38.806614][ C2] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 38.806745][ C2] ? trace_lock_acquire+0x135/0x1c0 [ 38.806874][ C2] ? addrconf_rs_timer+0xa9/0x730 [ 38.807004][ C2] ? lock_acquire+0x32/0xc0 [ 38.807213][ C2] ? addrconf_rs_timer+0xa9/0x730 [ 38.807348][ C2] _raw_write_lock+0x30/0x40 [ 38.807481][ C2] ? addrconf_rs_timer+0xa9/0x730 [ 38.807612][ C2] addrconf_rs_timer+0xa9/0x730 [ 38.807818][ C2] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 38.807951][ C2] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 38.808080][ C2] ? call_timer_fn+0xe8/0x230 [ 38.808209][ C2] ? lock_acquire+0x32/0xc0 [ 38.808339][ C2] ? call_timer_fn+0xe8/0x230 [ 38.808546][ C2] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 38.808675][ C2] call_timer_fn+0x13b/0x230 [ 38.808805][ C2] ? call_timer_fn+0xe8/0x230 [ 38.808933][ C2] ? call_timer_fn+0xe8/0x230 [ 38.809138][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 38.809269][ C2] ? mark_lock+0x38/0x3e0 [ 38.809371][ C2] __run_timers+0x545/0x810 [ 38.809501][ C2] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 38.809706][ C2] ? __pfx___run_timers+0x10/0x10 [ 38.809843][ C2] ? do_raw_spin_lock+0x131/0x270 [ 38.809974][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 38.810104][ C2] ? lock_acquire+0x32/0xc0 [ 38.810234][ C2] ? run_timer_softirq+0xe0/0x1b0 [ 38.810440][ C2] run_timer_softirq+0xe8/0x1b0 [ 38.810571][ C2] __do_softirq+0x1f8/0x5df [ 38.810703][ C2] irq_exit_rcu+0x97/0xc0 [ 38.810802][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 38.811089][ C2] [ 38.811156][ C2] [ 38.811222][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 38.811383][ C2] RIP: 0010:default_idle+0xf/0x20 [ 38.811537][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 20 35 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 38.812081][ C2] RSP: 0018:ffffc9000015fdf8 EFLAGS: 00000246 [ 38.812255][ C2] RAX: 00000000000e4977 RBX: 1ffff9200002bfc1 RCX: ffffffff8cb0f9e5 [ 38.812528][ C2] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffffff8a4aa4a4 [ 38.812725][ C2] RBP: 0000000000000000 R08: 0000000000000001 R09: ffffed1005f2709c [ 38.812997][ C2] R10: ffff88802f9384e3 R11: ffff88802f92d9b0 R12: 0000000000000000 [ 38.813192][ C2] R13: ffff888001b7c5c0 R14: dffffc0000000000 R15: 0000000000000000 [ 38.813392][ C2] ? ct_kernel_exit.constprop.0+0xc5/0xf0 [ 38.813522][ C2] ? cpuidle_idle_call+0x1f4/0x280 [ 38.813730][ C2] default_idle_call+0x6d/0xb0 [ 38.813860][ C2] cpuidle_idle_call+0x1f4/0x280 [ 38.813990][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 38.814127][ C2] ? tsc_verify_tsc_adjust+0x5e/0x2b0 [ 38.814335][ C2] do_idle+0xf9/0x160 [ 38.814439][ C2] cpu_startup_entry+0x54/0x60 [ 38.814569][ C2] start_secondary+0x21c/0x2b0 [ 38.814700][ C2] ? __pfx_start_secondary+0x10/0x10 [ 38.814907][ C2] common_startup_64+0x12c/0x138 [ 38.815039][ C2] [ 41.392660][ T357] GACT probability NOT on [ 77.559629][ T273] veth0: left allmulticast mode [ 77.559857][ T273] veth1: left allmulticast mode [ 77.560051][ T273] veth2: left allmulticast mode [ 77.560216][ T273] veth3: left allmulticast mode [ 77.560384][ T273] veth4: left allmulticast mode [ 77.560550][ T273] veth5: left allmulticast mode