[ 25.910366][ T274] veth0: entered allmulticast mode [ 25.911001][ T274] veth1: entered allmulticast mode [ 25.911339][ T274] veth2: entered allmulticast mode [ 25.911649][ T274] veth3: entered allmulticast mode [ 25.911982][ T274] veth4: entered allmulticast mode [ 25.912296][ T274] veth5: entered allmulticast mode [ 37.167085][ C1] [ 37.167325][ C1] ======================================================== [ 37.167548][ C1] WARNING: possible irq lock inversion dependency detected [ 37.167748][ C1] 6.9.0-rc1-virtme #1 Not tainted [ 37.167890][ C1] -------------------------------------------------------- [ 37.168096][ C1] swapper/1/0 just changed the state of lock: [ 37.168292][ C1] ffff888007a8bd80 (&ndev->lock){++-.}-{2:2}, at: addrconf_rs_timer+0xa9/0x730 [ 37.168543][ C1] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 37.168744][ C1] (&p->alloc_lock){+.+.}-{2:2} [ 37.168749][ C1] [ 37.168749][ C1] [ 37.168749][ C1] and interrupts could create inverse lock ordering between them. [ 37.168749][ C1] [ 37.169246][ C1] [ 37.169246][ C1] other info that might help us debug this: [ 37.169447][ C1] Possible interrupt unsafe locking scenario: [ 37.169447][ C1] [ 37.169658][ C1] CPU0 CPU1 [ 37.169786][ C1] ---- ---- [ 37.169929][ C1] lock(&p->alloc_lock); [ 37.170036][ C1] local_irq_disable(); [ 37.170212][ C1] lock(&ndev->lock); [ 37.170392][ C1] lock(&p->alloc_lock); [ 37.170555][ C1] [ 37.170668][ C1] lock(&ndev->lock); [ 37.170766][ C1] [ 37.170766][ C1] *** DEADLOCK *** [ 37.170766][ C1] [ 37.170963][ C1] 1 lock held by swapper/1/0: [ 37.171107][ C1] #0: ffffc900001d8d68 ((&ndev->rs_timer)){+.-.}-{0:0}, at: call_timer_fn+0xe8/0x230 [ 37.171360][ C1] [ 37.171360][ C1] the shortest dependencies between 2nd lock and 1st lock: [ 37.171595][ C1] -> (&p->alloc_lock){+.+.}-{2:2} { [ 37.171742][ C1] HARDIRQ-ON-W at: [ 37.171856][ C1] __lock_acquire+0x797/0x1570 [ 37.172036][ C1] lock_acquire.part.0+0xeb/0x330 [ 37.172204][ C1] _raw_spin_lock+0x30/0x40 [ 37.172379][ C1] set_mems_allowed+0x1d/0x210 [ 37.172563][ C1] kernel_init_freeable+0x72/0x310 [ 37.172735][ C1] kernel_init+0x20/0x200 [ 37.172909][ C1] ret_from_fork+0x31/0x70 [ 37.173084][ C1] ret_from_fork_asm+0x1a/0x30 [ 37.173263][ C1] SOFTIRQ-ON-W at: [ 37.173360][ C1] __lock_acquire+0x797/0x1570 [ 37.173545][ C1] lock_acquire.part.0+0xeb/0x330 [ 37.173707][ C1] _raw_spin_lock+0x30/0x40 [ 37.173868][ C1] set_mems_allowed+0x1d/0x210 [ 37.174030][ C1] kernel_init_freeable+0x72/0x310 [ 37.174193][ C1] kernel_init+0x20/0x200 [ 37.174356][ C1] ret_from_fork+0x31/0x70 [ 37.174525][ C1] ret_from_fork_asm+0x1a/0x30 [ 37.174689][ C1] INITIAL USE at: [ 37.174786][ C1] __lock_acquire+0x797/0x1570 [ 37.174948][ C1] lock_acquire.part.0+0xeb/0x330 [ 37.175109][ C1] _raw_spin_lock+0x30/0x40 [ 37.175275][ C1] set_mems_allowed+0x1d/0x210 [ 37.175441][ C1] kernel_init_freeable+0x72/0x310 [ 37.175604][ C1] kernel_init+0x20/0x200 [ 37.175766][ C1] ret_from_fork+0x31/0x70 [ 37.175927][ C1] ret_from_fork_asm+0x1a/0x30 [ 37.176089][ C1] } [ 37.176157][ C1] ... key at: [] __key.387+0x0/0x40 [ 37.176353][ C1] ... acquired at: [ 37.176454][ C1] __lock_acquire+0xaf0/0x1570 [ 37.176587][ C1] lock_acquire.part.0+0xeb/0x330 [ 37.176717][ C1] _raw_spin_lock+0x30/0x40 [ 37.176847][ C1] __get_task_comm+0x27/0x70 [ 37.176983][ C1] ref_tracker_alloc+0x2ee/0x490 [ 37.177113][ C1] netdev_get_by_index+0x5e/0x80 [ 37.177244][ C1] fib6_nh_init+0x3d8/0x15b0 [ 37.177375][ C1] ip6_route_info_create+0xf18/0x17d0 [ 37.177510][ C1] addrconf_f6i_alloc+0x265/0x560 [ 37.177640][ C1] __ipv6_dev_ac_inc+0x25f/0xb10 [ 37.177771][ C1] addrconf_join_anycast+0x1c0/0x220 [ 37.177901][ C1] dev_forward_change+0x2a6/0x7b0 [ 37.178032][ C1] addrconf_fixup_forwarding+0x23f/0x460 [ 37.178193][ C1] addrconf_sysctl_forward+0x212/0x2b0 [ 37.178322][ C1] proc_sys_call_handler+0x403/0x5e0 [ 37.178454][ C1] vfs_write+0x9e5/0x10a0 [ 37.178586][ C1] ksys_write+0xf5/0x1e0 [ 37.178716][ C1] do_syscall_64+0xc6/0x1e0 [ 37.178847][ C1] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 37.179012][ C1] [ 37.179078][ C1] -> (&ndev->lock){++-.}-{2:2} { [ 37.179215][ C1] HARDIRQ-ON-W at: [ 37.179312][ C1] __lock_acquire+0x797/0x1570 [ 37.179476][ C1] lock_acquire.part.0+0xeb/0x330 [ 37.179642][ C1] _raw_write_lock_bh+0x38/0x50 [ 37.179817][ C1] addrconf_permanent_addr+0x6e/0x670 [ 37.179997][ C1] addrconf_notify+0x749/0xd60 [ 37.180202][ C1] notifier_call_chain+0xcd/0x150 [ 37.180386][ C1] __dev_notify_flags+0xe6/0x250 [ 37.180560][ C1] dev_change_flags+0xec/0x160 [ 37.180748][ C1] do_setlink+0x7d6/0x21e0 [ 37.180916][ C1] __rtnl_newlink+0xaa7/0xd80 [ 37.181101][ C1] rtnl_newlink+0x63/0xa0 [ 37.181271][ C1] rtnetlink_rcv_msg+0x2fb/0xbf0 [ 37.181451][ C1] netlink_rcv_skb+0x130/0x360 [ 37.181618][ C1] netlink_unicast+0x449/0x710 [ 37.181797][ C1] netlink_sendmsg+0x723/0xbe0 [ 37.181970][ C1] ____sys_sendmsg+0x7b2/0xa10 [ 37.182136][ C1] ___sys_sendmsg+0xee/0x170 [ 37.182317][ C1] __sys_sendmsg+0xcd/0x170 [ 37.182497][ C1] do_syscall_64+0xc6/0x1e0 [ 37.182664][ C1] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 37.182870][ C1] HARDIRQ-ON-R at: [ 37.182984][ C1] __lock_acquire+0x797/0x1570 [ 37.183156][ C1] lock_acquire.part.0+0xeb/0x330 [ 37.183335][ C1] _raw_read_lock_bh+0x44/0x80 [ 37.183509][ C1] inet6_fill_ifla6_attrs+0x516/0x740 [ 37.183691][ C1] inet6_fill_link_af+0x5e/0xe0 [ 37.183855][ C1] rtnl_fill_ifinfo+0x1612/0x29e0 [ 37.184036][ C1] rtmsg_ifinfo_build_skb+0x13c/0x240 [ 37.184212][ C1] rtmsg_ifinfo_event.part.0+0x2d/0x120 [ 37.184424][ C1] rtmsg_ifinfo+0x5b/0xa0 [ 37.184594][ C1] register_netdevice+0x1177/0x1690 [ 37.184778][ C1] register_netdev+0x20/0x40 [ 37.184953][ C1] sit_init_net+0x250/0x4f0 [ 37.185137][ C1] ops_init+0x9b/0x560 [ 37.185272][ C1] register_pernet_operations+0x2db/0x710 [ 37.185484][ C1] register_pernet_device+0x2a/0x60 [ 37.185656][ C1] sit_init+0x23/0xe0 [ 37.185795][ C1] do_one_initcall+0x8d/0x1e0 [ 37.185972][ C1] do_initcalls+0x1b2/0x3e0 [ 37.186153][ C1] kernel_init_freeable+0x232/0x310 [ 37.186326][ C1] kernel_init+0x20/0x200 [ 37.186496][ C1] ret_from_fork+0x31/0x70 [ 37.186683][ C1] ret_from_fork_asm+0x1a/0x30 [ 37.186863][ C1] IN-SOFTIRQ-W at: [ 37.186963][ C1] __lock_acquire+0x797/0x1570 [ 37.187134][ C1] lock_acquire.part.0+0xeb/0x330 [ 37.187295][ C1] _raw_write_lock+0x30/0x40 [ 37.187462][ C1] addrconf_rs_timer+0xa9/0x730 [ 37.187623][ C1] call_timer_fn+0x13b/0x230 [ 37.187785][ C1] __run_timers+0x545/0x810 [ 37.187956][ C1] run_timer_softirq+0xe8/0x1b0 [ 37.188125][ C1] __do_softirq+0x1f8/0x5df [ 37.188288][ C1] irq_exit_rcu+0x97/0xc0 [ 37.188454][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 37.188653][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 37.188849][ C1] default_idle+0xf/0x20 [ 37.189011][ C1] default_idle_call+0x6d/0xb0 [ 37.189176][ C1] cpuidle_idle_call+0x1f4/0x280 [ 37.189338][ C1] do_idle+0xf9/0x160 [ 37.189468][ C1] cpu_startup_entry+0x54/0x60 [ 37.189634][ C1] start_secondary+0x21c/0x2b0 [ 37.189800][ C1] common_startup_64+0x12c/0x138 [ 37.189964][ C1] INITIAL USE at: [ 37.190061][ C1] __lock_acquire+0x797/0x1570 [ 37.190238][ C1] lock_acquire.part.0+0xeb/0x330 [ 37.190403][ C1] _raw_write_lock_bh+0x38/0x50 [ 37.190568][ C1] addrconf_permanent_addr+0x6e/0x670 [ 37.190731][ C1] addrconf_notify+0x749/0xd60 [ 37.190896][ C1] notifier_call_chain+0xcd/0x150 [ 37.191058][ C1] __dev_notify_flags+0xe6/0x250 [ 37.191220][ C1] dev_change_flags+0xec/0x160 [ 37.191386][ C1] do_setlink+0x7d6/0x21e0 [ 37.191547][ C1] __rtnl_newlink+0xaa7/0xd80 [ 37.191712][ C1] rtnl_newlink+0x63/0xa0 [ 37.191875][ C1] rtnetlink_rcv_msg+0x2fb/0xbf0 [ 37.192076][ C1] netlink_rcv_skb+0x130/0x360 [ 37.192241][ C1] netlink_unicast+0x449/0x710 [ 37.192424][ C1] netlink_sendmsg+0x723/0xbe0 [ 37.192597][ C1] ____sys_sendmsg+0x7b2/0xa10 [ 37.192762][ C1] ___sys_sendmsg+0xee/0x170 [ 37.192959][ C1] __sys_sendmsg+0xcd/0x170 [ 37.193123][ C1] do_syscall_64+0xc6/0x1e0 [ 37.193305][ C1] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 37.193516][ C1] INITIAL READ USE at: [ 37.193627][ C1] __lock_acquire+0x797/0x1570 [ 37.193801][ C1] lock_acquire.part.0+0xeb/0x330 [ 37.193983][ C1] _raw_read_lock_bh+0x44/0x80 [ 37.194154][ C1] inet6_fill_ifla6_attrs+0x516/0x740 [ 37.194366][ C1] inet6_fill_link_af+0x5e/0xe0 [ 37.194613][ C1] rtnl_fill_ifinfo+0x1612/0x29e0 [ 37.194794][ C1] rtmsg_ifinfo_build_skb+0x13c/0x240 [ 37.194998][ C1] rtmsg_ifinfo_event.part.0+0x2d/0x120 [ 37.195288][ C1] rtmsg_ifinfo+0x5b/0xa0 [ 37.195468][ C1] register_netdevice+0x1177/0x1690 [ 37.195673][ C1] register_netdev+0x20/0x40 [ 37.195932][ C1] sit_init_net+0x250/0x4f0 [ 37.196112][ C1] ops_init+0x9b/0x560 [ 37.196275][ C1] register_pernet_operations+0x2db/0x710 [ 37.196657][ C1] register_pernet_device+0x2a/0x60 [ 37.196893][ C1] sit_init+0x23/0xe0 [ 37.197068][ C1] do_one_initcall+0x8d/0x1e0 [ 37.197327][ C1] do_initcalls+0x1b2/0x3e0 [ 37.197506][ C1] kernel_init_freeable+0x232/0x310 [ 37.197702][ C1] kernel_init+0x20/0x200 [ 37.197949][ C1] ret_from_fork+0x31/0x70 [ 37.198138][ C1] ret_from_fork_asm+0x1a/0x30 [ 37.198302][ C1] } [ 37.198368][ C1] ... key at: [] __key.37+0x0/0x40 [ 37.198635][ C1] ... acquired at: [ 37.198737][ C1] mark_lock+0x28d/0x3e0 [ 37.198893][ C1] mark_usage+0xd9/0x2a0 [ 37.199029][ C1] __lock_acquire+0x797/0x1570 [ 37.199177][ C1] lock_acquire.part.0+0xeb/0x330 [ 37.199390][ C1] _raw_write_lock+0x30/0x40 [ 37.199522][ C1] addrconf_rs_timer+0xa9/0x730 [ 37.199674][ C1] call_timer_fn+0x13b/0x230 [ 37.199812][ C1] __run_timers+0x545/0x810 [ 37.200039][ C1] run_timer_softirq+0xe8/0x1b0 [ 37.200216][ C1] __do_softirq+0x1f8/0x5df [ 37.200347][ C1] irq_exit_rcu+0x97/0xc0 [ 37.200495][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 37.200746][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 37.200908][ C1] default_idle+0xf/0x20 [ 37.201064][ C1] default_idle_call+0x6d/0xb0 [ 37.201195][ C1] cpuidle_idle_call+0x1f4/0x280 [ 37.201400][ C1] do_idle+0xf9/0x160 [ 37.201497][ C1] cpu_startup_entry+0x54/0x60 [ 37.201639][ C1] start_secondary+0x21c/0x2b0 [ 37.201781][ C1] common_startup_64+0x12c/0x138 [ 37.202010][ C1] [ 37.202077][ C1] [ 37.202077][ C1] stack backtrace: [ 37.202243][ C1] CPU: 1 PID: 0 Comm: swapper/1 Not tainted 6.9.0-rc1-virtme #1 [ 37.202453][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 37.202840][ C1] Call Trace: [ 37.202974][ C1] [ 37.203053][ C1] dump_stack_lvl+0x82/0xd0 [ 37.203188][ C1] print_irq_inversion_bug.part.0+0x3d9/0x570 [ 37.203446][ C1] ? kernel_text_address+0x17/0xe0 [ 37.203595][ C1] ? __pfx_print_irq_inversion_bug.part.0+0x10/0x10 [ 37.203773][ C1] ? __pfx_usage_skip+0x10/0x10 [ 37.203915][ C1] ? __pfx_usage_match+0x10/0x10 [ 37.204120][ C1] ? arch_stack_walk+0x8c/0xf0 [ 37.204252][ C1] mark_lock_irq+0x4cd/0xa10 [ 37.204382][ C1] ? common_startup_64+0x12c/0x138 [ 37.204538][ C1] ? __pfx_mark_lock_irq+0x10/0x10 [ 37.204763][ C1] ? __pfx_stack_trace_save+0x10/0x10 [ 37.204896][ C1] ? save_trace+0x8f/0x5b0 [ 37.205036][ C1] mark_lock+0x28d/0x3e0 [ 37.205135][ C1] ? __pfx_stack_trace_save+0x10/0x10 [ 37.205282][ C1] mark_usage+0xd9/0x2a0 [ 37.205477][ C1] __lock_acquire+0x797/0x1570 [ 37.205607][ C1] ? __pfx_validate_chain+0x10/0x10 [ 37.205740][ C1] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 37.205870][ C1] lock_acquire.part.0+0xeb/0x330 [ 37.206072][ C1] ? addrconf_rs_timer+0xa9/0x730 [ 37.206205][ C1] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 37.206366][ C1] ? trace_lock_acquire+0x135/0x1c0 [ 37.206496][ C1] ? addrconf_rs_timer+0xa9/0x730 [ 37.206699][ C1] ? lock_acquire+0x32/0xc0 [ 37.206829][ C1] ? addrconf_rs_timer+0xa9/0x730 [ 37.206960][ C1] _raw_write_lock+0x30/0x40 [ 37.207091][ C1] ? addrconf_rs_timer+0xa9/0x730 [ 37.207218][ C1] addrconf_rs_timer+0xa9/0x730 [ 37.207493][ C1] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 37.207623][ C1] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 37.207752][ C1] ? call_timer_fn+0xe8/0x230 [ 37.207883][ C1] ? lock_acquire+0x32/0xc0 [ 37.208089][ C1] ? call_timer_fn+0xe8/0x230 [ 37.208219][ C1] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 37.208347][ C1] call_timer_fn+0x13b/0x230 [ 37.208476][ C1] ? call_timer_fn+0xe8/0x230 [ 37.208677][ C1] ? call_timer_fn+0xe8/0x230 [ 37.208806][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 37.208935][ C1] ? mark_lock+0x38/0x3e0 [ 37.209036][ C1] __run_timers+0x545/0x810 [ 37.209167][ C1] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 37.209371][ C1] ? __pfx___run_timers+0x10/0x10 [ 37.209503][ C1] ? do_raw_spin_lock+0x131/0x270 [ 37.209631][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 37.209759][ C1] ? lock_acquire+0x32/0xc0 [ 37.209960][ C1] ? run_timer_softirq+0xe0/0x1b0 [ 37.210091][ C1] run_timer_softirq+0xe8/0x1b0 [ 37.210230][ C1] __do_softirq+0x1f8/0x5df [ 37.210361][ C1] irq_exit_rcu+0x97/0xc0 [ 37.210532][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 37.210665][ C1] [ 37.210732][ C1] [ 37.210798][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 37.210958][ C1] RIP: 0010:default_idle+0xf/0x20 [ 37.211193][ C1] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d a3 30 35 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 37.211671][ C1] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 37.211959][ C1] RAX: 000000000008d2eb RBX: 1ffff92000029fc1 RCX: ffffffff9d10e9d5 [ 37.212154][ C1] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffffff9aaaa4a4 [ 37.212348][ C1] RBP: 0000000000000000 R08: 0000000000000001 R09: ffffed1006c1709c [ 37.212649][ C1] R10: ffff8880360b84e3 R11: ffff8880360ad9b0 R12: 0000000000000000 [ 37.212860][ C1] R13: ffff888001b7a300 R14: dffffc0000000000 R15: 0000000000000000 [ 37.213067][ C1] ? ct_kernel_exit.constprop.0+0xc5/0xf0 [ 37.213295][ C1] ? cpuidle_idle_call+0x1f4/0x280 [ 37.213427][ C1] default_idle_call+0x6d/0xb0 [ 37.213597][ C1] cpuidle_idle_call+0x1f4/0x280 [ 37.213726][ C1] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 37.213949][ C1] ? tsc_verify_tsc_adjust+0x5e/0x2b0 [ 37.214082][ C1] do_idle+0xf9/0x160 [ 37.214184][ C1] cpu_startup_entry+0x54/0x60 [ 37.214314][ C1] start_secondary+0x21c/0x2b0 [ 37.214442][ C1] ? __pfx_start_secondary+0x10/0x10 [ 37.214668][ C1] common_startup_64+0x12c/0x138 [ 37.214819][ C1] [ 39.374973][ T358] GACT probability NOT on [ 74.200684][ T274] veth0: left allmulticast mode [ 74.200913][ T274] veth1: left allmulticast mode [ 74.201118][ T274] veth2: left allmulticast mode [ 74.201284][ T274] veth3: left allmulticast mode [ 74.201453][ T274] veth4: left allmulticast mode [ 74.201616][ T274] veth5: left allmulticast mode