[ 38.120140][ C3] [ 38.120255][ C3] ======================================================== [ 38.120482][ C3] WARNING: possible irq lock inversion dependency detected [ 38.120706][ C3] 6.9.0-rc1-virtme #1 Not tainted [ 38.120855][ C3] -------------------------------------------------------- [ 38.121080][ C3] swapper/3/0 just changed the state of lock: [ 38.121264][ C3] ffff888005386d80 (&ndev->lock){++-.}-{2:2}, at: addrconf_rs_timer+0xa9/0x730 [ 38.121551][ C3] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 38.121775][ C3] (&p->alloc_lock){+.+.}-{2:2} [ 38.121779][ C3] [ 38.121779][ C3] [ 38.121779][ C3] and interrupts could create inverse lock ordering between them. [ 38.121779][ C3] [ 38.122328][ C3] [ 38.122328][ C3] other info that might help us debug this: [ 38.122552][ C3] Possible interrupt unsafe locking scenario: [ 38.122552][ C3] [ 38.122775][ C3] CPU0 CPU1 [ 38.122923][ C3] ---- ---- [ 38.123072][ C3] lock(&p->alloc_lock); [ 38.123185][ C3] local_irq_disable(); [ 38.123365][ C3] lock(&ndev->lock); [ 38.123555][ C3] lock(&p->alloc_lock); [ 38.123747][ C3] [ 38.123891][ C3] lock(&ndev->lock); [ 38.124005][ C3] [ 38.124005][ C3] *** DEADLOCK *** [ 38.124005][ C3] [ 38.124259][ C3] 1 lock held by swapper/3/0: [ 38.124434][ C3] #0: ffffc90000288d68 ((&ndev->rs_timer)){+.-.}-{0:0}, at: call_timer_fn+0xe8/0x230 [ 38.124725][ C3] [ 38.124725][ C3] the shortest dependencies between 2nd lock and 1st lock: [ 38.124996][ C3] -> (&p->alloc_lock){+.+.}-{2:2} { [ 38.125157][ C3] HARDIRQ-ON-W at: [ 38.125280][ C3] __lock_acquire+0x797/0x1570 [ 38.125478][ C3] lock_acquire.part.0+0xeb/0x330 [ 38.125672][ C3] _raw_spin_lock+0x30/0x40 [ 38.125872][ C3] set_mems_allowed+0x1d/0x210 [ 38.126093][ C3] kernel_init_freeable+0x72/0x310 [ 38.126298][ C3] kernel_init+0x20/0x200 [ 38.126489][ C3] ret_from_fork+0x31/0x70 [ 38.126696][ C3] ret_from_fork_asm+0x1a/0x30 [ 38.126885][ C3] SOFTIRQ-ON-W at: [ 38.127000][ C3] __lock_acquire+0x797/0x1570 [ 38.127201][ C3] lock_acquire.part.0+0xeb/0x330 [ 38.127395][ C3] _raw_spin_lock+0x30/0x40 [ 38.127584][ C3] set_mems_allowed+0x1d/0x210 [ 38.127774][ C3] kernel_init_freeable+0x72/0x310 [ 38.127963][ C3] kernel_init+0x20/0x200 [ 38.128190][ C3] ret_from_fork+0x31/0x70 [ 38.128394][ C3] ret_from_fork_asm+0x1a/0x30 [ 38.128589][ C3] INITIAL USE at: [ 38.128705][ C3] __lock_acquire+0x797/0x1570 [ 38.128905][ C3] lock_acquire.part.0+0xeb/0x330 [ 38.129103][ C3] _raw_spin_lock+0x30/0x40 [ 38.129299][ C3] set_mems_allowed+0x1d/0x210 [ 38.129486][ C3] kernel_init_freeable+0x72/0x310 [ 38.129684][ C3] kernel_init+0x20/0x200 [ 38.129882][ C3] ret_from_fork+0x31/0x70 [ 38.130078][ C3] ret_from_fork_asm+0x1a/0x30 [ 38.130276][ C3] } [ 38.130354][ C3] ... key at: [] __key.387+0x0/0x40 [ 38.130587][ C3] ... acquired at: [ 38.130710][ C3] __lock_acquire+0xaf0/0x1570 [ 38.130871][ C3] lock_acquire.part.0+0xeb/0x330 [ 38.131031][ C3] _raw_spin_lock+0x30/0x40 [ 38.131192][ C3] __get_task_comm+0x27/0x70 [ 38.131357][ C3] ref_tracker_alloc+0x2ee/0x490 [ 38.131553][ C3] netdev_get_by_index+0x5e/0x80 [ 38.131730][ C3] fib6_nh_init+0x3d8/0x15b0 [ 38.131894][ C3] ip6_route_info_create+0xf18/0x17d0 [ 38.132057][ C3] ip6_route_add+0x1c/0x140 [ 38.132216][ C3] addrconf_prefix_route+0x1cc/0x2b0 [ 38.132374][ C3] addrconf_permanent_addr+0x32f/0x670 [ 38.132529][ C3] addrconf_notify+0x749/0xd60 [ 38.132684][ C3] notifier_call_chain+0xcd/0x150 [ 38.132841][ C3] __dev_notify_flags+0xe6/0x250 [ 38.133000][ C3] dev_change_flags+0xec/0x160 [ 38.133155][ C3] do_setlink+0x7d6/0x21e0 [ 38.133309][ C3] __rtnl_newlink+0xaa7/0xd80 [ 38.133470][ C3] rtnl_newlink+0x63/0xa0 [ 38.133646][ C3] rtnetlink_rcv_msg+0x2fb/0xbf0 [ 38.133808][ C3] netlink_rcv_skb+0x130/0x360 [ 38.133976][ C3] netlink_unicast+0x449/0x710 [ 38.134143][ C3] netlink_sendmsg+0x723/0xbe0 [ 38.134305][ C3] ____sys_sendmsg+0x7b2/0xa10 [ 38.134474][ C3] ___sys_sendmsg+0xee/0x170 [ 38.134641][ C3] __sys_sendmsg+0xcd/0x170 [ 38.134805][ C3] do_syscall_64+0xc6/0x1e0 [ 38.134967][ C3] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 38.135172][ C3] [ 38.135256][ C3] -> (&ndev->lock){++-.}-{2:2} { [ 38.135420][ C3] HARDIRQ-ON-W at: [ 38.135544][ C3] __lock_acquire+0x797/0x1570 [ 38.135748][ C3] lock_acquire.part.0+0xeb/0x330 [ 38.136045][ C3] _raw_write_lock_bh+0x38/0x50 [ 38.136249][ C3] addrconf_permanent_addr+0x6e/0x670 [ 38.136454][ C3] addrconf_notify+0x749/0xd60 [ 38.136729][ C3] notifier_call_chain+0xcd/0x150 [ 38.136928][ C3] __dev_notify_flags+0xe6/0x250 [ 38.137134][ C3] dev_change_flags+0xec/0x160 [ 38.137420][ C3] do_setlink+0x7d6/0x21e0 [ 38.137625][ C3] __rtnl_newlink+0xaa7/0xd80 [ 38.137814][ C3] rtnl_newlink+0x63/0xa0 [ 38.138000][ C3] rtnetlink_rcv_msg+0x2fb/0xbf0 [ 38.138284][ C3] netlink_rcv_skb+0x130/0x360 [ 38.138473][ C3] netlink_unicast+0x449/0x710 [ 38.138660][ C3] netlink_sendmsg+0x723/0xbe0 [ 38.138848][ C3] ____sys_sendmsg+0x7b2/0xa10 [ 38.139036][ C3] ___sys_sendmsg+0xee/0x170 [ 38.139229][ C3] __sys_sendmsg+0xcd/0x170 [ 38.139417][ C3] do_syscall_64+0xc6/0x1e0 [ 38.139609][ C3] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 38.139837][ C3] HARDIRQ-ON-R at: [ 38.139950][ C3] __lock_acquire+0x797/0x1570 [ 38.140266][ C3] lock_acquire.part.0+0xeb/0x330 [ 38.140537][ C3] _raw_read_lock_bh+0x44/0x80 [ 38.140727][ C3] inet6_fill_ifla6_attrs+0x516/0x740 [ 38.140927][ C3] inet6_fill_link_af+0x5e/0xe0 [ 38.141113][ C3] rtnl_fill_ifinfo+0x1612/0x29e0 [ 38.141329][ C3] rtmsg_ifinfo_build_skb+0x13c/0x240 [ 38.141517][ C3] rtmsg_ifinfo_event.part.0+0x2d/0x120 [ 38.141849][ C3] rtmsg_ifinfo+0x5b/0xa0 [ 38.142042][ C3] register_netdevice+0x1177/0x1690 [ 38.142235][ C3] register_netdev+0x20/0x40 [ 38.142503][ C3] sit_init_net+0x250/0x4f0 [ 38.142695][ C3] ops_init+0x9b/0x560 [ 38.142848][ C3] register_pernet_operations+0x2db/0x710 [ 38.143068][ C3] register_pernet_device+0x2a/0x60 [ 38.143346][ C3] sit_init+0x23/0xe0 [ 38.143503][ C3] do_one_initcall+0x8d/0x1e0 [ 38.143697][ C3] do_initcalls+0x1b2/0x3e0 [ 38.143963][ C3] kernel_init_freeable+0x232/0x310 [ 38.144160][ C3] kernel_init+0x20/0x200 [ 38.144352][ C3] ret_from_fork+0x31/0x70 [ 38.144554][ C3] ret_from_fork_asm+0x1a/0x30 [ 38.144746][ C3] IN-SOFTIRQ-W at: [ 38.144941][ C3] __lock_acquire+0x797/0x1570 [ 38.145133][ C3] lock_acquire.part.0+0xeb/0x330 [ 38.145325][ C3] _raw_write_lock+0x30/0x40 [ 38.145514][ C3] addrconf_rs_timer+0xa9/0x730 [ 38.145791][ C3] call_timer_fn+0x13b/0x230 [ 38.145984][ C3] __run_timers+0x545/0x810 [ 38.146181][ C3] run_timer_softirq+0xe8/0x1b0 [ 38.146365][ C3] __do_softirq+0x1f8/0x5df [ 38.146643][ C3] irq_exit_rcu+0x97/0xc0 [ 38.146923][ C3] sysvec_apic_timer_interrupt+0x75/0x80 [ 38.147147][ C3] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 38.147384][ C3] default_idle+0xf/0x20 [ 38.147652][ C3] default_idle_call+0x6d/0xb0 [ 38.147846][ C3] cpuidle_idle_call+0x1f4/0x280 [ 38.148036][ C3] do_idle+0xf9/0x160 [ 38.148193][ C3] cpu_startup_entry+0x54/0x60 [ 38.148458][ C3] start_secondary+0x21c/0x2b0 [ 38.148653][ C3] common_startup_64+0x12c/0x138 [ 38.148850][ C3] INITIAL USE at: [ 38.148967][ C3] __lock_acquire+0x797/0x1570 [ 38.149162][ C3] lock_acquire.part.0+0xeb/0x330 [ 38.149427][ C3] _raw_write_lock_bh+0x38/0x50 [ 38.149613][ C3] addrconf_permanent_addr+0x6e/0x670 [ 38.149808][ C3] addrconf_notify+0x749/0xd60 [ 38.149997][ C3] notifier_call_chain+0xcd/0x150 [ 38.150271][ C3] __dev_notify_flags+0xe6/0x250 [ 38.150474][ C3] dev_change_flags+0xec/0x160 [ 38.150684][ C3] do_setlink+0x7d6/0x21e0 [ 38.150877][ C3] __rtnl_newlink+0xaa7/0xd80 [ 38.151164][ C3] rtnl_newlink+0x63/0xa0 [ 38.151369][ C3] rtnetlink_rcv_msg+0x2fb/0xbf0 [ 38.151573][ C3] netlink_rcv_skb+0x130/0x360 [ 38.151765][ C3] netlink_unicast+0x449/0x710 [ 38.151962][ C3] netlink_sendmsg+0x723/0xbe0 [ 38.152172][ C3] ____sys_sendmsg+0x7b2/0xa10 [ 38.152375][ C3] ___sys_sendmsg+0xee/0x170 [ 38.152591][ C3] __sys_sendmsg+0xcd/0x170 [ 38.152771][ C3] do_syscall_64+0xc6/0x1e0 [ 38.152974][ C3] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 38.153204][ C3] INITIAL READ USE at: [ 38.153335][ C3] __lock_acquire+0x797/0x1570 [ 38.153517][ C3] lock_acquire.part.0+0xeb/0x330 [ 38.153707][ C3] _raw_read_lock_bh+0x44/0x80 [ 38.153891][ C3] inet6_fill_ifla6_attrs+0x516/0x740 [ 38.154120][ C3] inet6_fill_link_af+0x5e/0xe0 [ 38.154316][ C3] rtnl_fill_ifinfo+0x1612/0x29e0 [ 38.154505][ C3] rtmsg_ifinfo_build_skb+0x13c/0x240 [ 38.154746][ C3] rtmsg_ifinfo_event.part.0+0x2d/0x120 [ 38.154968][ C3] rtmsg_ifinfo+0x5b/0xa0 [ 38.155153][ C3] register_netdevice+0x1177/0x1690 [ 38.155373][ C3] register_netdev+0x20/0x40 [ 38.155562][ C3] sit_init_net+0x250/0x4f0 [ 38.155752][ C3] ops_init+0x9b/0x560 [ 38.155962][ C3] register_pernet_operations+0x2db/0x710 [ 38.156203][ C3] register_pernet_device+0x2a/0x60 [ 38.156445][ C3] sit_init+0x23/0xe0 [ 38.156633][ C3] do_one_initcall+0x8d/0x1e0 [ 38.156820][ C3] do_initcalls+0x1b2/0x3e0 [ 38.157009][ C3] kernel_init_freeable+0x232/0x310 [ 38.157253][ C3] kernel_init+0x20/0x200 [ 38.157439][ C3] ret_from_fork+0x31/0x70 [ 38.157625][ C3] ret_from_fork_asm+0x1a/0x30 [ 38.157833][ C3] } [ 38.157918][ C3] ... key at: [] __key.36+0x0/0x40 [ 38.158166][ C3] ... acquired at: [ 38.158277][ C3] mark_lock+0x28d/0x3e0 [ 38.158427][ C3] mark_usage+0xd9/0x2a0 [ 38.158577][ C3] __lock_acquire+0x797/0x1570 [ 38.158724][ C3] lock_acquire.part.0+0xeb/0x330 [ 38.158879][ C3] _raw_write_lock+0x30/0x40 [ 38.159034][ C3] addrconf_rs_timer+0xa9/0x730 [ 38.159183][ C3] call_timer_fn+0x13b/0x230 [ 38.159336][ C3] __run_timers+0x545/0x810 [ 38.159492][ C3] run_timer_softirq+0xe8/0x1b0 [ 38.159647][ C3] __do_softirq+0x1f8/0x5df [ 38.159805][ C3] irq_exit_rcu+0x97/0xc0 [ 38.159955][ C3] sysvec_apic_timer_interrupt+0x75/0x80 [ 38.160138][ C3] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 38.160330][ C3] default_idle+0xf/0x20 [ 38.160481][ C3] default_idle_call+0x6d/0xb0 [ 38.160635][ C3] cpuidle_idle_call+0x1f4/0x280 [ 38.160786][ C3] do_idle+0xf9/0x160 [ 38.160905][ C3] cpu_startup_entry+0x54/0x60 [ 38.161058][ C3] start_secondary+0x21c/0x2b0 [ 38.161217][ C3] common_startup_64+0x12c/0x138 [ 38.161378][ C3] [ 38.161455][ C3] [ 38.161455][ C3] stack backtrace: [ 38.161651][ C3] CPU: 3 PID: 0 Comm: swapper/3 Not tainted 6.9.0-rc1-virtme #1 [ 38.161959][ C3] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 38.162298][ C3] Call Trace: [ 38.162422][ C3] [ 38.162506][ C3] dump_stack_lvl+0x82/0xd0 [ 38.162744][ C3] print_irq_inversion_bug.part.0+0x3d9/0x570 [ 38.162935][ C3] ? kernel_text_address+0x17/0xe0 [ 38.163099][ C3] ? __pfx_print_irq_inversion_bug.part.0+0x10/0x10 [ 38.163376][ C3] ? __pfx_usage_skip+0x10/0x10 [ 38.163527][ C3] ? __pfx_usage_match+0x10/0x10 [ 38.163671][ C3] ? arch_stack_walk+0x8c/0xf0 [ 38.163827][ C3] mark_lock_irq+0x4cd/0xa10 [ 38.163985][ C3] ? common_startup_64+0x12c/0x138 [ 38.164220][ C3] ? __pfx_mark_lock_irq+0x10/0x10 [ 38.164373][ C3] ? __pfx_stack_trace_save+0x10/0x10 [ 38.164533][ C3] ? save_trace+0x8f/0x5b0 [ 38.164689][ C3] mark_lock+0x28d/0x3e0 [ 38.164809][ C3] ? __pfx_stack_trace_save+0x10/0x10 [ 38.164960][ C3] mark_usage+0xd9/0x2a0 [ 38.165154][ C3] __lock_acquire+0x797/0x1570 [ 38.165306][ C3] ? __pfx_validate_chain+0x10/0x10 [ 38.165455][ C3] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 38.165606][ C3] lock_acquire.part.0+0xeb/0x330 [ 38.165763][ C3] ? addrconf_rs_timer+0xa9/0x730 [ 38.165914][ C3] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 38.166241][ C3] ? trace_lock_acquire+0x135/0x1c0 [ 38.166469][ C3] ? addrconf_rs_timer+0xa9/0x730 [ 38.166619][ C3] ? lock_acquire+0x32/0xc0 [ 38.166777][ C3] ? addrconf_rs_timer+0xa9/0x730 [ 38.166919][ C3] _raw_write_lock+0x30/0x40 [ 38.167151][ C3] ? addrconf_rs_timer+0xa9/0x730 [ 38.167302][ C3] addrconf_rs_timer+0xa9/0x730 [ 38.167456][ C3] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 38.167607][ C3] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 38.167761][ C3] ? call_timer_fn+0xe8/0x230 [ 38.167915][ C3] ? lock_acquire+0x32/0xc0 [ 38.168064][ C3] ? call_timer_fn+0xe8/0x230 [ 38.168218][ C3] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 38.168372][ C3] call_timer_fn+0x13b/0x230 [ 38.168605][ C3] ? call_timer_fn+0xe8/0x230 [ 38.168758][ C3] ? call_timer_fn+0xe8/0x230 [ 38.168907][ C3] ? __pfx_call_timer_fn+0x10/0x10 [ 38.169056][ C3] ? mark_lock+0x38/0x3e0 [ 38.169247][ C3] __run_timers+0x545/0x810 [ 38.169463][ C3] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 38.169613][ C3] ? __pfx___run_timers+0x10/0x10 [ 38.169767][ C3] ? do_raw_spin_lock+0x131/0x270 [ 38.169988][ C3] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 38.170219][ C3] ? lock_acquire+0x32/0xc0 [ 38.170365][ C3] ? run_timer_softirq+0xe0/0x1b0 [ 38.170517][ C3] run_timer_softirq+0xe8/0x1b0 [ 38.170666][ C3] __do_softirq+0x1f8/0x5df [ 38.170820][ C3] irq_exit_rcu+0x97/0xc0 [ 38.170936][ C3] sysvec_apic_timer_interrupt+0x75/0x80 [ 38.171172][ C3] [ 38.171251][ C3] [ 38.171327][ C3] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 38.171516][ C3] RIP: 0010:default_idle+0xf/0x20 [ 38.171671][ C3] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d c3 d1 2b 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 38.172284][ C3] RSP: 0018:ffffc9000016fdf8 EFLAGS: 00000242 [ 38.172475][ C3] RAX: 0000000000081501 RBX: 1ffff9200002dfc1 RCX: ffffffff84fa48b5 [ 38.172707][ C3] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffffff828aa4a4 [ 38.173013][ C3] RBP: 0000000000000000 R08: 0000000000000001 R09: ffffed1006c3709c [ 38.173239][ C3] R10: ffff8880361b84e3 R11: ffff8880361bde40 R12: 0000000000000000 [ 38.173468][ C3] R13: ffff888001b90040 R14: dffffc0000000000 R15: 0000000000000000 [ 38.173769][ C3] ? ct_kernel_exit.constprop.0+0xc5/0xf0 [ 38.173922][ C3] ? cpuidle_idle_call+0x1f4/0x280 [ 38.174080][ C3] default_idle_call+0x6d/0xb0 [ 38.174227][ C3] cpuidle_idle_call+0x1f4/0x280 [ 38.174453][ C3] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 38.174603][ C3] ? tsc_verify_tsc_adjust+0x5e/0x2b0 [ 38.174782][ C3] do_idle+0xf9/0x160 [ 38.174896][ C3] cpu_startup_entry+0x54/0x60 [ 38.175123][ C3] start_secondary+0x21c/0x2b0 [ 38.175286][ C3] ? __pfx_start_secondary+0x10/0x10 [ 38.175448][ C3] common_startup_64+0x12c/0x138 [ 38.175599][ C3] [ 255.803595][ T2122] netem: version 1.3