[ 27.175553][ T273] 8021q: 802.1Q VLAN Support v1.8 [ 30.133753][ T299] br1: port 1(veth1) entered blocking state [ 30.134145][ T299] br1: port 1(veth1) entered disabled state [ 30.134467][ T299] veth1: entered allmulticast mode [ 30.136393][ T299] veth1: entered promiscuous mode [ 30.248384][ T49] br1: port 1(veth1) entered blocking state [ 30.248700][ T49] br1: port 1(veth1) entered forwarding state [ 35.511083][ C3] [ 35.511244][ C3] ======================================================== [ 35.511465][ C3] WARNING: possible irq lock inversion dependency detected [ 35.511670][ C3] 6.9.0-rc1-virtme #1 Not tainted [ 35.511811][ C3] -------------------------------------------------------- [ 35.512013][ C3] swapper/3/0 just changed the state of lock: [ 35.512182][ C3] ffff888005b42580 (&ndev->lock){++-.}-{2:2}, at: addrconf_rs_timer+0xa9/0x730 [ 35.512441][ C3] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 35.512640][ C3] (&p->alloc_lock){+.+.}-{2:2} [ 35.512644][ C3] [ 35.512644][ C3] [ 35.512644][ C3] and interrupts could create inverse lock ordering between them. [ 35.512644][ C3] [ 35.513147][ C3] [ 35.513147][ C3] other info that might help us debug this: [ 35.513349][ C3] Possible interrupt unsafe locking scenario: [ 35.513349][ C3] [ 35.513564][ C3] CPU0 CPU1 [ 35.513700][ C3] ---- ---- [ 35.513840][ C3] lock(&p->alloc_lock); [ 35.513950][ C3] local_irq_disable(); [ 35.514124][ C3] lock(&ndev->lock); [ 35.514295][ C3] lock(&p->alloc_lock); [ 35.514465][ C3] [ 35.514569][ C3] lock(&ndev->lock); [ 35.514679][ C3] [ 35.514679][ C3] *** DEADLOCK *** [ 35.514679][ C3] [ 35.514888][ C3] 1 lock held by swapper/3/0: [ 35.515031][ C3] #0: ffffc90000288b68 ((&ndev->rs_timer)){+.-.}-{0:0}, at: call_timer_fn+0xe8/0x230 [ 35.515287][ C3] [ 35.515287][ C3] the shortest dependencies between 2nd lock and 1st lock: [ 35.515533][ C3] -> (&p->alloc_lock){+.+.}-{2:2} { [ 35.515683][ C3] HARDIRQ-ON-W at: [ 35.515789][ C3] __lock_acquire+0x797/0x1570 [ 35.515971][ C3] lock_acquire.part.0+0xeb/0x330 [ 35.516146][ C3] _raw_spin_lock+0x30/0x40 [ 35.516328][ C3] set_mems_allowed+0x1d/0x210 [ 35.516511][ C3] kernel_init_freeable+0x72/0x310 [ 35.516701][ C3] kernel_init+0x20/0x200 [ 35.516874][ C3] ret_from_fork+0x31/0x70 [ 35.517050][ C3] ret_from_fork_asm+0x1a/0x30 [ 35.517223][ C3] SOFTIRQ-ON-W at: [ 35.517327][ C3] __lock_acquire+0x797/0x1570 [ 35.517500][ C3] lock_acquire.part.0+0xeb/0x330 [ 35.517679][ C3] _raw_spin_lock+0x30/0x40 [ 35.517852][ C3] set_mems_allowed+0x1d/0x210 [ 35.518022][ C3] kernel_init_freeable+0x72/0x310 [ 35.518194][ C3] kernel_init+0x20/0x200 [ 35.518368][ C3] ret_from_fork+0x31/0x70 [ 35.518540][ C3] ret_from_fork_asm+0x1a/0x30 [ 35.518711][ C3] INITIAL USE at: [ 35.518820][ C3] __lock_acquire+0x797/0x1570 [ 35.518993][ C3] lock_acquire.part.0+0xeb/0x330 [ 35.519165][ C3] _raw_spin_lock+0x30/0x40 [ 35.519339][ C3] set_mems_allowed+0x1d/0x210 [ 35.519512][ C3] kernel_init_freeable+0x72/0x310 [ 35.519682][ C3] kernel_init+0x20/0x200 [ 35.519859][ C3] ret_from_fork+0x31/0x70 [ 35.520034][ C3] ret_from_fork_asm+0x1a/0x30 [ 35.520205][ C3] } [ 35.520275][ C3] ... key at: [] __key.387+0x0/0x40 [ 35.520496][ C3] ... acquired at: [ 35.520600][ C3] __lock_acquire+0xaf0/0x1570 [ 35.520740][ C3] lock_acquire.part.0+0xeb/0x330 [ 35.520881][ C3] _raw_spin_lock+0x30/0x40 [ 35.521020][ C3] __get_task_comm+0x27/0x70 [ 35.521162][ C3] ref_tracker_alloc+0x2ee/0x490 [ 35.521301][ C3] netdev_get_by_index+0x5e/0x80 [ 35.521438][ C3] fib6_nh_init+0x3d8/0x15b0 [ 35.521578][ C3] ip6_route_info_create+0xf18/0x17d0 [ 35.521716][ C3] addrconf_f6i_alloc+0x265/0x560 [ 35.521853][ C3] __ipv6_dev_ac_inc+0x25f/0xb10 [ 35.521994][ C3] addrconf_join_anycast+0x1c0/0x220 [ 35.522130][ C3] dev_forward_change+0x2a6/0x7b0 [ 35.522268][ C3] addrconf_fixup_forwarding+0x23f/0x460 [ 35.522438][ C3] addrconf_sysctl_forward+0x212/0x2b0 [ 35.522575][ C3] proc_sys_call_handler+0x403/0x5e0 [ 35.522713][ C3] vfs_write+0x9e5/0x10a0 [ 35.522850][ C3] ksys_write+0xf5/0x1e0 [ 35.522988][ C3] do_syscall_64+0xc6/0x1e0 [ 35.523128][ C3] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 35.523303][ C3] [ 35.523374][ C3] -> (&ndev->lock){++-.}-{2:2} { [ 35.523516][ C3] HARDIRQ-ON-W at: [ 35.523621][ C3] __lock_acquire+0x797/0x1570 [ 35.523804][ C3] lock_acquire.part.0+0xeb/0x330 [ 35.523991][ C3] _raw_write_lock_bh+0x38/0x50 [ 35.524182][ C3] addrconf_permanent_addr+0x6e/0x670 [ 35.524370][ C3] addrconf_notify+0x749/0xd60 [ 35.524556][ C3] notifier_call_chain+0xcd/0x150 [ 35.524742][ C3] __dev_notify_flags+0xe6/0x250 [ 35.524929][ C3] dev_change_flags+0xec/0x160 [ 35.525115][ C3] do_setlink+0x7d6/0x21e0 [ 35.525303][ C3] __rtnl_newlink+0xaa7/0xd80 [ 35.525496][ C3] rtnl_newlink+0x63/0xa0 [ 35.525683][ C3] rtnetlink_rcv_msg+0x2fb/0xbf0 [ 35.525870][ C3] netlink_rcv_skb+0x130/0x360 [ 35.526056][ C3] netlink_unicast+0x449/0x710 [ 35.526245][ C3] netlink_sendmsg+0x723/0xbe0 [ 35.526432][ C3] ____sys_sendmsg+0x7b2/0xa10 [ 35.526623][ C3] ___sys_sendmsg+0xee/0x170 [ 35.526812][ C3] __sys_sendmsg+0xcd/0x170 [ 35.527007][ C3] do_syscall_64+0xc6/0x1e0 [ 35.527191][ C3] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 35.527415][ C3] HARDIRQ-ON-R at: [ 35.527528][ C3] __lock_acquire+0x797/0x1570 [ 35.527718][ C3] lock_acquire.part.0+0xeb/0x330 [ 35.527908][ C3] _raw_read_lock_bh+0x44/0x80 [ 35.528097][ C3] inet6_fill_ifla6_attrs+0x516/0x740 [ 35.528282][ C3] inet6_fill_link_af+0x5e/0xe0 [ 35.528467][ C3] rtnl_fill_ifinfo+0x1612/0x29e0 [ 35.528655][ C3] rtmsg_ifinfo_build_skb+0x13c/0x240 [ 35.528839][ C3] rtmsg_ifinfo_event.part.0+0x2d/0x120 [ 35.529062][ C3] rtmsg_ifinfo+0x5b/0xa0 [ 35.529247][ C3] register_netdevice+0x1177/0x1690 [ 35.529431][ C3] register_netdev+0x20/0x40 [ 35.529619][ C3] sit_init_net+0x250/0x4f0 [ 35.529805][ C3] ops_init+0x9b/0x560 [ 35.529956][ C3] register_pernet_operations+0x2db/0x710 [ 35.530179][ C3] register_pernet_device+0x2a/0x60 [ 35.530366][ C3] sit_init+0x23/0xe0 [ 35.530526][ C3] do_one_initcall+0x8d/0x1e0 [ 35.530717][ C3] do_initcalls+0x1b2/0x3e0 [ 35.530902][ C3] kernel_init_freeable+0x232/0x310 [ 35.531092][ C3] kernel_init+0x20/0x200 [ 35.531282][ C3] ret_from_fork+0x31/0x70 [ 35.531475][ C3] ret_from_fork_asm+0x1a/0x30 [ 35.531661][ C3] IN-SOFTIRQ-W at: [ 35.531773][ C3] __lock_acquire+0x797/0x1570 [ 35.531959][ C3] lock_acquire.part.0+0xeb/0x330 [ 35.532144][ C3] _raw_write_lock+0x30/0x40 [ 35.532330][ C3] addrconf_rs_timer+0xa9/0x730 [ 35.532516][ C3] call_timer_fn+0x13b/0x230 [ 35.532708][ C3] __run_timers+0x545/0x810 [ 35.532896][ C3] timer_expire_remote+0x9b/0xe0 [ 35.533078][ C3] tmigr_handle_remote_cpu+0x270/0x430 [ 35.533258][ C3] tmigr_handle_remote_up+0x19f/0x2e0 [ 35.533435][ C3] tmigr_handle_remote+0x21d/0x3a0 [ 35.533607][ C3] __do_softirq+0x1f8/0x5df [ 35.533785][ C3] irq_exit_rcu+0x97/0xc0 [ 35.533956][ C3] sysvec_apic_timer_interrupt+0x75/0x80 [ 35.534167][ C3] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 35.534381][ C3] default_idle+0xf/0x20 [ 35.534552][ C3] default_idle_call+0x6d/0xb0 [ 35.534725][ C3] cpuidle_idle_call+0x1f4/0x280 [ 35.534900][ C3] do_idle+0xf9/0x160 [ 35.535037][ C3] cpu_startup_entry+0x54/0x60 [ 35.535215][ C3] start_secondary+0x21c/0x2b0 [ 35.535393][ C3] common_startup_64+0x12c/0x138 [ 35.535567][ C3] INITIAL USE at: [ 35.535672][ C3] __lock_acquire+0x797/0x1570 [ 35.535846][ C3] lock_acquire.part.0+0xeb/0x330 [ 35.536022][ C3] _raw_write_lock_bh+0x38/0x50 [ 35.536198][ C3] addrconf_permanent_addr+0x6e/0x670 [ 35.536373][ C3] addrconf_notify+0x749/0xd60 [ 35.536544][ C3] notifier_call_chain+0xcd/0x150 [ 35.536718][ C3] __dev_notify_flags+0xe6/0x250 [ 35.536891][ C3] dev_change_flags+0xec/0x160 [ 35.537066][ C3] do_setlink+0x7d6/0x21e0 [ 35.537239][ C3] __rtnl_newlink+0xaa7/0xd80 [ 35.537412][ C3] rtnl_newlink+0x63/0xa0 [ 35.537583][ C3] rtnetlink_rcv_msg+0x2fb/0xbf0 [ 35.537755][ C3] netlink_rcv_skb+0x130/0x360 [ 35.537928][ C3] netlink_unicast+0x449/0x710 [ 35.538099][ C3] netlink_sendmsg+0x723/0xbe0 [ 35.538274][ C3] ____sys_sendmsg+0x7b2/0xa10 [ 35.538454][ C3] ___sys_sendmsg+0xee/0x170 [ 35.538625][ C3] __sys_sendmsg+0xcd/0x170 [ 35.538796][ C3] do_syscall_64+0xc6/0x1e0 [ 35.538968][ C3] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 35.539177][ C3] INITIAL READ USE at: [ 35.539280][ C3] __lock_acquire+0x797/0x1570 [ 35.539457][ C3] lock_acquire.part.0+0xeb/0x330 [ 35.539634][ C3] _raw_read_lock_bh+0x44/0x80 [ 35.539807][ C3] inet6_fill_ifla6_attrs+0x516/0x740 [ 35.540011][ C3] inet6_fill_link_af+0x5e/0xe0 [ 35.540182][ C3] rtnl_fill_ifinfo+0x1612/0x29e0 [ 35.540363][ C3] rtmsg_ifinfo_build_skb+0x13c/0x240 [ 35.540585][ C3] rtmsg_ifinfo_event.part.0+0x2d/0x120 [ 35.540793][ C3] rtmsg_ifinfo+0x5b/0xa0 [ 35.540964][ C3] register_netdevice+0x1177/0x1690 [ 35.541170][ C3] register_netdev+0x20/0x40 [ 35.541343][ C3] sit_init_net+0x250/0x4f0 [ 35.541522][ C3] ops_init+0x9b/0x560 [ 35.541694][ C3] register_pernet_operations+0x2db/0x710 [ 35.541898][ C3] register_pernet_device+0x2a/0x60 [ 35.542103][ C3] sit_init+0x23/0xe0 [ 35.542274][ C3] do_one_initcall+0x8d/0x1e0 [ 35.542448][ C3] do_initcalls+0x1b2/0x3e0 [ 35.542624][ C3] kernel_init_freeable+0x232/0x310 [ 35.542835][ C3] kernel_init+0x20/0x200 [ 35.543006][ C3] ret_from_fork+0x31/0x70 [ 35.543178][ C3] ret_from_fork_asm+0x1a/0x30 [ 35.543353][ C3] } [ 35.543422][ C3] ... key at: [] __key.37+0x0/0x40 [ 35.543627][ C3] ... acquired at: [ 35.543732][ C3] mark_lock+0x28d/0x3e0 [ 35.543871][ C3] mark_usage+0xd9/0x2a0 [ 35.544008][ C3] __lock_acquire+0x797/0x1570 [ 35.544156][ C3] lock_acquire.part.0+0xeb/0x330 [ 35.544297][ C3] _raw_write_lock+0x30/0x40 [ 35.544437][ C3] addrconf_rs_timer+0xa9/0x730 [ 35.544579][ C3] call_timer_fn+0x13b/0x230 [ 35.544716][ C3] __run_timers+0x545/0x810 [ 35.544852][ C3] timer_expire_remote+0x9b/0xe0 [ 35.544994][ C3] tmigr_handle_remote_cpu+0x270/0x430 [ 35.545130][ C3] tmigr_handle_remote_up+0x19f/0x2e0 [ 35.545265][ C3] tmigr_handle_remote+0x21d/0x3a0 [ 35.545404][ C3] __do_softirq+0x1f8/0x5df [ 35.545541][ C3] irq_exit_rcu+0x97/0xc0 [ 35.545678][ C3] sysvec_apic_timer_interrupt+0x75/0x80 [ 35.545846][ C3] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 35.546019][ C3] default_idle+0xf/0x20 [ 35.546157][ C3] default_idle_call+0x6d/0xb0 [ 35.546295][ C3] cpuidle_idle_call+0x1f4/0x280 [ 35.546434][ C3] do_idle+0xf9/0x160 [ 35.546537][ C3] cpu_startup_entry+0x54/0x60 [ 35.546675][ C3] start_secondary+0x21c/0x2b0 [ 35.546814][ C3] common_startup_64+0x12c/0x138 [ 35.546950][ C3] [ 35.547019][ C3] [ 35.547019][ C3] stack backtrace: [ 35.547189][ C3] CPU: 3 PID: 0 Comm: swapper/3 Not tainted 6.9.0-rc1-virtme #1 [ 35.547401][ C3] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 35.547703][ C3] Call Trace: [ 35.547810][ C3] [ 35.547885][ C3] dump_stack_lvl+0x82/0xd0 [ 35.548026][ C3] print_irq_inversion_bug.part.0+0x3d9/0x570 [ 35.548196][ C3] ? kernel_text_address+0x17/0xe0 [ 35.548343][ C3] ? __pfx_print_irq_inversion_bug.part.0+0x10/0x10 [ 35.548513][ C3] ? __pfx_usage_skip+0x10/0x10 [ 35.548653][ C3] ? __pfx_usage_match+0x10/0x10 [ 35.548788][ C3] ? arch_stack_walk+0x8c/0xf0 [ 35.548926][ C3] mark_lock_irq+0x4cd/0xa10 [ 35.549066][ C3] ? common_startup_64+0x12c/0x138 [ 35.549202][ C3] ? __pfx_mark_lock_irq+0x10/0x10 [ 35.549347][ C3] ? __pfx_stack_trace_save+0x10/0x10 [ 35.549488][ C3] ? save_trace+0x8f/0x5b0 [ 35.549626][ C3] mark_lock+0x28d/0x3e0 [ 35.549731][ C3] ? __pfx_stack_trace_save+0x10/0x10 [ 35.549867][ C3] mark_usage+0xd9/0x2a0 [ 35.549971][ C3] __lock_acquire+0x797/0x1570 [ 35.550108][ C3] ? __pfx_validate_chain+0x10/0x10 [ 35.550246][ C3] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 35.550384][ C3] lock_acquire.part.0+0xeb/0x330 [ 35.550534][ C3] ? addrconf_rs_timer+0xa9/0x730 [ 35.550672][ C3] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 35.550809][ C3] ? trace_lock_acquire+0x135/0x1c0 [ 35.550947][ C3] ? addrconf_rs_timer+0xa9/0x730 [ 35.551082][ C3] ? lock_acquire+0x32/0xc0 [ 35.551217][ C3] ? addrconf_rs_timer+0xa9/0x730 [ 35.551355][ C3] _raw_write_lock+0x30/0x40 [ 35.551494][ C3] ? addrconf_rs_timer+0xa9/0x730 [ 35.551636][ C3] addrconf_rs_timer+0xa9/0x730 [ 35.551779][ C3] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 35.551916][ C3] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 35.552058][ C3] ? call_timer_fn+0xe8/0x230 [ 35.552196][ C3] ? lock_acquire+0x32/0xc0 [ 35.552339][ C3] ? call_timer_fn+0xe8/0x230 [ 35.552487][ C3] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 35.552636][ C3] call_timer_fn+0x13b/0x230 [ 35.552790][ C3] ? call_timer_fn+0xe8/0x230 [ 35.552938][ C3] ? call_timer_fn+0xe8/0x230 [ 35.553081][ C3] ? __pfx_call_timer_fn+0x10/0x10 [ 35.553217][ C3] ? mark_lock+0x38/0x3e0 [ 35.553330][ C3] __run_timers+0x545/0x810 [ 35.553464][ C3] ? __pfx_addrconf_rs_timer+0x10/0x10 [ 35.553600][ C3] ? __pfx___run_timers+0x10/0x10 [ 35.553735][ C3] ? __lock_release+0x103/0x460 [ 35.553873][ C3] ? do_raw_spin_lock+0x131/0x270 [ 35.554013][ C3] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 35.554147][ C3] ? lock_acquire+0x32/0xc0 [ 35.554284][ C3] ? timer_expire_remote+0x93/0xe0 [ 35.554423][ C3] timer_expire_remote+0x9b/0xe0 [ 35.554558][ C3] tmigr_handle_remote_cpu+0x270/0x430 [ 35.554694][ C3] ? __pfx_tmigr_handle_remote_cpu+0x10/0x10 [ 35.554865][ C3] tmigr_handle_remote_up+0x19f/0x2e0 [ 35.555004][ C3] tmigr_handle_remote+0x21d/0x3a0 [ 35.555143][ C3] ? __pfx_tmigr_handle_remote+0x10/0x10 [ 35.555281][ C3] __do_softirq+0x1f8/0x5df [ 35.555419][ C3] irq_exit_rcu+0x97/0xc0 [ 35.555522][ C3] sysvec_apic_timer_interrupt+0x75/0x80 [ 35.555660][ C3] [ 35.555730][ C3] [ 35.555799][ C3] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 35.555971][ C3] RIP: 0010:default_idle+0xf/0x20 [ 35.556115][ C3] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d a3 30 35 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 35.556603][ C3] RSP: 0018:ffffc9000016fdf8 EFLAGS: 00000246 [ 35.556779][ C3] RAX: 000000000007ab65 RBX: 1ffff9200002dfc1 RCX: ffffffff8d70e9d5 [ 35.556985][ C3] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffffff8b0aa4a4 [ 35.557192][ C3] RBP: 0000000000000000 R08: 0000000000000001 R09: ffffed1005f3709c [ 35.557404][ C3] R10: ffff88802f9b84e3 R11: ffff88802f9ad9b0 R12: 0000000000000000 [ 35.557609][ C3] R13: ffff888001b88040 R14: dffffc0000000000 R15: 0000000000000000 [ 35.557815][ C3] ? ct_kernel_exit.constprop.0+0xc5/0xf0 [ 35.557953][ C3] ? cpuidle_idle_call+0x1f4/0x280 [ 35.558093][ C3] default_idle_call+0x6d/0xb0 [ 35.558228][ C3] cpuidle_idle_call+0x1f4/0x280 [ 35.558368][ C3] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 35.558505][ C3] ? tsc_verify_tsc_adjust+0x5e/0x2b0 [ 35.558643][ C3] do_idle+0xf9/0x160 [ 35.558747][ C3] cpu_startup_entry+0x54/0x60 [ 35.558883][ C3] start_secondary+0x21c/0x2b0 [ 35.559019][ C3] ? __pfx_start_secondary+0x10/0x10 [ 35.559158][ C3] common_startup_64+0x12c/0x138 [ 35.559303][ C3] [ 48.638891][ T375] br1: port 1(veth1) entered disabled state [ 48.728709][ T376] veth1: left allmulticast mode [ 48.728894][ T376] veth1: left promiscuous mode [ 48.729149][ T376] br1: port 1(veth1) entered disabled state