[ 23.895897][ T236] ip (236) used greatest stack depth: 23328 bytes left [ 29.057120][ T299] gre: GRE over IPv4 demultiplexor driver [ 29.078858][ T299] ip_gre: GRE over IPv4 tunneling driver [ 30.039172][ T310] GACT probability NOT on [ 30.307561][ T312] ip6_gre: GRE over IPv6 tunneling driver [ 30.469799][ T7] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 30.581681][ T7] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 31.213631][ T10] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 31.469866][ T7] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 31.518201][ T326] br1: port 1(veth1) entered blocking state [ 31.518686][ T326] br1: port 1(veth1) entered disabled state [ 31.519024][ T326] veth1: entered allmulticast mode [ 31.520992][ T326] veth1: entered promiscuous mode [ 31.641402][ T51] br1: port 1(veth1) entered blocking state [ 31.641900][ T51] br1: port 1(veth1) entered forwarding state [ 31.748163][ T328] br1: port 2(veth2) entered blocking state [ 31.748512][ T328] br1: port 2(veth2) entered disabled state [ 31.748766][ T328] veth2: entered allmulticast mode [ 31.750580][ T328] veth2: entered promiscuous mode [ 31.886622][ T51] br1: port 2(veth2) entered blocking state [ 31.886906][ T51] br1: port 2(veth2) entered forwarding state [ 32.238745][ T10] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 32.240755][ T10] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 33.005561][ T51] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 36.141546][ C3] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 42.292084][ T386] Mirror/redirect action on [ 44.333752][ C0] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 46.893494][ C2] [ 46.893606][ C2] ======================================================== [ 46.893810][ C2] WARNING: possible irq lock inversion dependency detected [ 46.894017][ C2] 6.9.0-rc1-virtme #1 Not tainted [ 46.894159][ C2] -------------------------------------------------------- [ 46.894364][ C2] swapper/2/0 just changed the state of lock: [ 46.894620][ C2] ffff88800897ac38 (&br->lock){+.-.}-{2:2}, at: br_forward_delay_timer_expired+0x48/0x440 [bridge] [ 46.895039][ C2] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 46.895287][ C2] (&p->alloc_lock){+.+.}-{2:2} [ 46.895292][ C2] [ 46.895292][ C2] [ 46.895292][ C2] and interrupts could create inverse lock ordering between them. [ 46.895292][ C2] [ 46.895873][ C2] [ 46.895873][ C2] other info that might help us debug this: [ 46.896117][ C2] Chain exists of: [ 46.896117][ C2] &br->lock --> lweventlist_lock --> &p->alloc_lock [ 46.896117][ C2] [ 46.896482][ C2] Possible interrupt unsafe locking scenario: [ 46.896482][ C2] [ 46.896718][ C2] CPU0 CPU1 [ 46.896878][ C2] ---- ---- [ 46.897038][ C2] lock(&p->alloc_lock); [ 46.897167][ C2] local_irq_disable(); [ 46.897379][ C2] lock(&br->lock); [ 46.897545][ C2] lock(lweventlist_lock); [ 46.897712][ C2] [ 46.897813][ C2] lock(&br->lock); [ 46.897914][ C2] [ 46.897914][ C2] *** DEADLOCK *** [ 46.897914][ C2] [ 46.898112][ C2] 1 lock held by swapper/2/0: [ 46.898246][ C2] #0: ffffc90000230d68 ((&p->forward_delay_timer)){+.-.}-{0:0}, at: call_timer_fn+0xe8/0x230 [ 46.898527][ C2] [ 46.898527][ C2] the shortest dependencies between 2nd lock and 1st lock: [ 46.898754][ C2] -> (&p->alloc_lock){+.+.}-{2:2} { [ 46.898893][ C2] HARDIRQ-ON-W at: [ 46.898999][ C2] __lock_acquire+0x797/0x1570 [ 46.899173][ C2] lock_acquire.part.0+0xeb/0x330 [ 46.899343][ C2] _raw_spin_lock+0x30/0x40 [ 46.899516][ C2] set_mems_allowed+0x1d/0x210 [ 46.899684][ C2] kernel_init_freeable+0x72/0x310 [ 46.899857][ C2] kernel_init+0x20/0x200 [ 46.900032][ C2] ret_from_fork+0x31/0x70 [ 46.900208][ C2] ret_from_fork_asm+0x1a/0x30 [ 46.900386][ C2] SOFTIRQ-ON-W at: [ 46.900490][ C2] __lock_acquire+0x797/0x1570 [ 46.900666][ C2] lock_acquire.part.0+0xeb/0x330 [ 46.900844][ C2] _raw_spin_lock+0x30/0x40 [ 46.901013][ C2] set_mems_allowed+0x1d/0x210 [ 46.901188][ C2] kernel_init_freeable+0x72/0x310 [ 46.901359][ C2] kernel_init+0x20/0x200 [ 46.901526][ C2] ret_from_fork+0x31/0x70 [ 46.901694][ C2] ret_from_fork_asm+0x1a/0x30 [ 46.901861][ C2] INITIAL USE at: [ 46.901963][ C2] __lock_acquire+0x797/0x1570 [ 46.902135][ C2] lock_acquire.part.0+0xeb/0x330 [ 46.902318][ C2] _raw_spin_lock+0x30/0x40 [ 46.902484][ C2] set_mems_allowed+0x1d/0x210 [ 46.902648][ C2] kernel_init_freeable+0x72/0x310 [ 46.902815][ C2] kernel_init+0x20/0x200 [ 46.902984][ C2] ret_from_fork+0x31/0x70 [ 46.903149][ C2] ret_from_fork_asm+0x1a/0x30 [ 46.903320][ C2] } [ 46.903391][ C2] ... key at: [] __key.387+0x0/0x40 [ 46.903597][ C2] ... acquired at: [ 46.903701][ C2] __lock_acquire+0xaf0/0x1570 [ 46.903842][ C2] lock_acquire.part.0+0xeb/0x330 [ 46.903974][ C2] _raw_spin_lock+0x30/0x40 [ 46.904107][ C2] __get_task_comm+0x27/0x70 [ 46.904246][ C2] ref_tracker_alloc+0x2ee/0x490 [ 46.904382][ C2] linkwatch_fire_event+0x196/0x200 [ 46.904552][ C2] veth_newlink+0x367/0x830 [veth] [ 46.904693][ C2] rtnl_newlink_create+0x341/0x850 [ 46.904826][ C2] __rtnl_newlink+0xac9/0xd80 [ 46.904961][ C2] rtnl_newlink+0x63/0xa0 [ 46.905094][ C2] rtnetlink_rcv_msg+0x2fb/0xbf0 [ 46.905225][ C2] netlink_rcv_skb+0x130/0x360 [ 46.905362][ C2] netlink_unicast+0x449/0x710 [ 46.905503][ C2] netlink_sendmsg+0x723/0xbe0 [ 46.905642][ C2] ____sys_sendmsg+0x7b2/0xa10 [ 46.905778][ C2] ___sys_sendmsg+0xee/0x170 [ 46.905913][ C2] __sys_sendmsg+0xcd/0x170 [ 46.906046][ C2] do_syscall_64+0xc6/0x1e0 [ 46.906182][ C2] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 46.906349][ C2] [ 46.906418][ C2] -> (lweventlist_lock){....}-{2:2} { [ 46.906558][ C2] INITIAL USE at: [ 46.906666][ C2] __lock_acquire+0x797/0x1570 [ 46.906838][ C2] lock_acquire.part.0+0xeb/0x330 [ 46.907006][ C2] _raw_spin_lock_irqsave+0x3f/0x60 [ 46.907176][ C2] linkwatch_sync_dev+0x29/0x1f0 [ 46.907343][ C2] rtnl_getlink+0x4c9/0x970 [ 46.907510][ C2] rtnetlink_rcv_msg+0x2fb/0xbf0 [ 46.907682][ C2] netlink_rcv_skb+0x130/0x360 [ 46.907852][ C2] netlink_unicast+0x449/0x710 [ 46.908020][ C2] netlink_sendmsg+0x723/0xbe0 [ 46.908185][ C2] __sys_sendto+0x37d/0x410 [ 46.908356][ C2] __x64_sys_sendto+0xe0/0x1c0 [ 46.908522][ C2] do_syscall_64+0xc6/0x1e0 [ 46.908688][ C2] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 46.908904][ C2] } [ 46.908972][ C2] ... key at: [] lweventlist_lock+0x18/0x60 [ 46.909171][ C2] ... acquired at: [ 46.909268][ C2] __lock_acquire+0xaf0/0x1570 [ 46.909403][ C2] lock_acquire.part.0+0xeb/0x330 [ 46.909534][ C2] _raw_spin_lock_irqsave+0x3f/0x60 [ 46.909666][ C2] linkwatch_fire_event+0x74/0x200 [ 46.909803][ C2] br_stp_change_bridge_id+0x25f/0x360 [bridge] [ 46.910020][ C2] br_set_mac_address+0x1f3/0x260 [bridge] [ 46.910216][ C2] dev_set_mac_address+0x28a/0x410 [ 46.910350][ C2] dev_set_mac_address_user+0x31/0x50 [ 46.910484][ C2] do_setlink+0x17b4/0x21e0 [ 46.910619][ C2] rtnl_setlink+0x1f7/0x310 [ 46.910753][ C2] rtnetlink_rcv_msg+0x2fb/0xbf0 [ 46.910890][ C2] netlink_rcv_skb+0x130/0x360 [ 46.911023][ C2] netlink_unicast+0x449/0x710 [ 46.911158][ C2] netlink_sendmsg+0x723/0xbe0 [ 46.911370][ C2] __sys_sendto+0x37d/0x410 [ 46.911503][ C2] __x64_sys_sendto+0xe0/0x1c0 [ 46.911635][ C2] do_syscall_64+0xc6/0x1e0 [ 46.911766][ C2] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 46.912009][ C2] [ 46.912076][ C2] -> (&br->lock){+.-.}-{2:2} { [ 46.912211][ C2] HARDIRQ-ON-W at: [ 46.912317][ C2] __lock_acquire+0x797/0x1570 [ 46.912563][ C2] lock_acquire.part.0+0xeb/0x330 [ 46.912729][ C2] _raw_spin_lock_bh+0x38/0x50 [ 46.912895][ C2] recalculate_group_addr+0x55/0x130 [bridge] [ 46.913132][ C2] br_vlan_filter_toggle+0x77/0x130 [bridge] [ 46.913445][ C2] br_changelink+0x36c/0x1360 [bridge] [ 46.913652][ C2] br_dev_newlink+0xa5/0x100 [bridge] [ 46.913857][ C2] rtnl_newlink_create+0x341/0x850 [ 46.914102][ C2] __rtnl_newlink+0xac9/0xd80 [ 46.914269][ C2] rtnl_newlink+0x63/0xa0 [ 46.914512][ C2] rtnetlink_rcv_msg+0x2fb/0xbf0 [ 46.914802][ C2] netlink_rcv_skb+0x130/0x360 [ 46.915010][ C2] netlink_unicast+0x449/0x710 [ 46.915209][ C2] netlink_sendmsg+0x723/0xbe0 [ 46.915408][ C2] ____sys_sendmsg+0x7b2/0xa10 [ 46.915693][ C2] ___sys_sendmsg+0xee/0x170 [ 46.915892][ C2] __sys_sendmsg+0xcd/0x170 [ 46.916091][ C2] do_syscall_64+0xc6/0x1e0 [ 46.916370][ C2] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 46.916618][ C2] IN-SOFTIRQ-W at: [ 46.916741][ C2] __lock_acquire+0x797/0x1570 [ 46.916945][ C2] lock_acquire.part.0+0xeb/0x330 [ 46.917221][ C2] _raw_spin_lock+0x30/0x40 [ 46.917419][ C2] br_forward_delay_timer_expired+0x48/0x440 [bridge] [ 46.917699][ C2] call_timer_fn+0x13b/0x230 [ 46.917986][ C2] __run_timers+0x545/0x810 [ 46.918188][ C2] run_timer_softirq+0xe8/0x1b0 [ 46.918389][ C2] __do_softirq+0x1f8/0x5df [ 46.918669][ C2] irq_exit_rcu+0x97/0xc0 [ 46.918875][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 46.919115][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 46.919442][ C2] default_idle+0xf/0x20 [ 46.919648][ C2] default_idle_call+0x6d/0xb0 [ 46.919848][ C2] cpuidle_idle_call+0x1f4/0x280 [ 46.920050][ C2] do_idle+0xf9/0x160 [ 46.920211][ C2] cpu_startup_entry+0x54/0x60 [ 46.920409][ C2] start_secondary+0x21c/0x2b0 [ 46.920611][ C2] common_startup_64+0x12c/0x138 [ 46.920820][ C2] INITIAL USE at: [ 46.920949][ C2] __lock_acquire+0x797/0x1570 [ 46.921148][ C2] lock_acquire.part.0+0xeb/0x330 [ 46.921348][ C2] _raw_spin_lock_bh+0x38/0x50 [ 46.921628][ C2] recalculate_group_addr+0x55/0x130 [bridge] [ 46.921908][ C2] br_vlan_filter_toggle+0x77/0x130 [bridge] [ 46.922182][ C2] br_changelink+0x36c/0x1360 [bridge] [ 46.922510][ C2] br_dev_newlink+0xa5/0x100 [bridge] [ 46.922748][ C2] rtnl_newlink_create+0x341/0x850 [ 46.922948][ C2] __rtnl_newlink+0xac9/0xd80 [ 46.923148][ C2] rtnl_newlink+0x63/0xa0 [ 46.923347][ C2] rtnetlink_rcv_msg+0x2fb/0xbf0 [ 46.923546][ C2] netlink_rcv_skb+0x130/0x360 [ 46.923751][ C2] netlink_unicast+0x449/0x710 [ 46.923959][ C2] netlink_sendmsg+0x723/0xbe0 [ 46.924155][ C2] ____sys_sendmsg+0x7b2/0xa10 [ 46.924354][ C2] ___sys_sendmsg+0xee/0x170 [ 46.924571][ C2] __sys_sendmsg+0xcd/0x170 [ 46.924769][ C2] do_syscall_64+0xc6/0x1e0 [ 46.924970][ C2] entry_SYSCALL_64_after_hwframe+0x6d/0x75 [ 46.925295][ C2] } [ 46.925378][ C2] ... key at: [] __key.6+0x0/0xfffffffffffe5ac0 [bridge] [ 46.925696][ C2] ... acquired at: [ 46.925813][ C2] mark_lock+0x28d/0x3e0 [ 46.925980][ C2] mark_usage+0xd9/0x2a0 [ 46.926213][ C2] __lock_acquire+0x797/0x1570 [ 46.926374][ C2] lock_acquire.part.0+0xeb/0x330 [ 46.926539][ C2] _raw_spin_lock+0x30/0x40 [ 46.926701][ C2] br_forward_delay_timer_expired+0x48/0x440 [bridge] [ 46.927016][ C2] call_timer_fn+0x13b/0x230 [ 46.927177][ C2] __run_timers+0x545/0x810 [ 46.927336][ C2] run_timer_softirq+0xe8/0x1b0 [ 46.927496][ C2] __do_softirq+0x1f8/0x5df [ 46.927732][ C2] irq_exit_rcu+0x97/0xc0 [ 46.927897][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 46.928099][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 46.928303][ C2] default_idle+0xf/0x20 [ 46.928551][ C2] default_idle_call+0x6d/0xb0 [ 46.928708][ C2] cpuidle_idle_call+0x1f4/0x280 [ 46.928870][ C2] do_idle+0xf9/0x160 [ 46.928991][ C2] cpu_startup_entry+0x54/0x60 [ 46.929150][ C2] start_secondary+0x21c/0x2b0 [ 46.929310][ C2] common_startup_64+0x12c/0x138 [ 46.929468][ C2] [ 46.929555][ C2] [ 46.929555][ C2] stack backtrace: [ 46.929753][ C2] CPU: 2 PID: 0 Comm: swapper/2 Not tainted 6.9.0-rc1-virtme #1 [ 46.929991][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 46.930342][ C2] Call Trace: [ 46.930464][ C2] [ 46.930547][ C2] dump_stack_lvl+0x82/0xd0 [ 46.930713][ C2] print_irq_inversion_bug.part.0+0x3d9/0x570 [ 46.930918][ C2] ? common_startup_64+0x12c/0x138 [ 46.931079][ C2] ? __pfx_print_irq_inversion_bug.part.0+0x10/0x10 [ 46.931356][ C2] ? __pfx_usage_skip+0x10/0x10 [ 46.931516][ C2] ? __pfx_usage_match+0x10/0x10 [ 46.931677][ C2] ? arch_stack_walk+0x8c/0xf0 [ 46.931838][ C2] mark_lock_irq+0x4cd/0xa10 [ 46.932152][ C2] ? __pfx_mark_lock_irq+0x10/0x10 [ 46.932314][ C2] ? stack_trace_save+0x94/0xd0 [ 46.932480][ C2] ? add_chain_cache+0x248/0x8b0 [ 46.932641][ C2] ? save_trace+0x8f/0x5b0 [ 46.932879][ C2] mark_lock+0x28d/0x3e0 [ 46.933003][ C2] mark_usage+0xd9/0x2a0 [ 46.933126][ C2] __lock_acquire+0x797/0x1570 [ 46.933287][ C2] ? __lock_acquire+0xaf0/0x1570 [ 46.933446][ C2] ? __pfx_br_forward_delay_timer_expired+0x10/0x10 [bridge] [ 46.933797][ C2] lock_acquire.part.0+0xeb/0x330 [ 46.933956][ C2] ? br_forward_delay_timer_expired+0x48/0x440 [bridge] [ 46.934198][ C2] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 46.934484][ C2] ? trace_lock_acquire+0x135/0x1c0 [ 46.934649][ C2] ? br_forward_delay_timer_expired+0x48/0x440 [bridge] [ 46.934881][ C2] ? lock_acquire+0x32/0xc0 [ 46.935041][ C2] ? br_forward_delay_timer_expired+0x48/0x440 [bridge] [ 46.935279][ C2] _raw_spin_lock+0x30/0x40 [ 46.935446][ C2] ? br_forward_delay_timer_expired+0x48/0x440 [bridge] [ 46.935683][ C2] br_forward_delay_timer_expired+0x48/0x440 [bridge] [ 46.935917][ C2] ? __pfx_br_forward_delay_timer_expired+0x10/0x10 [bridge] [ 46.936192][ C2] call_timer_fn+0x13b/0x230 [ 46.936352][ C2] ? call_timer_fn+0xe8/0x230 [ 46.936511][ C2] ? call_timer_fn+0xe8/0x230 [ 46.936677][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 46.936843][ C2] ? mark_lock+0x38/0x3e0 [ 46.936971][ C2] __run_timers+0x545/0x810 [ 46.937132][ C2] ? __pfx_br_forward_delay_timer_expired+0x10/0x10 [bridge] [ 46.937409][ C2] ? __pfx___run_timers+0x10/0x10 [ 46.937648][ C2] ? do_raw_spin_lock+0x131/0x270 [ 46.937808][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 46.937967][ C2] ? lock_acquire+0x32/0xc0 [ 46.938125][ C2] ? run_timer_softirq+0xe0/0x1b0 [ 46.938361][ C2] run_timer_softirq+0xe8/0x1b0 [ 46.938527][ C2] __do_softirq+0x1f8/0x5df [ 46.938689][ C2] irq_exit_rcu+0x97/0xc0 [ 46.938812][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 46.939046][ C2] [ 46.939130][ C2] [ 46.939210][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 46.939407][ C2] RIP: 0010:default_idle+0xf/0x20 [ 46.939571][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d a3 30 35 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 46.940219][ C2] RSP: 0018:ffffc9000015fdf8 EFLAGS: 00000246 [ 46.940427][ C2] RAX: 0000000000124663 RBX: 1ffff9200002bfc1 RCX: ffffffffba70e9d5 [ 46.940746][ C2] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffffffb80aa4a4 [ 46.940987][ C2] RBP: 0000000000000000 R08: 0000000000000001 R09: ffffed1006c2709c [ 46.941231][ C2] R10: ffff8880361384e3 R11: ffff88803613dc80 R12: 0000000000000000 [ 46.941545][ C2] R13: ffff888001b7c5c0 R14: dffffc0000000000 R15: 0000000000000000 [ 46.941783][ C2] ? ct_kernel_exit.constprop.0+0xc5/0xf0 [ 46.941950][ C2] ? cpuidle_idle_call+0x1f4/0x280 [ 46.942185][ C2] default_idle_call+0x6d/0xb0 [ 46.942343][ C2] cpuidle_idle_call+0x1f4/0x280 [ 46.942507][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 46.942666][ C2] ? tsc_verify_tsc_adjust+0x5e/0x2b0 [ 46.942908][ C2] do_idle+0xf9/0x160 [ 46.943029][ C2] cpu_startup_entry+0x54/0x60 [ 46.943188][ C2] start_secondary+0x21c/0x2b0 [ 46.943346][ C2] ? __pfx_start_secondary+0x10/0x10 [ 46.943507][ C2] common_startup_64+0x12c/0x138 [ 46.943745][ C2] [ 60.206515][ C3] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 79.600213][ T570] br1: port 1(veth1) entered disabled state [ 79.691851][ T571] br1: port 2(veth2) entered disabled state [ 79.795307][ T572] veth2: left allmulticast mode [ 79.796222][ T572] veth2: left promiscuous mode [ 79.796711][ T572] br1: port 2(veth2) entered disabled state [ 79.798028][ T572] veth1: left allmulticast mode [ 79.798223][ T572] veth1: left promiscuous mode [ 79.798567][ T572] br1: port 1(veth1) entered disabled state