[ 1063.246778][ T8844] eth0: renamed from veth0 [ 1063.395958][ T8849] swp1: renamed from veth1 [ 1063.837170][ T8861] veth0: renamed from veth1 [ 1064.129375][ T8863] eth0: renamed from veth0 [ 1064.284825][ T8866] swp1: renamed from veth1 [ 1067.380917][ T8890] br0: port 1(swp1) entered blocking state [ 1067.381141][ T8890] br0: port 1(swp1) entered disabled state [ 1067.381359][ T8890] swp1: entered allmulticast mode [ 1067.382498][ T8890] swp1: entered promiscuous mode [ 1067.385541][ T51] br0: port 1(swp1) entered blocking state [ 1067.385757][ T51] br0: port 1(swp1) entered forwarding state [ 1067.777980][ T8893] br0: port 2(vx0) entered blocking state [ 1067.778183][ T8893] br0: port 2(vx0) entered disabled state [ 1067.778378][ T8893] vx0: entered allmulticast mode [ 1067.779524][ T8893] vx0: entered promiscuous mode [ 1067.780058][ T8893] br0: port 2(vx0) entered blocking state [ 1067.780232][ T8893] br0: port 2(vx0) entered forwarding state [ 1069.992682][ T8910] br0: port 1(swp1) entered blocking state [ 1069.992946][ T8910] br0: port 1(swp1) entered disabled state [ 1069.993172][ T8910] swp1: entered allmulticast mode [ 1069.994307][ T8910] swp1: entered promiscuous mode [ 1069.997965][ T62] br0: port 1(swp1) entered blocking state [ 1069.998188][ T62] br0: port 1(swp1) entered forwarding state [ 1070.379735][ T8913] br0: port 2(vx0) entered blocking state [ 1070.379946][ T8913] br0: port 2(vx0) entered disabled state [ 1070.380132][ T8913] vx0: entered allmulticast mode [ 1070.381280][ T8913] vx0: entered promiscuous mode [ 1070.382295][ T8913] br0: port 2(vx0) entered blocking state [ 1070.382495][ T8913] br0: port 2(vx0) entered forwarding state [ 1101.489369][ T10] br0: port 1(swp1) entered disabled state [ 1101.495196][ T10] swp1 (unregistering): left allmulticast mode [ 1101.495938][ T10] swp1 (unregistering): left promiscuous mode [ 1101.496212][ T10] br0: port 1(swp1) entered disabled state [ 1101.862068][ T10] br0: port 1(swp1) entered disabled state [ 1101.869807][ T10] swp1 (unregistering): left allmulticast mode [ 1101.870019][ T10] swp1 (unregistering): left promiscuous mode [ 1101.870211][ T10] br0: port 1(swp1) entered disabled state [ 1102.176608][ T10] vx0: left allmulticast mode [ 1102.176805][ T10] vx0: left promiscuous mode [ 1102.177083][ T10] br0: port 2(vx0) entered disabled state [ 1102.537381][ T10] vx0: left allmulticast mode [ 1102.537579][ T10] vx0: left promiscuous mode [ 1102.537852][ T10] br0: port 2(vx0) entered disabled state [ 1108.814460][ T9110] eth0: renamed from veth0 [ 1108.963883][ T9115] swp1: renamed from veth1 [ 1109.413174][ T9127] veth0: renamed from veth1 [ 1109.681770][ T9131] eth0: renamed from veth0 [ 1109.815981][ T9132] swp1: renamed from veth1 [ 1113.029472][ T9156] br0: port 1(swp1) entered blocking state [ 1113.030263][ T9156] br0: port 1(swp1) entered disabled state [ 1113.030949][ T9156] swp1: entered allmulticast mode [ 1113.033287][ T9156] swp1: entered promiscuous mode [ 1113.042937][ T7] br0: port 1(swp1) entered blocking state [ 1113.043163][ T7] br0: port 1(swp1) entered forwarding state [ 1113.467505][ T9160] br0: port 2(vx0) entered blocking state [ 1113.467715][ T9160] br0: port 2(vx0) entered disabled state [ 1113.467898][ T9160] vx0: entered allmulticast mode [ 1113.469004][ T9160] vx0: entered promiscuous mode [ 1113.470003][ T9160] br0: port 2(vx0) entered blocking state [ 1113.470181][ T9160] br0: port 2(vx0) entered forwarding state [ 1115.437388][ C1] [ 1115.437510][ C1] ====================================================== [ 1115.437760][ C1] WARNING: possible circular locking dependency detected [ 1115.438028][ C1] 6.9.0-rc2-virtme #1 Not tainted [ 1115.438247][ C1] ------------------------------------------------------ [ 1115.438510][ C1] swapper/1/0 is trying to acquire lock: [ 1115.438729][ C1] ffff888003e4b998 (&hashinfo->ehash_locks[i]){+.-.}-{2:2}, at: tw_timer_handler+0xe9/0x130 [ 1115.439170][ C1] [ 1115.439170][ C1] but task is already holding lock: [ 1115.439487][ C1] ffffc900001d8d68 ((&tw->tw_timer)){+.-.}-{0:0}, at: call_timer_fn+0xe8/0x230 [ 1115.439876][ C1] [ 1115.439876][ C1] which lock already depends on the new lock. [ 1115.439876][ C1] [ 1115.440296][ C1] [ 1115.440296][ C1] the existing dependency chain (in reverse order) is: [ 1115.440660][ C1] [ 1115.440660][ C1] -> #1 ((&tw->tw_timer)){+.-.}-{0:0}: [ 1115.440996][ C1] __lock_acquire+0xaf0/0x1570 [ 1115.441219][ C1] lock_acquire.part.0+0xeb/0x330 [ 1115.441432][ C1] __timer_delete_sync+0xe1/0x110 [ 1115.441643][ C1] inet_twsk_deschedule_put+0xec/0x150 [ 1115.441910][ C1] inet_twsk_purge+0x4c8/0x660 [ 1115.442123][ C1] tcp_twsk_purge+0x112/0x160 [ 1115.442337][ C1] tcp_sk_exit_batch+0x17/0x120 [ 1115.442551][ C1] cleanup_net+0x4f3/0xb60 [ 1115.442771][ C1] process_one_work+0xe2c/0x1730 [ 1115.442990][ C1] worker_thread+0x587/0xd30 [ 1115.443201][ C1] kthread+0x28a/0x350 [ 1115.443414][ C1] ret_from_fork+0x31/0x70 [ 1115.443629][ C1] ret_from_fork_asm+0x1a/0x30 [ 1115.443843][ C1] [ 1115.443843][ C1] -> #0 (&hashinfo->ehash_locks[i]){+.-.}-{2:2}: [ 1115.444162][ C1] check_prev_add+0x182/0xce0 [ 1115.444379][ C1] validate_chain+0x71d/0x9b0 [ 1115.444598][ C1] __lock_acquire+0xaf0/0x1570 [ 1115.444811][ C1] lock_acquire.part.0+0xeb/0x330 [ 1115.445033][ C1] _raw_spin_lock+0x30/0x40 [ 1115.445252][ C1] tw_timer_handler+0xe9/0x130 [ 1115.445466][ C1] call_timer_fn+0x13b/0x230 [ 1115.445679][ C1] __run_timers+0x545/0x810 [ 1115.445899][ C1] run_timer_softirq+0x7a/0x1b0 [ 1115.446114][ C1] __do_softirq+0x1f8/0x5df [ 1115.446333][ C1] irq_exit_rcu+0x97/0xc0 [ 1115.446555][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 1115.446823][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1115.447089][ C1] default_idle+0xf/0x20 [ 1115.447307][ C1] default_idle_call+0x6d/0xb0 [ 1115.447521][ C1] cpuidle_idle_call+0x1f4/0x280 [ 1115.447742][ C1] do_idle+0xf9/0x160 [ 1115.447959][ C1] cpu_startup_entry+0x54/0x60 [ 1115.448186][ C1] start_secondary+0x21c/0x2b0 [ 1115.448397][ C1] common_startup_64+0x12c/0x138 [ 1115.448612][ C1] [ 1115.448612][ C1] other info that might help us debug this: [ 1115.448612][ C1] [ 1115.449023][ C1] Possible unsafe locking scenario: [ 1115.449023][ C1] [ 1115.449338][ C1] CPU0 CPU1 [ 1115.449554][ C1] ---- ---- [ 1115.449769][ C1] lock((&tw->tw_timer)); [ 1115.449987][ C1] lock(&hashinfo->ehash_locks[i]); [ 1115.450318][ C1] lock((&tw->tw_timer)); [ 1115.450586][ C1] lock(&hashinfo->ehash_locks[i]); [ 1115.450802][ C1] [ 1115.450802][ C1] *** DEADLOCK *** [ 1115.450802][ C1] [ 1115.451119][ C1] 1 lock held by swapper/1/0: [ 1115.451334][ C1] #0: ffffc900001d8d68 ((&tw->tw_timer)){+.-.}-{0:0}, at: call_timer_fn+0xe8/0x230 [ 1115.451836][ C1] [ 1115.451836][ C1] stack backtrace: [ 1115.452083][ C1] CPU: 1 PID: 0 Comm: swapper/1 Not tainted 6.9.0-rc2-virtme #1 [ 1115.452398][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 1115.453009][ C1] Call Trace: [ 1115.453173][ C1] [ 1115.453285][ C1] dump_stack_lvl+0x82/0xd0 [ 1115.453646][ C1] check_noncircular+0x2f9/0x3e0 [ 1115.453861][ C1] ? get_stack_info+0x35/0xc0 [ 1115.454077][ C1] ? __pfx_check_noncircular+0x10/0x10 [ 1115.454437][ C1] ? common_startup_64+0x12c/0x138 [ 1115.454651][ C1] ? alloc_chain_hlocks+0x4e0/0x720 [ 1115.454863][ C1] check_prev_add+0x182/0xce0 [ 1115.455087][ C1] validate_chain+0x71d/0x9b0 [ 1115.455443][ C1] ? __pfx_validate_chain+0x10/0x10 [ 1115.455657][ C1] ? hlock_class+0x4e/0x130 [ 1115.455868][ C1] ? mark_lock+0x38/0x3e0 [ 1115.456036][ C1] __lock_acquire+0xaf0/0x1570 [ 1115.456391][ C1] ? __pfx_tw_timer_handler+0x10/0x10 [ 1115.456605][ C1] lock_acquire.part.0+0xeb/0x330 [ 1115.456819][ C1] ? tw_timer_handler+0xe9/0x130 [ 1115.457033][ C1] ? __pfx_tw_timer_handler+0x10/0x10 [ 1115.457387][ C1] ? lock_acquire.part.0+0xeb/0x330 [ 1115.457600][ C1] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1115.457818][ C1] ? trace_lock_acquire+0x135/0x1c0 [ 1115.458036][ C1] ? tw_timer_handler+0xe9/0x130 [ 1115.458250][ C1] ? lock_acquire+0x32/0xc0 [ 1115.458747][ C1] ? tw_timer_handler+0xe9/0x130 [ 1115.458967][ C1] _raw_spin_lock+0x30/0x40 [ 1115.459187][ C1] ? tw_timer_handler+0xe9/0x130 [ 1115.459404][ C1] tw_timer_handler+0xe9/0x130 [ 1115.459618][ C1] call_timer_fn+0x13b/0x230 [ 1115.459836][ C1] ? call_timer_fn+0xe8/0x230 [ 1115.460051][ C1] ? call_timer_fn+0xe8/0x230 [ 1115.460265][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 1115.460621][ C1] ? mark_lock+0x38/0x3e0 [ 1115.460791][ C1] __run_timers+0x545/0x810 [ 1115.461002][ C1] ? __pfx_tw_timer_handler+0x10/0x10 [ 1115.461218][ C1] ? __pfx___run_timers+0x10/0x10 [ 1115.461431][ C1] ? do_raw_spin_lock+0x131/0x270 [ 1115.461642][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 1115.461853][ C1] ? lock_acquire+0x32/0xc0 [ 1115.462063][ C1] ? run_timer_softirq+0x72/0x1b0 [ 1115.462276][ C1] run_timer_softirq+0x7a/0x1b0 [ 1115.462633][ C1] __do_softirq+0x1f8/0x5df [ 1115.462847][ C1] irq_exit_rcu+0x97/0xc0 [ 1115.463011][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 1115.463222][ C1] [ 1115.463335][ C1] [ 1115.463443][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1115.463707][ C1] RIP: 0010:default_idle+0xf/0x20 [ 1115.463930][ C1] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 23 8d 32 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 1115.464836][ C1] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 1115.465111][ C1] RAX: 000000000159940f RBX: 1ffff92000029fc1 RCX: ffffffffac738e55 [ 1115.465439][ C1] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffffffa9eac0e4 [ 1115.465915][ C1] RBP: 0000000000000000 R08: 0000000000000001 R09: ffffed1006c1709c [ 1115.466234][ C1] R10: ffff8880360b84e3 R11: ffff8880360ad9b0 R12: 0000000000000000 [ 1115.466548][ C1] R13: ffff888001b8a300 R14: dffffc0000000000 R15: 0000000000000000 [ 1115.467018][ C1] ? ct_kernel_exit.constprop.0+0xc5/0xf0 [ 1115.467231][ C1] ? cpuidle_idle_call+0x1f4/0x280 [ 1115.467448][ C1] default_idle_call+0x6d/0xb0 [ 1115.467796][ C1] cpuidle_idle_call+0x1f4/0x280 [ 1115.468010][ C1] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 1115.468364][ C1] ? tsc_verify_tsc_adjust+0x5e/0x2b0 [ 1115.468582][ C1] do_idle+0xf9/0x160 [ 1115.468894][ C1] cpu_startup_entry+0x54/0x60 [ 1115.469108][ C1] start_secondary+0x21c/0x2b0 [ 1115.469464][ C1] ? __pfx_start_secondary+0x10/0x10 [ 1115.469677][ C1] common_startup_64+0x12c/0x138 [ 1115.469897][ C1] [ 1115.735247][ T9177] br0: port 1(swp1) entered blocking state [ 1115.735535][ T9177] br0: port 1(swp1) entered disabled state [ 1115.735715][ T9177] swp1: entered allmulticast mode [ 1115.736627][ T9177] swp1: entered promiscuous mode [ 1115.739882][ T62] br0: port 1(swp1) entered blocking state [ 1115.740111][ T62] br0: port 1(swp1) entered forwarding state [ 1116.101052][ T9180] br0: port 2(vx0) entered blocking state [ 1116.101257][ T9180] br0: port 2(vx0) entered disabled state [ 1116.101437][ T9180] vx0: entered allmulticast mode [ 1116.102348][ T9180] vx0: entered promiscuous mode [ 1116.102752][ T9180] br0: port 2(vx0) entered blocking state [ 1116.102913][ T9180] br0: port 2(vx0) entered forwarding state [ 1201.418148][ T10] br0: port 1(swp1) entered disabled state [ 1201.422306][ T10] swp1 (unregistering): left allmulticast mode [ 1201.422882][ T10] swp1 (unregistering): left promiscuous mode [ 1201.423085][ T10] br0: port 1(swp1) entered disabled state [ 1201.719540][ T10] br0: port 1(swp1) entered disabled state [ 1201.724511][ T10] swp1 (unregistering): left allmulticast mode [ 1201.724733][ T10] swp1 (unregistering): left promiscuous mode [ 1201.724943][ T10] br0: port 1(swp1) entered disabled state [ 1202.003969][ T10] vx0: left allmulticast mode [ 1202.004216][ T10] vx0: left promiscuous mode [ 1202.004589][ T10] br0: port 2(vx0) entered disabled state [ 1202.298820][ T10] vx0: left allmulticast mode [ 1202.299023][ T10] vx0: left promiscuous mode [ 1202.299285][ T10] br0: port 2(vx0) entered disabled state [ 1207.798125][ T9376] eth0: renamed from veth0 [ 1207.914857][ T9381] swp1: renamed from veth1 [ 1208.338310][ T9392] veth0: renamed from veth1 [ 1208.566271][ T9395] eth0: renamed from veth0 [ 1208.690203][ T9398] swp1: renamed from veth1 [ 1211.403507][ T9422] br0: port 1(swp1) entered blocking state [ 1211.403766][ T9422] br0: port 1(swp1) entered disabled state [ 1211.403938][ T9422] swp1: entered allmulticast mode [ 1211.404874][ T9422] swp1: entered promiscuous mode [ 1211.407627][ T5748] br0: port 1(swp1) entered blocking state [ 1211.407787][ T5748] br0: port 1(swp1) entered forwarding state [ 1211.751552][ T9425] br0: port 2(vx0) entered blocking state [ 1211.751796][ T9425] br0: port 2(vx0) entered disabled state [ 1211.751941][ T9425] vx0: entered allmulticast mode [ 1211.752858][ T9425] vx0: entered promiscuous mode [ 1211.753369][ T9425] br0: port 2(vx0) entered blocking state [ 1211.753506][ T9425] br0: port 2(vx0) entered forwarding state [ 1213.761418][ T9442] br0: port 1(swp1) entered blocking state [ 1213.761707][ T9442] br0: port 1(swp1) entered disabled state [ 1213.761881][ T9442] swp1: entered allmulticast mode [ 1213.762793][ T9442] swp1: entered promiscuous mode [ 1213.766404][ T51] br0: port 1(swp1) entered blocking state [ 1213.766573][ T51] br0: port 1(swp1) entered forwarding state [ 1214.109985][ T9445] br0: port 2(vx0) entered blocking state [ 1214.110177][ T9445] br0: port 2(vx0) entered disabled state [ 1214.110324][ T9445] vx0: entered allmulticast mode [ 1214.111211][ T9445] vx0: entered promiscuous mode [ 1214.111587][ T9445] br0: port 2(vx0) entered blocking state [ 1214.111717][ T9445] br0: port 2(vx0) entered forwarding state [ 1240.781128][ T10] br0: port 1(swp1) entered disabled state [ 1240.785637][ T10] swp1 (unregistering): left allmulticast mode [ 1240.785903][ T10] swp1 (unregistering): left promiscuous mode [ 1240.786150][ T10] br0: port 1(swp1) entered disabled state [ 1241.094501][ T10] br0: port 1(swp1) entered disabled state [ 1241.099901][ T10] swp1 (unregistering): left allmulticast mode [ 1241.100088][ T10] swp1 (unregistering): left promiscuous mode [ 1241.100241][ T10] br0: port 1(swp1) entered disabled state [ 1241.383632][ T10] vx0: left allmulticast mode [ 1241.383780][ T10] vx0: left promiscuous mode [ 1241.384010][ T10] br0: port 2(vx0) entered disabled state [ 1241.683425][ T10] vx0: left allmulticast mode [ 1241.683575][ T10] vx0: left promiscuous mode [ 1241.683803][ T10] br0: port 2(vx0) entered disabled state [ 1247.083191][ T9633] eth0: renamed from veth0 [ 1247.218493][ T9637] swp1: renamed from veth1 [ 1247.562227][ T9650] veth0: renamed from veth1 [ 1247.810951][ T9652] eth0: renamed from veth0 [ 1247.950378][ T9655] swp1: renamed from veth1 [ 1250.731694][ T9679] br0: port 1(swp1) entered blocking state [ 1250.732086][ T9679] br0: port 1(swp1) entered disabled state [ 1250.732397][ T9679] swp1: entered allmulticast mode [ 1250.735809][ T9679] swp1: entered promiscuous mode [ 1250.740250][ T51] br0: port 1(swp1) entered blocking state [ 1250.740622][ T51] br0: port 1(swp1) entered forwarding state [ 1251.213206][ T9682] br0: port 2(vx0) entered blocking state [ 1251.213858][ T9682] br0: port 2(vx0) entered disabled state [ 1251.214027][ T9682] vx0: entered allmulticast mode [ 1251.215008][ T9682] vx0: entered promiscuous mode [ 1251.215470][ T9682] br0: port 2(vx0) entered blocking state [ 1251.215615][ T9682] br0: port 2(vx0) entered forwarding state [ 1253.181838][ T9699] br0: port 1(swp1) entered blocking state [ 1253.182110][ T9699] br0: port 1(swp1) entered disabled state [ 1253.182301][ T9699] swp1: entered allmulticast mode [ 1253.184374][ T9699] swp1: entered promiscuous mode [ 1253.187169][ T5573] br0: port 1(swp1) entered blocking state [ 1253.187364][ T5573] br0: port 1(swp1) entered forwarding state [ 1253.503611][ T9702] br0: port 2(vx0) entered blocking state [ 1253.503851][ T9702] br0: port 2(vx0) entered disabled state [ 1253.504001][ T9702] vx0: entered allmulticast mode [ 1253.504881][ T9702] vx0: entered promiscuous mode [ 1253.505246][ T9702] br0: port 2(vx0) entered blocking state [ 1253.505397][ T9702] br0: port 2(vx0) entered forwarding state [ 1269.300908][ T10] br0: port 1(swp1) entered disabled state [ 1269.305995][ T10] swp1 (unregistering): left allmulticast mode [ 1269.306316][ T10] swp1 (unregistering): left promiscuous mode [ 1269.306536][ T10] br0: port 1(swp1) entered disabled state [ 1269.725794][ T10] br0: port 1(swp1) entered disabled state [ 1269.730522][ T10] swp1 (unregistering): left allmulticast mode [ 1269.730748][ T10] swp1 (unregistering): left promiscuous mode [ 1269.730921][ T10] br0: port 1(swp1) entered disabled state [ 1270.084693][ T10] vx0: left allmulticast mode [ 1270.084959][ T10] vx0: left promiscuous mode [ 1270.085381][ T10] br0: port 2(vx0) entered disabled state [ 1270.536864][ T10] vx0: left allmulticast mode [ 1270.537091][ T10] vx0: left promiscuous mode [ 1270.537397][ T10] br0: port 2(vx0) entered disabled state