[ 116.607256][ T706] ip (706) used greatest stack depth: 24008 bytes left [ 116.696757][ T707] eth0: renamed from r1h1 [ 116.894142][ T709] eth0: renamed from r2h1 [ 117.158917][ T712] eth2: renamed from r2h2 [ 117.438054][ T715] eth1: renamed from r2r1 [ 117.831295][ T720] br0: port 1(eth0) entered blocking state [ 117.832115][ T720] br0: port 1(eth0) entered disabled state [ 117.832354][ T720] eth0: entered allmulticast mode [ 117.833569][ T720] eth0: entered promiscuous mode [ 117.836449][ T40] br0: port 1(eth0) entered blocking state [ 117.836906][ T40] br0: port 1(eth0) entered forwarding state [ 117.914813][ T721] br0: port 2(eth1) entered blocking state [ 117.915060][ T721] br0: port 2(eth1) entered disabled state [ 117.915287][ T721] eth1: entered allmulticast mode [ 117.916871][ T721] eth1: entered promiscuous mode [ 117.919057][ T45] br0: port 2(eth1) entered blocking state [ 117.919335][ T45] br0: port 2(eth1) entered forwarding state [ 134.189744][ T11] eth1: left allmulticast mode [ 134.190045][ T11] eth1: left promiscuous mode [ 134.190351][ T11] br0: port 2(eth1) entered disabled state [ 134.193004][ T11] eth0: left allmulticast mode [ 134.193170][ T11] eth0: left promiscuous mode [ 134.193436][ T11] br0: port 1(eth0) entered disabled state [ 139.578305][ T923] eth0: renamed from r1h1 [ 139.750100][ T925] eth0: renamed from r2h1 [ 139.864738][ T926] ip (926) used greatest stack depth: 23616 bytes left [ 140.025818][ T928] eth2: renamed from r2h2 [ 140.291060][ T931] eth1: renamed from r2r1 [ 141.219530][ T943] ip (943) used greatest stack depth: 23528 bytes left [ 141.428006][ T946] br0: port 1(eth0) entered blocking state [ 141.428243][ T946] br0: port 1(eth0) entered disabled state [ 141.428465][ T946] eth0: entered allmulticast mode [ 141.429867][ T946] eth0: entered promiscuous mode [ 141.432794][ T283] br0: port 1(eth0) entered blocking state [ 141.433030][ T283] br0: port 1(eth0) entered forwarding state [ 141.509102][ T947] br0: port 2(eth1) entered blocking state [ 141.509364][ T947] br0: port 2(eth1) entered disabled state [ 141.510761][ T947] eth1: entered allmulticast mode [ 141.511929][ T947] eth1: entered promiscuous mode [ 141.513203][ T45] br0: port 2(eth1) entered blocking state [ 141.513468][ T45] br0: port 2(eth1) entered forwarding state [ 157.724236][ T11] eth1: left allmulticast mode [ 157.724430][ T11] eth1: left promiscuous mode [ 157.724723][ T11] br0: port 2(eth1) entered disabled state [ 157.726144][ T11] eth0: left allmulticast mode [ 157.726316][ T11] eth0: left promiscuous mode [ 157.726808][ T11] br0: port 1(eth0) entered disabled state [ 157.753825][ T11] [ 157.753916][ T11] ============================================ [ 157.754084][ T11] WARNING: possible recursive locking detected [ 157.754249][ T11] 6.13.0-rc5-virtme #1 Not tainted [ 157.754387][ T11] -------------------------------------------- [ 157.754551][ T11] kworker/u16:0/11 is trying to acquire lock: [ 157.754720][ T11] ffffffff9b9f6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 157.754999][ T11] [ 157.754999][ T11] but task is already holding lock: [ 157.755195][ T11] ffffffff9b9f6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 157.755467][ T11] [ 157.755467][ T11] other info that might help us debug this: [ 157.755662][ T11] Possible unsafe locking scenario: [ 157.755662][ T11] [ 157.755862][ T11] CPU0 [ 157.755966][ T11] ---- [ 157.756067][ T11] lock((netdev_chain).rwsem); [ 157.756202][ T11] lock((netdev_chain).rwsem); [ 157.756337][ T11] [ 157.756337][ T11] *** DEADLOCK *** [ 157.756337][ T11] [ 157.756535][ T11] May be due to missing lock nesting notation [ 157.756535][ T11] [ 157.756729][ T11] 5 locks held by kworker/u16:0/11: [ 157.756868][ T11] #0: ffff8880010b5948 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0x7ec/0x16d0 [ 157.757151][ T11] #1: ffffc900000b7da0 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xe0b/0x16d0 [ 157.757394][ T11] #2: ffffffff9b9ec4d0 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xbc/0xba0 [ 157.757638][ T11] #3: ffffffff9ba07e88 (rtnl_mutex){+.+.}-{4:4}, at: cleanup_net+0x45e/0xba0 [ 157.757881][ T11] #4: ffffffff9b9f6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 157.758168][ T11] [ 157.758168][ T11] stack backtrace: [ 157.758337][ T11] CPU: 0 UID: 0 PID: 11 Comm: kworker/u16:0 Not tainted 6.13.0-rc5-virtme #1 [ 157.758571][ T11] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 157.758744][ T11] Workqueue: netns cleanup_net [ 157.758886][ T11] Call Trace: [ 157.758994][ T11] [ 157.759066][ T11] dump_stack_lvl+0x82/0xd0 [ 157.759211][ T11] print_deadlock_bug+0x40a/0x650 [ 157.759350][ T11] validate_chain+0x5bf/0xae0 [ 157.759489][ T11] ? __pfx_validate_chain+0x10/0x10 [ 157.759639][ T11] ? hlock_class+0x4e/0x130 [ 157.759774][ T11] ? mark_lock+0x38/0x3e0 [ 157.759879][ T11] __lock_acquire+0xb9a/0x1680 [ 157.760017][ T11] lock_acquire.part.0+0xeb/0x330 [ 157.760152][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 157.760323][ T11] ? __lock_acquire+0xb9a/0x1680 [ 157.760459][ T11] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 157.760594][ T11] ? trace_lock_acquire+0x14c/0x1f0 [ 157.760728][ T11] ? lock_acquire+0x32/0xc0 [ 157.760863][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 157.761032][ T11] down_read+0x9f/0x340 [ 157.761136][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 157.761304][ T11] ? __pfx_down_read+0x10/0x10 [ 157.761442][ T11] ? __lock_release+0x103/0x460 [ 157.761580][ T11] blocking_notifier_call_chain+0x50/0x90 [ 157.761717][ T11] __netdev_upper_dev_unlink+0xd9/0x220 [ 157.761854][ T11] ? mark_held_locks+0x9e/0xe0 [ 157.761992][ T11] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 157.762164][ T11] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 157.762332][ T11] ? __try_to_del_timer_sync+0xe7/0x140 [ 157.762469][ T11] ? __pfx___try_to_del_timer_sync+0x10/0x10 [ 157.762641][ T11] ? mark_held_locks+0x9e/0xe0 [ 157.762777][ T11] netdev_upper_dev_unlink+0x71/0xa0 [ 157.762912][ T11] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 157.763081][ T11] ? mutex_is_locked+0x1c/0x60 [ 157.763219][ T11] ? rtnl_is_locked+0x15/0x20 [ 157.763353][ T11] ? netdev_master_upper_dev_get+0x13/0x120 [ 157.763519][ T11] vrf_device_event+0x78/0xe0 [ 157.763657][ T11] notifier_call_chain+0xcd/0x150 [ 157.763793][ T11] blocking_notifier_call_chain+0x66/0x90 [ 157.763927][ T11] unregister_netdevice_many_notify+0xa83/0x1580 [ 157.764093][ T11] ? mark_held_locks+0x9e/0xe0 [ 157.764230][ T11] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 157.764400][ T11] ? mutex_is_locked+0x1c/0x60 [ 157.764535][ T11] ? rtnl_is_locked+0x15/0x20 [ 157.764671][ T11] ? mutex_is_locked+0x1c/0x60 [ 157.764806][ T11] ? nexthop_net_exit_batch_rtnl+0x83/0x210 [ 157.764976][ T11] cleanup_net+0x4cf/0xba0 [ 157.765110][ T11] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 157.765247][ T11] ? __pfx_cleanup_net+0x10/0x10 [ 157.765383][ T11] ? trace_lock_acquire+0x14c/0x1f0 [ 157.765521][ T11] ? lock_acquire+0x32/0xc0 [ 157.765655][ T11] ? process_one_work+0xe0b/0x16d0 [ 157.765796][ T11] process_one_work+0xe55/0x16d0 [ 157.765931][ T11] ? __pfx___lock_release+0x10/0x10 [ 157.766067][ T11] ? __pfx_process_one_work+0x10/0x10 [ 157.766203][ T11] ? assign_work+0x16c/0x240 [ 157.766341][ T11] worker_thread+0x58c/0xce0 [ 157.766478][ T11] ? __pfx_worker_thread+0x10/0x10 [ 157.766615][ T11] kthread+0x28a/0x350 [ 157.766720][ T11] ? __pfx_kthread+0x10/0x10 [ 157.766857][ T11] ret_from_fork+0x31/0x70 [ 157.767003][ T11] ? __pfx_kthread+0x10/0x10 [ 157.767133][ T11] ret_from_fork_asm+0x1a/0x30 [ 157.767269][ T11] [ 161.509468][ T1149] eth0: renamed from r1h1 [ 161.642577][ T1151] eth0: renamed from r2h1 [ 161.829726][ T1154] eth2: renamed from r2h2 [ 162.025625][ T1157] eth1: renamed from r2r1 [ 162.297896][ T1162] br0: port 1(eth0) entered blocking state [ 162.298089][ T1162] br0: port 1(eth0) entered disabled state [ 162.298268][ T1162] eth0: entered allmulticast mode [ 162.299157][ T1162] eth0: entered promiscuous mode [ 162.300569][ T283] br0: port 1(eth0) entered blocking state [ 162.300767][ T283] br0: port 1(eth0) entered forwarding state [ 162.352673][ T1163] br0: port 2(eth1) entered blocking state [ 162.352857][ T1163] br0: port 2(eth1) entered disabled state [ 162.353035][ T1163] eth1: entered allmulticast mode [ 162.360255][ T1163] eth1: entered promiscuous mode [ 162.361404][ T45] br0: port 2(eth1) entered blocking state [ 162.361597][ T45] br0: port 2(eth1) entered forwarding state [ 177.059803][ T11] eth1: left allmulticast mode [ 177.059962][ T11] eth1: left promiscuous mode [ 177.060216][ T11] br0: port 2(eth1) entered disabled state [ 177.061353][ T11] eth0: left allmulticast mode [ 177.061588][ T11] eth0: left promiscuous mode [ 177.061885][ T11] br0: port 1(eth0) entered disabled state [ 180.757367][ T1376] eth0: renamed from r1h1 [ 180.906270][ T1378] eth0: renamed from r2h1 [ 181.097887][ T1381] eth2: renamed from r2h2 [ 181.293780][ T1384] eth1: renamed from r2r1 [ 182.084606][ T1399] br0: port 1(eth0) entered blocking state [ 182.084837][ T1399] br0: port 1(eth0) entered disabled state [ 182.085033][ T1399] eth0: entered allmulticast mode [ 182.085960][ T1399] eth0: entered promiscuous mode [ 182.087543][ T39] br0: port 1(eth0) entered blocking state [ 182.087724][ T39] br0: port 1(eth0) entered forwarding state [ 182.146033][ T1400] br0: port 2(eth1) entered blocking state [ 182.146261][ T1400] br0: port 2(eth1) entered disabled state [ 182.146455][ T1400] eth1: entered allmulticast mode [ 182.147612][ T1400] eth1: entered promiscuous mode [ 182.148679][ T39] br0: port 2(eth1) entered blocking state [ 182.148853][ T39] br0: port 2(eth1) entered forwarding state [ 197.129090][ T11] eth1: left allmulticast mode [ 197.129332][ T11] eth1: left promiscuous mode [ 197.129581][ T11] br0: port 2(eth1) entered disabled state [ 197.130744][ T11] eth0: left allmulticast mode [ 197.130884][ T11] eth0: left promiscuous mode [ 197.131141][ T11] br0: port 1(eth0) entered disabled state