[ 11.072355][ T264] ip (264) used greatest stack depth: 23752 bytes left [ 12.343102][ T281] eth0: renamed from r1h1 [ 12.532179][ T283] eth1: renamed from r1h2 [ 18.167857][ T11] [ 18.167996][ T11] ============================================ [ 18.168177][ T11] WARNING: possible recursive locking detected [ 18.168343][ T11] 6.13.0-rc5-virtme #1 Not tainted [ 18.168486][ T11] -------------------------------------------- [ 18.168652][ T11] kworker/u16:0/11 is trying to acquire lock: [ 18.168824][ T11] ffffffff865f6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 18.169118][ T11] [ 18.169118][ T11] but task is already holding lock: [ 18.169319][ T11] ffffffff865f6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 18.169600][ T11] [ 18.169600][ T11] other info that might help us debug this: [ 18.169796][ T11] Possible unsafe locking scenario: [ 18.169796][ T11] [ 18.169997][ T11] CPU0 [ 18.170105][ T11] ---- [ 18.170206][ T11] lock((netdev_chain).rwsem); [ 18.170342][ T11] lock((netdev_chain).rwsem); [ 18.170484][ T11] [ 18.170484][ T11] *** DEADLOCK *** [ 18.170484][ T11] [ 18.170683][ T11] May be due to missing lock nesting notation [ 18.170683][ T11] [ 18.170882][ T11] 5 locks held by kworker/u16:0/11: [ 18.171020][ T11] #0: ffff8880010b5948 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0x7ec/0x16d0 [ 18.171309][ T11] #1: ffffc900000b7da0 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xe0b/0x16d0 [ 18.171556][ T11] #2: ffffffff865ec4d0 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xbc/0xba0 [ 18.171805][ T11] #3: ffffffff86607e88 (rtnl_mutex){+.+.}-{4:4}, at: default_device_exit_batch+0x81/0x2e0 [ 18.172087][ T11] #4: ffffffff865f6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 18.172365][ T11] [ 18.172365][ T11] stack backtrace: [ 18.172538][ T11] CPU: 0 UID: 0 PID: 11 Comm: kworker/u16:0 Not tainted 6.13.0-rc5-virtme #1 [ 18.172783][ T11] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 18.172958][ T11] Workqueue: netns cleanup_net [ 18.173104][ T11] Call Trace: [ 18.173210][ T11] [ 18.173283][ T11] dump_stack_lvl+0x82/0xd0 [ 18.173430][ T11] print_deadlock_bug+0x40a/0x650 [ 18.173570][ T11] validate_chain+0x5bf/0xae0 [ 18.173711][ T11] ? __pfx_validate_chain+0x10/0x10 [ 18.173851][ T11] ? hlock_class+0x4e/0x130 [ 18.173990][ T11] ? mark_lock+0x38/0x3e0 [ 18.174095][ T11] __lock_acquire+0xb9a/0x1680 [ 18.174241][ T11] lock_acquire.part.0+0xeb/0x330 [ 18.174382][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 18.174558][ T11] ? __lock_acquire+0xb9a/0x1680 [ 18.174700][ T11] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 18.174840][ T11] ? trace_lock_acquire+0x14c/0x1f0 [ 18.174983][ T11] ? lock_acquire+0x32/0xc0 [ 18.175125][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 18.175303][ T11] down_read+0x9f/0x340 [ 18.175410][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 18.175582][ T11] ? __pfx_down_read+0x10/0x10 [ 18.175721][ T11] ? __lock_release+0x103/0x460 [ 18.175858][ T11] blocking_notifier_call_chain+0x50/0x90 [ 18.176009][ T11] __netdev_upper_dev_unlink+0xd9/0x220 [ 18.176150][ T11] ? mark_held_locks+0x9e/0xe0 [ 18.176292][ T11] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 18.176470][ T11] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 18.176705][ T11] ? __try_to_del_timer_sync+0xe7/0x140 [ 18.176849][ T11] ? __pfx___try_to_del_timer_sync+0x10/0x10 [ 18.177018][ T11] ? mark_held_locks+0x9e/0xe0 [ 18.177160][ T11] netdev_upper_dev_unlink+0x71/0xa0 [ 18.177303][ T11] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 18.177478][ T11] ? mutex_is_locked+0x1c/0x60 [ 18.177629][ T11] ? rtnl_is_locked+0x15/0x20 [ 18.177769][ T11] ? netdev_master_upper_dev_get+0x13/0x120 [ 18.177941][ T11] vrf_device_event+0x78/0xe0 [ 18.178086][ T11] notifier_call_chain+0xcd/0x150 [ 18.178233][ T11] blocking_notifier_call_chain+0x66/0x90 [ 18.178372][ T11] unregister_netdevice_many_notify+0xa83/0x1580 [ 18.178548][ T11] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 18.178722][ T11] ? default_device_exit_batch+0x81/0x2e0 [ 18.178860][ T11] ? rtnl_is_locked+0x15/0x20 [ 18.178997][ T11] ? unregister_netdevice_queue+0x70/0x410 [ 18.179169][ T11] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 18.179342][ T11] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 18.179512][ T11] default_device_exit_batch+0x241/0x2e0 [ 18.179652][ T11] ? __pfx_default_device_exit_batch+0x10/0x10 [ 18.179825][ T11] ? ops_exit_list+0xb4/0x170 [ 18.179965][ T11] cleanup_net+0x4ef/0xba0 [ 18.180102][ T11] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 18.180241][ T11] ? __pfx_cleanup_net+0x10/0x10 [ 18.180377][ T11] ? trace_lock_acquire+0x14c/0x1f0 [ 18.180517][ T11] ? lock_acquire+0x32/0xc0 [ 18.180653][ T11] ? process_one_work+0xe0b/0x16d0 [ 18.180801][ T11] process_one_work+0xe55/0x16d0 [ 18.180945][ T11] ? __pfx___lock_release+0x10/0x10 [ 18.181085][ T11] ? __pfx_process_one_work+0x10/0x10 [ 18.181221][ T11] ? assign_work+0x16c/0x240 [ 18.181363][ T11] worker_thread+0x58c/0xce0 [ 18.181508][ T11] ? __pfx_worker_thread+0x10/0x10 [ 18.181647][ T11] kthread+0x28a/0x350 [ 18.181759][ T11] ? __pfx_kthread+0x10/0x10 [ 18.181907][ T11] ret_from_fork+0x31/0x70 [ 18.182049][ T11] ? __pfx_kthread+0x10/0x10 [ 18.182187][ T11] ret_from_fork_asm+0x1a/0x30 [ 18.182330][ T11] [ 20.347635][ T377] eth0: renamed from r1h1 [ 20.501152][ T379] eth1: renamed from r1h2 [ 27.550955][ T474] eth0: renamed from r1h1 [ 27.706166][ T476] eth1: renamed from r1h2 [ 34.523880][ T569] eth0: renamed from r1h1 [ 34.670664][ T571] eth1: renamed from r1h2 [ 41.350555][ T662] eth0: renamed from r1h1 [ 41.503013][ T664] eth1: renamed from r1h2 [ 49.244510][ T760] eth0: renamed from r1h1 [ 49.387755][ T762] eth1: renamed from r1h2 [ 57.445404][ T864] eth0: renamed from r1h1 [ 57.607567][ T866] eth0: renamed from r2h1 [ 57.756611][ T868] eth1: renamed from r1h2 [ 57.902762][ T870] eth1: renamed from r2h2 [ 58.194767][ T875] br0: port 1(eth0) entered blocking state [ 58.195011][ T875] br0: port 1(eth0) entered disabled state [ 58.195210][ T875] eth0: entered allmulticast mode [ 58.196142][ T875] eth0: entered promiscuous mode [ 58.198346][ T418] br0: port 1(eth0) entered blocking state [ 58.198578][ T418] br0: port 1(eth0) entered forwarding state [ 58.263491][ T876] br0: port 2(eth1) entered blocking state [ 58.263782][ T876] br0: port 2(eth1) entered disabled state [ 58.263990][ T876] eth1: entered allmulticast mode [ 58.264946][ T876] eth1: entered promiscuous mode [ 58.266597][ T55] br0: port 2(eth1) entered blocking state [ 58.266812][ T55] br0: port 2(eth1) entered forwarding state [ 58.660046][ T883] br0: port 1(eth0) entered blocking state [ 58.660323][ T883] br0: port 1(eth0) entered disabled state [ 58.660541][ T883] eth0: entered allmulticast mode [ 58.661476][ T883] eth0: entered promiscuous mode [ 58.711039][ T884] br0: port 2(eth1) entered blocking state [ 58.711256][ T884] br0: port 2(eth1) entered disabled state [ 58.711452][ T884] eth1: entered allmulticast mode [ 58.712364][ T884] eth1: entered promiscuous mode [ 58.714415][ T418] br0: port 2(eth1) entered blocking state [ 58.714651][ T418] br0: port 2(eth1) entered forwarding state [ 59.385650][ T37] br0: port 1(eth0) entered blocking state [ 59.386152][ T37] br0: port 1(eth0) entered forwarding state [ 63.066145][ T11] eth1: left allmulticast mode [ 63.066335][ T11] eth1: left promiscuous mode [ 63.066634][ T11] br0: port 2(eth1) entered disabled state [ 63.067967][ T11] eth0: left allmulticast mode [ 63.068119][ T11] eth0: left promiscuous mode [ 63.068372][ T11] br0: port 1(eth0) entered disabled state [ 63.367251][ T11] eth1: left allmulticast mode [ 63.367447][ T11] eth1: left promiscuous mode [ 63.367799][ T11] br0: port 2(eth1) entered disabled state [ 63.369382][ T11] eth0: left allmulticast mode [ 63.369565][ T11] eth0: left promiscuous mode [ 63.369926][ T11] br0: port 1(eth0) entered disabled state [ 66.416010][ T988] eth0: renamed from r1h1 [ 66.587103][ T990] eth0: renamed from r2h1 [ 66.770642][ T992] eth1: renamed from r1h2 [ 66.927507][ T994] eth1: renamed from r2h2 [ 67.233207][ T999] br0: port 1(eth0) entered blocking state [ 67.233512][ T999] br0: port 1(eth0) entered disabled state [ 67.234115][ T999] eth0: entered allmulticast mode [ 67.235085][ T999] eth0: entered promiscuous mode [ 67.236796][ T55] br0: port 1(eth0) entered blocking state [ 67.237014][ T55] br0: port 1(eth0) entered forwarding state [ 67.292581][ T1000] br0: port 2(eth1) entered blocking state [ 67.293049][ T1000] br0: port 2(eth1) entered disabled state [ 67.293261][ T1000] eth1: entered allmulticast mode [ 67.294197][ T1000] eth1: entered promiscuous mode [ 67.295622][ T37] br0: port 2(eth1) entered blocking state [ 67.295849][ T37] br0: port 2(eth1) entered forwarding state [ 67.717091][ T1007] br0: port 1(eth0) entered blocking state [ 67.717376][ T1007] br0: port 1(eth0) entered disabled state [ 67.717587][ T1007] eth0: entered allmulticast mode [ 67.718546][ T1007] eth0: entered promiscuous mode [ 67.784065][ T1008] br0: port 2(eth1) entered blocking state [ 67.784288][ T1008] br0: port 2(eth1) entered disabled state [ 67.784484][ T1008] eth1: entered allmulticast mode [ 67.785402][ T1008] eth1: entered promiscuous mode [ 67.786466][ T37] br0: port 2(eth1) entered blocking state [ 67.786657][ T37] br0: port 2(eth1) entered forwarding state [ 68.344194][ T418] br0: port 1(eth0) entered blocking state [ 68.344446][ T418] br0: port 1(eth0) entered forwarding state [ 71.999097][ T11] eth1: left allmulticast mode [ 71.999278][ T11] eth1: left promiscuous mode [ 71.999574][ T11] br0: port 2(eth1) entered disabled state [ 72.001335][ T11] eth0: left allmulticast mode [ 72.001487][ T11] eth0: left promiscuous mode [ 72.001738][ T11] br0: port 1(eth0) entered disabled state [ 72.245300][ T11] eth1: left allmulticast mode [ 72.245530][ T11] eth1: left promiscuous mode [ 72.245836][ T11] br0: port 2(eth1) entered disabled state [ 72.247016][ T11] eth0: left allmulticast mode [ 72.247206][ T11] eth0: left promiscuous mode [ 72.247458][ T11] br0: port 1(eth0) entered disabled state [ 74.484662][ T1100] eth0: renamed from r1h1 [ 74.636530][ T1102] eth1: renamed from r1h2 [ 81.675809][ T1201] eth0: renamed from r1h1 [ 81.818624][ T1203] eth1: renamed from r1h2 [ 88.823660][ T1301] eth0: renamed from r1h1 [ 88.973638][ T1303] eth1: renamed from r1h2 [ 96.043048][ T1400] eth0: renamed from r1h1 [ 96.193612][ T1402] eth1: renamed from r1h2 [ 104.130891][ T1502] eth0: renamed from r1h1 [ 104.277973][ T1504] eth1: renamed from r1h2 [ 112.846427][ T1615] eth0: renamed from r1h1 [ 112.981189][ T1617] eth0: renamed from r2h1 [ 113.139646][ T1619] eth1: renamed from r1h2 [ 113.297540][ T1621] eth1: renamed from r2h2 [ 113.565966][ T1626] br0: port 1(eth0) entered blocking state [ 113.566183][ T1626] br0: port 1(eth0) entered disabled state [ 113.566366][ T1626] eth0: entered allmulticast mode [ 113.568242][ T1626] eth0: entered promiscuous mode [ 113.569773][ T418] br0: port 1(eth0) entered blocking state [ 113.569954][ T418] br0: port 1(eth0) entered forwarding state [ 113.627850][ T1627] br0: port 2(eth1) entered blocking state [ 113.628158][ T1627] br0: port 2(eth1) entered disabled state [ 113.628358][ T1627] eth1: entered allmulticast mode [ 113.629292][ T1627] eth1: entered promiscuous mode [ 113.630637][ T55] br0: port 2(eth1) entered blocking state [ 113.630830][ T55] br0: port 2(eth1) entered forwarding state [ 114.033244][ T1634] br0: port 1(eth0) entered blocking state [ 114.033557][ T1634] br0: port 1(eth0) entered disabled state [ 114.033783][ T1634] eth0: entered allmulticast mode [ 114.034733][ T1634] eth0: entered promiscuous mode [ 114.090420][ T1635] br0: port 2(eth1) entered blocking state [ 114.090728][ T1635] br0: port 2(eth1) entered disabled state [ 114.090916][ T1635] eth1: entered allmulticast mode [ 114.091819][ T1635] eth1: entered promiscuous mode [ 114.095955][ T418] br0: port 2(eth1) entered blocking state [ 114.096143][ T418] br0: port 2(eth1) entered forwarding state [ 114.807325][ T703] br0: port 1(eth0) entered blocking state [ 114.807602][ T703] br0: port 1(eth0) entered forwarding state [ 118.323974][ T11] eth1: left allmulticast mode [ 118.324184][ T11] eth1: left promiscuous mode [ 118.324450][ T11] br0: port 2(eth1) entered disabled state [ 118.337675][ T11] eth0: left allmulticast mode [ 118.337845][ T11] eth0: left promiscuous mode [ 118.338088][ T11] br0: port 1(eth0) entered disabled state [ 118.640657][ T11] eth1: left allmulticast mode [ 118.641513][ T11] eth1: left promiscuous mode [ 118.641908][ T11] br0: port 2(eth1) entered disabled state [ 118.644083][ T11] eth0: left allmulticast mode [ 118.644319][ T11] eth0: left promiscuous mode [ 118.644664][ T11] br0: port 1(eth0) entered disabled state [ 121.394848][ T1739] eth0: renamed from r1h1 [ 121.538651][ T1741] eth0: renamed from r2h1 [ 121.696853][ T1743] eth1: renamed from r1h2 [ 121.855365][ T1745] eth1: renamed from r2h2 [ 122.177793][ T1750] br0: port 1(eth0) entered blocking state [ 122.178087][ T1750] br0: port 1(eth0) entered disabled state [ 122.178304][ T1750] eth0: entered allmulticast mode [ 122.179504][ T1750] eth0: entered promiscuous mode [ 122.181344][ T55] br0: port 1(eth0) entered blocking state [ 122.181533][ T55] br0: port 1(eth0) entered forwarding state [ 122.243266][ T1751] br0: port 2(eth1) entered blocking state [ 122.243590][ T1751] br0: port 2(eth1) entered disabled state [ 122.243801][ T1751] eth1: entered allmulticast mode [ 122.244817][ T1751] eth1: entered promiscuous mode [ 122.246040][ T37] br0: port 2(eth1) entered blocking state [ 122.246251][ T37] br0: port 2(eth1) entered forwarding state [ 122.677397][ T1758] br0: port 1(eth0) entered blocking state [ 122.677641][ T1758] br0: port 1(eth0) entered disabled state [ 122.677847][ T1758] eth0: entered allmulticast mode [ 122.678832][ T1758] eth0: entered promiscuous mode [ 122.737793][ T1759] br0: port 2(eth1) entered blocking state [ 122.738091][ T1759] br0: port 2(eth1) entered disabled state [ 122.738282][ T1759] eth1: entered allmulticast mode [ 122.739591][ T1759] eth1: entered promiscuous mode [ 122.740784][ T37] br0: port 2(eth1) entered blocking state [ 122.740971][ T37] br0: port 2(eth1) entered forwarding state [ 123.383294][ T703] br0: port 1(eth0) entered blocking state [ 123.383515][ T703] br0: port 1(eth0) entered forwarding state [ 126.972348][ T11] eth1: left allmulticast mode [ 126.972569][ T11] eth1: left promiscuous mode [ 126.972849][ T11] br0: port 2(eth1) entered disabled state [ 126.974032][ T11] eth0: left allmulticast mode [ 126.974199][ T11] eth0: left promiscuous mode [ 126.974443][ T11] br0: port 1(eth0) entered disabled state [ 127.201343][ T11] eth1: left allmulticast mode [ 127.201559][ T11] eth1: left promiscuous mode [ 127.201842][ T11] br0: port 2(eth1) entered disabled state [ 127.203010][ T11] eth0: left allmulticast mode [ 127.203174][ T11] eth0: left promiscuous mode [ 127.203414][ T11] br0: port 1(eth0) entered disabled state