[ 11.626070][ T282] eth0: renamed from r1h1 [ 11.832766][ T284] eth1: renamed from r1h2 [ 17.502523][ T66] [ 17.502652][ T66] ============================================ [ 17.502852][ T66] WARNING: possible recursive locking detected [ 17.503048][ T66] 6.13.0-rc5-virtme #1 Not tainted [ 17.503200][ T66] -------------------------------------------- [ 17.503390][ T66] kworker/u16:1/66 is trying to acquire lock: [ 17.503577][ T66] ffffffffb99f6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 17.503892][ T66] [ 17.503892][ T66] but task is already holding lock: [ 17.504121][ T66] ffffffffb99f6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 17.504431][ T66] [ 17.504431][ T66] other info that might help us debug this: [ 17.504663][ T66] Possible unsafe locking scenario: [ 17.504663][ T66] [ 17.504887][ T66] CPU0 [ 17.504996][ T66] ---- [ 17.505113][ T66] lock((netdev_chain).rwsem); [ 17.505291][ T66] lock((netdev_chain).rwsem); [ 17.505446][ T66] [ 17.505446][ T66] *** DEADLOCK *** [ 17.505446][ T66] [ 17.505671][ T66] May be due to missing lock nesting notation [ 17.505671][ T66] [ 17.505896][ T66] 5 locks held by kworker/u16:1/66: [ 17.506052][ T66] #0: ffff8880010b5948 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0x7ec/0x16d0 [ 17.506365][ T66] #1: ffffc90000477da0 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xe0b/0x16d0 [ 17.506644][ T66] #2: ffffffffb99ec4d0 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xbc/0xba0 [ 17.506914][ T66] #3: ffffffffb9a07e88 (rtnl_mutex){+.+.}-{4:4}, at: default_device_exit_batch+0x81/0x2e0 [ 17.507225][ T66] #4: ffffffffb99f6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 17.507542][ T66] [ 17.507542][ T66] stack backtrace: [ 17.507733][ T66] CPU: 0 UID: 0 PID: 66 Comm: kworker/u16:1 Not tainted 6.13.0-rc5-virtme #1 [ 17.508003][ T66] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 17.508195][ T66] Workqueue: netns cleanup_net [ 17.508364][ T66] Call Trace: [ 17.508483][ T66] [ 17.508564][ T66] dump_stack_lvl+0x82/0xd0 [ 17.508720][ T66] print_deadlock_bug+0x40a/0x650 [ 17.508873][ T66] validate_chain+0x5bf/0xae0 [ 17.509032][ T66] ? __pfx_validate_chain+0x10/0x10 [ 17.509189][ T66] ? hlock_class+0x4e/0x130 [ 17.509339][ T66] ? mark_lock+0x38/0x3e0 [ 17.509457][ T66] __lock_acquire+0xb9a/0x1680 [ 17.509623][ T66] lock_acquire.part.0+0xeb/0x330 [ 17.509779][ T66] ? blocking_notifier_call_chain+0x50/0x90 [ 17.509967][ T66] ? __lock_acquire+0xb9a/0x1680 [ 17.510120][ T66] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 17.510273][ T66] ? trace_lock_acquire+0x14c/0x1f0 [ 17.510429][ T66] ? lock_acquire+0x32/0xc0 [ 17.510584][ T66] ? blocking_notifier_call_chain+0x50/0x90 [ 17.510777][ T66] down_read+0x9f/0x340 [ 17.510897][ T66] ? blocking_notifier_call_chain+0x50/0x90 [ 17.511089][ T66] ? __pfx_down_read+0x10/0x10 [ 17.511243][ T66] ? __lock_release+0x103/0x460 [ 17.511392][ T66] blocking_notifier_call_chain+0x50/0x90 [ 17.511549][ T66] __netdev_upper_dev_unlink+0xd9/0x220 [ 17.511703][ T66] ? mark_held_locks+0x9e/0xe0 [ 17.511862][ T66] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 17.512076][ T66] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 17.512267][ T66] ? __try_to_del_timer_sync+0xe7/0x140 [ 17.512423][ T66] ? __pfx___try_to_del_timer_sync+0x10/0x10 [ 17.512613][ T66] ? mark_held_locks+0x9e/0xe0 [ 17.512768][ T66] netdev_upper_dev_unlink+0x71/0xa0 [ 17.512920][ T66] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 17.513112][ T66] ? mutex_is_locked+0x1c/0x60 [ 17.513267][ T66] ? rtnl_is_locked+0x15/0x20 [ 17.513424][ T66] ? netdev_master_upper_dev_get+0x13/0x120 [ 17.513614][ T66] vrf_device_event+0x78/0xe0 [ 17.513771][ T66] notifier_call_chain+0xcd/0x150 [ 17.513927][ T66] blocking_notifier_call_chain+0x66/0x90 [ 17.514087][ T66] unregister_netdevice_many_notify+0xa83/0x1580 [ 17.514281][ T66] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 17.514472][ T66] ? default_device_exit_batch+0x81/0x2e0 [ 17.514629][ T66] ? rtnl_is_locked+0x15/0x20 [ 17.514781][ T66] ? unregister_netdevice_queue+0x70/0x410 [ 17.514973][ T66] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 17.515163][ T66] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 17.515365][ T66] default_device_exit_batch+0x241/0x2e0 [ 17.515523][ T66] ? __pfx_default_device_exit_batch+0x10/0x10 [ 17.515712][ T66] ? ops_exit_list+0xb4/0x170 [ 17.515869][ T66] cleanup_net+0x4ef/0xba0 [ 17.516027][ T66] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 17.516186][ T66] ? __pfx_cleanup_net+0x10/0x10 [ 17.516339][ T66] ? trace_lock_acquire+0x14c/0x1f0 [ 17.516494][ T66] ? lock_acquire+0x32/0xc0 [ 17.516646][ T66] ? process_one_work+0xe0b/0x16d0 [ 17.516799][ T66] process_one_work+0xe55/0x16d0 [ 17.516956][ T66] ? __pfx___lock_release+0x10/0x10 [ 17.517189][ T66] ? __pfx_process_one_work+0x10/0x10 [ 17.517344][ T66] ? assign_work+0x16c/0x240 [ 17.517503][ T66] worker_thread+0x58c/0xce0 [ 17.517656][ T66] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 17.517850][ T66] ? __pfx_worker_thread+0x10/0x10 [ 17.518081][ T66] ? __pfx_worker_thread+0x10/0x10 [ 17.518229][ T66] kthread+0x28a/0x350 [ 17.518346][ T66] ? __pfx_kthread+0x10/0x10 [ 17.518498][ T66] ret_from_fork+0x31/0x70 [ 17.518653][ T66] ? __pfx_kthread+0x10/0x10 [ 17.518807][ T66] ret_from_fork_asm+0x1a/0x30 [ 17.518965][ T66] [ 19.564082][ T378] eth0: renamed from r1h1 [ 19.699875][ T380] eth1: renamed from r1h2 [ 26.246079][ T473] eth0: renamed from r1h1 [ 26.380060][ T475] eth1: renamed from r1h2 [ 32.938005][ T569] eth0: renamed from r1h1 [ 33.075224][ T571] eth1: renamed from r1h2 [ 39.582950][ T663] eth0: renamed from r1h1 [ 39.709889][ T665] eth1: renamed from r1h2 [ 47.102943][ T760] eth0: renamed from r1h1 [ 47.241864][ T762] eth1: renamed from r1h2 [ 55.135852][ T864] eth0: renamed from r1h1 [ 55.279109][ T866] eth0: renamed from r2h1 [ 55.407260][ T868] eth1: renamed from r1h2 [ 55.555089][ T870] eth1: renamed from r2h2 [ 55.835270][ T875] br0: port 1(eth0) entered blocking state [ 55.835536][ T875] br0: port 1(eth0) entered disabled state [ 55.835719][ T875] eth0: entered allmulticast mode [ 55.836610][ T875] eth0: entered promiscuous mode [ 55.838169][ T44] br0: port 1(eth0) entered blocking state [ 55.838379][ T44] br0: port 1(eth0) entered forwarding state [ 55.886766][ T876] br0: port 2(eth1) entered blocking state [ 55.886951][ T876] br0: port 2(eth1) entered disabled state [ 55.887765][ T876] eth1: entered allmulticast mode [ 55.888885][ T876] eth1: entered promiscuous mode [ 55.890015][ T158] br0: port 2(eth1) entered blocking state [ 55.890201][ T158] br0: port 2(eth1) entered forwarding state [ 56.267359][ T883] br0: port 1(eth0) entered blocking state [ 56.267660][ T883] br0: port 1(eth0) entered disabled state [ 56.267840][ T883] eth0: entered allmulticast mode [ 56.268724][ T883] eth0: entered promiscuous mode [ 56.320237][ T884] br0: port 2(eth1) entered blocking state [ 56.320518][ T884] br0: port 2(eth1) entered disabled state [ 56.320703][ T884] eth1: entered allmulticast mode [ 56.321614][ T884] eth1: entered promiscuous mode [ 56.322791][ T44] br0: port 2(eth1) entered blocking state [ 56.322981][ T44] br0: port 2(eth1) entered forwarding state [ 57.115526][ T158] br0: port 1(eth0) entered blocking state [ 57.115728][ T158] br0: port 1(eth0) entered forwarding state [ 60.419340][ T66] eth1: left allmulticast mode [ 60.419543][ T66] eth1: left promiscuous mode [ 60.419799][ T66] br0: port 2(eth1) entered disabled state [ 60.420823][ T66] eth0: left allmulticast mode [ 60.420984][ T66] eth0: left promiscuous mode [ 60.421258][ T66] br0: port 1(eth0) entered disabled state [ 60.713949][ T66] eth1: left allmulticast mode [ 60.714150][ T66] eth1: left promiscuous mode [ 60.714388][ T66] br0: port 2(eth1) entered disabled state [ 60.715469][ T66] eth0: left allmulticast mode [ 60.715640][ T66] eth0: left promiscuous mode [ 60.715868][ T66] br0: port 1(eth0) entered disabled state [ 63.422272][ T989] eth0: renamed from r1h1 [ 63.587317][ T991] eth0: renamed from r2h1 [ 63.743478][ T993] eth1: renamed from r1h2 [ 63.939527][ T995] eth1: renamed from r2h2 [ 64.247546][ T1000] br0: port 1(eth0) entered blocking state [ 64.247749][ T1000] br0: port 1(eth0) entered disabled state [ 64.247927][ T1000] eth0: entered allmulticast mode [ 64.248828][ T1000] eth0: entered promiscuous mode [ 64.250294][ T44] br0: port 1(eth0) entered blocking state [ 64.250482][ T44] br0: port 1(eth0) entered forwarding state [ 64.305198][ T1001] br0: port 2(eth1) entered blocking state [ 64.305422][ T1001] br0: port 2(eth1) entered disabled state [ 64.305621][ T1001] eth1: entered allmulticast mode [ 64.306527][ T1001] eth1: entered promiscuous mode [ 64.307855][ T281] br0: port 2(eth1) entered blocking state [ 64.308070][ T281] br0: port 2(eth1) entered forwarding state [ 64.695228][ T1008] br0: port 1(eth0) entered blocking state [ 64.695503][ T1008] br0: port 1(eth0) entered disabled state [ 64.695686][ T1008] eth0: entered allmulticast mode [ 64.696593][ T1008] eth0: entered promiscuous mode [ 64.742336][ T1009] br0: port 2(eth1) entered blocking state [ 64.742566][ T1009] br0: port 2(eth1) entered disabled state [ 64.742762][ T1009] eth1: entered allmulticast mode [ 64.743668][ T1009] eth1: entered promiscuous mode [ 64.746558][ T281] br0: port 2(eth1) entered blocking state [ 64.746749][ T281] br0: port 2(eth1) entered forwarding state [ 65.371456][ T44] br0: port 1(eth0) entered blocking state [ 65.371668][ T44] br0: port 1(eth0) entered forwarding state [ 68.796941][ T66] eth1: left allmulticast mode [ 68.797121][ T66] eth1: left promiscuous mode [ 68.797359][ T66] br0: port 2(eth1) entered disabled state [ 68.798374][ T66] eth0: left allmulticast mode [ 68.798514][ T66] eth0: left promiscuous mode [ 68.798740][ T66] br0: port 1(eth0) entered disabled state [ 69.064429][ T66] eth1: left allmulticast mode [ 69.064587][ T66] eth1: left promiscuous mode [ 69.064820][ T66] br0: port 2(eth1) entered disabled state [ 69.065807][ T66] eth0: left allmulticast mode [ 69.065945][ T66] eth0: left promiscuous mode [ 69.066196][ T66] br0: port 1(eth0) entered disabled state [ 71.234970][ T1101] eth0: renamed from r1h1 [ 71.390743][ T1103] eth1: renamed from r1h2 [ 78.129635][ T1202] eth0: renamed from r1h1 [ 78.269687][ T1204] eth1: renamed from r1h2 [ 84.984058][ T1302] eth0: renamed from r1h1 [ 85.111086][ T1304] eth1: renamed from r1h2 [ 91.857390][ T1400] eth0: renamed from r1h1 [ 91.996795][ T1402] eth1: renamed from r1h2 [ 99.618174][ T1502] eth0: renamed from r1h1 [ 99.754078][ T1504] eth1: renamed from r1h2 [ 107.927302][ T1615] eth0: renamed from r1h1 [ 108.070457][ T1617] eth0: renamed from r2h1 [ 108.205319][ T1619] eth1: renamed from r1h2 [ 108.343032][ T1621] eth1: renamed from r2h2 [ 108.610708][ T1626] br0: port 1(eth0) entered blocking state [ 108.610906][ T1626] br0: port 1(eth0) entered disabled state [ 108.611099][ T1626] eth0: entered allmulticast mode [ 108.611982][ T1626] eth0: entered promiscuous mode [ 108.613551][ T158] br0: port 1(eth0) entered blocking state [ 108.613731][ T158] br0: port 1(eth0) entered forwarding state [ 108.670222][ T1627] br0: port 2(eth1) entered blocking state [ 108.670484][ T1627] br0: port 2(eth1) entered disabled state [ 108.670665][ T1627] eth1: entered allmulticast mode [ 108.671538][ T1627] eth1: entered promiscuous mode [ 108.672561][ T158] br0: port 2(eth1) entered blocking state [ 108.672740][ T158] br0: port 2(eth1) entered forwarding state [ 109.055273][ T1634] br0: port 1(eth0) entered blocking state [ 109.055574][ T1634] br0: port 1(eth0) entered disabled state [ 109.055768][ T1634] eth0: entered allmulticast mode [ 109.056674][ T1634] eth0: entered promiscuous mode [ 109.117291][ T1635] br0: port 2(eth1) entered blocking state [ 109.117548][ T1635] br0: port 2(eth1) entered disabled state [ 109.117722][ T1635] eth1: entered allmulticast mode [ 109.118581][ T1635] eth1: entered promiscuous mode [ 109.119604][ T158] br0: port 2(eth1) entered blocking state [ 109.119782][ T158] br0: port 2(eth1) entered forwarding state [ 109.914446][ T55] br0: port 1(eth0) entered blocking state [ 109.914726][ T55] br0: port 1(eth0) entered forwarding state [ 113.131717][ T66] eth1: left allmulticast mode [ 113.131887][ T66] eth1: left promiscuous mode [ 113.132143][ T66] br0: port 2(eth1) entered disabled state [ 113.133176][ T66] eth0: left allmulticast mode [ 113.133316][ T66] eth0: left promiscuous mode [ 113.133538][ T66] br0: port 1(eth0) entered disabled state [ 113.384530][ T66] eth1: left allmulticast mode [ 113.384732][ T66] eth1: left promiscuous mode [ 113.384971][ T66] br0: port 2(eth1) entered disabled state [ 113.391498][ T66] eth0: left allmulticast mode [ 113.391647][ T66] eth0: left promiscuous mode [ 113.391890][ T66] br0: port 1(eth0) entered disabled state [ 116.008286][ T1739] eth0: renamed from r1h1 [ 116.141215][ T1741] eth0: renamed from r2h1 [ 116.269872][ T1743] eth1: renamed from r1h2 [ 116.400548][ T1745] eth1: renamed from r2h2 [ 116.670427][ T1750] br0: port 1(eth0) entered blocking state [ 116.670626][ T1750] br0: port 1(eth0) entered disabled state [ 116.670806][ T1750] eth0: entered allmulticast mode [ 116.671692][ T1750] eth0: entered promiscuous mode [ 116.673168][ T44] br0: port 1(eth0) entered blocking state [ 116.673346][ T44] br0: port 1(eth0) entered forwarding state [ 116.727584][ T1751] br0: port 2(eth1) entered blocking state [ 116.727842][ T1751] br0: port 2(eth1) entered disabled state [ 116.728020][ T1751] eth1: entered allmulticast mode [ 116.729464][ T1751] eth1: entered promiscuous mode [ 116.730622][ T158] br0: port 2(eth1) entered blocking state [ 116.730802][ T158] br0: port 2(eth1) entered forwarding state [ 117.112035][ T1758] br0: port 1(eth0) entered blocking state [ 117.112291][ T1758] br0: port 1(eth0) entered disabled state [ 117.112488][ T1758] eth0: entered allmulticast mode [ 117.113379][ T1758] eth0: entered promiscuous mode [ 117.173352][ T1759] br0: port 2(eth1) entered blocking state [ 117.173612][ T1759] br0: port 2(eth1) entered disabled state [ 117.173791][ T1759] eth1: entered allmulticast mode [ 117.175464][ T1759] eth1: entered promiscuous mode [ 117.176582][ T44] br0: port 2(eth1) entered blocking state [ 117.176766][ T44] br0: port 2(eth1) entered forwarding state [ 117.978990][ T158] br0: port 1(eth0) entered blocking state [ 117.979236][ T158] br0: port 1(eth0) entered forwarding state [ 121.202333][ T66] eth1: left allmulticast mode [ 121.202502][ T66] eth1: left promiscuous mode [ 121.202743][ T66] br0: port 2(eth1) entered disabled state [ 121.203741][ T66] eth0: left allmulticast mode [ 121.203889][ T66] eth0: left promiscuous mode [ 121.204160][ T66] br0: port 1(eth0) entered disabled state [ 121.420744][ T66] eth1: left allmulticast mode [ 121.420910][ T66] eth1: left promiscuous mode [ 121.421181][ T66] br0: port 2(eth1) entered disabled state [ 121.422252][ T66] eth0: left allmulticast mode [ 121.422393][ T66] eth0: left promiscuous mode [ 121.422621][ T66] br0: port 1(eth0) entered disabled state