[ 10.288384][ T266] ip (266) used greatest stack depth: 23816 bytes left [ 11.624377][ T283] eth0: renamed from r1h1 [ 11.720525][ T284] ip (284) used greatest stack depth: 23680 bytes left [ 11.819500][ T285] eth1: renamed from r1h2 [ 17.551123][ T11] [ 17.551233][ T11] ============================================ [ 17.551403][ T11] WARNING: possible recursive locking detected [ 17.551576][ T11] 6.13.0-rc5-virtme #1 Not tainted [ 17.551712][ T11] -------------------------------------------- [ 17.551891][ T11] kworker/u16:0/11 is trying to acquire lock: [ 17.552060][ T11] ffffffff981f6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 17.552342][ T11] [ 17.552342][ T11] but task is already holding lock: [ 17.552542][ T11] ffffffff981f6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 17.552817][ T11] [ 17.552817][ T11] other info that might help us debug this: [ 17.553019][ T11] Possible unsafe locking scenario: [ 17.553019][ T11] [ 17.553220][ T11] CPU0 [ 17.553321][ T11] ---- [ 17.553422][ T11] lock((netdev_chain).rwsem); [ 17.553563][ T11] lock((netdev_chain).rwsem); [ 17.553701][ T11] [ 17.553701][ T11] *** DEADLOCK *** [ 17.553701][ T11] [ 17.553909][ T11] May be due to missing lock nesting notation [ 17.553909][ T11] [ 17.554112][ T11] 5 locks held by kworker/u16:0/11: [ 17.554251][ T11] #0: ffff8880010b5948 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0x7ec/0x16d0 [ 17.554533][ T11] #1: ffffc900000b7da0 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xe0b/0x16d0 [ 17.554786][ T11] #2: ffffffff981ec4d0 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xbc/0xba0 [ 17.555032][ T11] #3: ffffffff98207e88 (rtnl_mutex){+.+.}-{4:4}, at: default_device_exit_batch+0x81/0x2e0 [ 17.555315][ T11] #4: ffffffff981f6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 17.555598][ T11] [ 17.555598][ T11] stack backtrace: [ 17.555768][ T11] CPU: 3 UID: 0 PID: 11 Comm: kworker/u16:0 Not tainted 6.13.0-rc5-virtme #1 [ 17.556013][ T11] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 17.556190][ T11] Workqueue: netns cleanup_net [ 17.556335][ T11] Call Trace: [ 17.556442][ T11] [ 17.556517][ T11] dump_stack_lvl+0x82/0xd0 [ 17.556665][ T11] print_deadlock_bug+0x40a/0x650 [ 17.556807][ T11] validate_chain+0x5bf/0xae0 [ 17.556948][ T11] ? __pfx_validate_chain+0x10/0x10 [ 17.557092][ T11] ? hlock_class+0x4e/0x130 [ 17.557233][ T11] ? mark_lock+0x38/0x3e0 [ 17.557338][ T11] __lock_acquire+0xb9a/0x1680 [ 17.557479][ T11] lock_acquire.part.0+0xeb/0x330 [ 17.557618][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 17.557796][ T11] ? __lock_acquire+0xb9a/0x1680 [ 17.557935][ T11] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 17.558072][ T11] ? trace_lock_acquire+0x14c/0x1f0 [ 17.558215][ T11] ? lock_acquire+0x32/0xc0 [ 17.558353][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 17.558522][ T11] down_read+0x9f/0x340 [ 17.558629][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 17.558803][ T11] ? __pfx_down_read+0x10/0x10 [ 17.558948][ T11] ? __lock_release+0x103/0x460 [ 17.559094][ T11] blocking_notifier_call_chain+0x50/0x90 [ 17.559235][ T11] __netdev_upper_dev_unlink+0xd9/0x220 [ 17.559373][ T11] ? mark_held_locks+0x9e/0xe0 [ 17.559508][ T11] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 17.559678][ T11] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 17.559852][ T11] ? __try_to_del_timer_sync+0xe7/0x140 [ 17.559994][ T11] ? __pfx___try_to_del_timer_sync+0x10/0x10 [ 17.560164][ T11] ? mark_held_locks+0x9e/0xe0 [ 17.560302][ T11] netdev_upper_dev_unlink+0x71/0xa0 [ 17.560443][ T11] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 17.560612][ T11] ? mutex_is_locked+0x1c/0x60 [ 17.560750][ T11] ? rtnl_is_locked+0x15/0x20 [ 17.560888][ T11] ? netdev_master_upper_dev_get+0x13/0x120 [ 17.561060][ T11] vrf_device_event+0x78/0xe0 [ 17.561198][ T11] notifier_call_chain+0xcd/0x150 [ 17.561338][ T11] blocking_notifier_call_chain+0x66/0x90 [ 17.561477][ T11] unregister_netdevice_many_notify+0xa83/0x1580 [ 17.561650][ T11] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 17.561822][ T11] ? default_device_exit_batch+0x81/0x2e0 [ 17.561964][ T11] ? rtnl_is_locked+0x15/0x20 [ 17.562101][ T11] ? unregister_netdevice_queue+0x70/0x410 [ 17.562271][ T11] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 17.562441][ T11] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 17.562614][ T11] default_device_exit_batch+0x241/0x2e0 [ 17.562752][ T11] ? __pfx_default_device_exit_batch+0x10/0x10 [ 17.562921][ T11] ? ops_exit_list+0xb4/0x170 [ 17.563066][ T11] cleanup_net+0x4ef/0xba0 [ 17.563206][ T11] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 17.563343][ T11] ? __pfx_cleanup_net+0x10/0x10 [ 17.563480][ T11] ? trace_lock_acquire+0x14c/0x1f0 [ 17.563619][ T11] ? lock_acquire+0x32/0xc0 [ 17.563759][ T11] ? process_one_work+0xe0b/0x16d0 [ 17.563902][ T11] process_one_work+0xe55/0x16d0 [ 17.564044][ T11] ? __pfx___lock_release+0x10/0x10 [ 17.564183][ T11] ? __pfx_process_one_work+0x10/0x10 [ 17.564322][ T11] ? assign_work+0x16c/0x240 [ 17.564459][ T11] worker_thread+0x58c/0xce0 [ 17.564598][ T11] ? __pfx_worker_thread+0x10/0x10 [ 17.564734][ T11] kthread+0x28a/0x350 [ 17.564839][ T11] ? __pfx_kthread+0x10/0x10 [ 17.564976][ T11] ret_from_fork+0x31/0x70 [ 17.565120][ T11] ? __pfx_kthread+0x10/0x10 [ 17.565259][ T11] ret_from_fork_asm+0x1a/0x30 [ 17.565402][ T11] [ 19.770487][ T379] eth0: renamed from r1h1 [ 19.927122][ T381] eth1: renamed from r1h2 [ 26.761813][ T474] eth0: renamed from r1h1 [ 26.908915][ T476] eth1: renamed from r1h2 [ 33.536362][ T569] eth0: renamed from r1h1 [ 33.674555][ T571] eth1: renamed from r1h2 [ 40.233702][ T662] eth0: renamed from r1h1 [ 40.367629][ T664] eth1: renamed from r1h2 [ 47.858575][ T760] eth0: renamed from r1h1 [ 47.992691][ T762] eth1: renamed from r1h2 [ 55.784396][ T864] eth0: renamed from r1h1 [ 55.928523][ T866] eth0: renamed from r2h1 [ 56.069605][ T868] eth1: renamed from r1h2 [ 56.206752][ T870] eth1: renamed from r2h2 [ 56.488677][ T875] br0: port 1(eth0) entered blocking state [ 56.488908][ T875] br0: port 1(eth0) entered disabled state [ 56.489110][ T875] eth0: entered allmulticast mode [ 56.490018][ T875] eth0: entered promiscuous mode [ 56.491593][ T37] br0: port 1(eth0) entered blocking state [ 56.491801][ T37] br0: port 1(eth0) entered forwarding state [ 56.552640][ T876] br0: port 2(eth1) entered blocking state [ 56.552867][ T876] br0: port 2(eth1) entered disabled state [ 56.553067][ T876] eth1: entered allmulticast mode [ 56.554041][ T876] eth1: entered promiscuous mode [ 56.555042][ T37] br0: port 2(eth1) entered blocking state [ 56.555241][ T37] br0: port 2(eth1) entered forwarding state [ 56.933028][ T883] br0: port 1(eth0) entered blocking state [ 56.933319][ T883] br0: port 1(eth0) entered disabled state [ 56.933565][ T883] eth0: entered allmulticast mode [ 56.934514][ T883] eth0: entered promiscuous mode [ 56.991539][ T884] br0: port 2(eth1) entered blocking state [ 56.991754][ T884] br0: port 2(eth1) entered disabled state [ 56.991967][ T884] eth1: entered allmulticast mode [ 56.992871][ T884] eth1: entered promiscuous mode [ 56.993885][ T37] br0: port 2(eth1) entered blocking state [ 56.994085][ T37] br0: port 2(eth1) entered forwarding state [ 57.789178][ T40] br0: port 1(eth0) entered blocking state [ 57.789392][ T40] br0: port 1(eth0) entered forwarding state [ 61.067798][ T11] eth1: left allmulticast mode [ 61.067974][ T11] eth1: left promiscuous mode [ 61.068266][ T11] br0: port 2(eth1) entered disabled state [ 61.069706][ T11] eth0: left allmulticast mode [ 61.070061][ T11] eth0: left promiscuous mode [ 61.070308][ T11] br0: port 1(eth0) entered disabled state [ 61.291219][ T11] eth1: left allmulticast mode [ 61.291455][ T11] eth1: left promiscuous mode [ 61.291740][ T11] br0: port 2(eth1) entered disabled state [ 61.292884][ T11] eth0: left allmulticast mode [ 61.293093][ T11] eth0: left promiscuous mode [ 61.293381][ T11] br0: port 1(eth0) entered disabled state [ 64.275056][ T988] eth0: renamed from r1h1 [ 64.400559][ T990] eth0: renamed from r2h1 [ 64.538709][ T992] eth1: renamed from r1h2 [ 64.674707][ T994] eth1: renamed from r2h2 [ 64.956522][ T999] br0: port 1(eth0) entered blocking state [ 64.956736][ T999] br0: port 1(eth0) entered disabled state [ 64.956973][ T999] eth0: entered allmulticast mode [ 64.963087][ T999] eth0: entered promiscuous mode [ 64.964568][ T37] br0: port 1(eth0) entered blocking state [ 64.964775][ T37] br0: port 1(eth0) entered forwarding state [ 65.038498][ T1000] br0: port 2(eth1) entered blocking state [ 65.038797][ T1000] br0: port 2(eth1) entered disabled state [ 65.039003][ T1000] eth1: entered allmulticast mode [ 65.040361][ T1000] eth1: entered promiscuous mode [ 65.041375][ T713] br0: port 2(eth1) entered blocking state [ 65.041563][ T713] br0: port 2(eth1) entered forwarding state [ 65.425292][ T1007] br0: port 1(eth0) entered blocking state [ 65.425509][ T1007] br0: port 1(eth0) entered disabled state [ 65.425711][ T1007] eth0: entered allmulticast mode [ 65.426714][ T1007] eth0: entered promiscuous mode [ 65.478901][ T1008] br0: port 2(eth1) entered blocking state [ 65.479113][ T1008] br0: port 2(eth1) entered disabled state [ 65.479312][ T1008] eth1: entered allmulticast mode [ 65.480201][ T1008] eth1: entered promiscuous mode [ 65.481201][ T37] br0: port 2(eth1) entered blocking state [ 65.481406][ T37] br0: port 2(eth1) entered forwarding state [ 66.236192][ T713] br0: port 1(eth0) entered blocking state [ 66.236406][ T713] br0: port 1(eth0) entered forwarding state [ 69.552759][ T11] eth1: left allmulticast mode [ 69.553010][ T11] eth1: left promiscuous mode [ 69.553316][ T11] br0: port 2(eth1) entered disabled state [ 69.554493][ T11] eth0: left allmulticast mode [ 69.554708][ T11] eth0: left promiscuous mode [ 69.555024][ T11] br0: port 1(eth0) entered disabled state [ 69.771816][ T11] eth1: left allmulticast mode [ 69.772052][ T11] eth1: left promiscuous mode [ 69.772336][ T11] br0: port 2(eth1) entered disabled state [ 69.773488][ T11] eth0: left allmulticast mode [ 69.773709][ T11] eth0: left promiscuous mode [ 69.774023][ T11] br0: port 1(eth0) entered disabled state [ 71.947828][ T1100] eth0: renamed from r1h1 [ 72.083701][ T1102] eth1: renamed from r1h2 [ 79.007114][ T1201] eth0: renamed from r1h1 [ 79.174191][ T1203] eth1: renamed from r1h2 [ 86.195893][ T1301] eth0: renamed from r1h1 [ 86.329620][ T1303] eth1: renamed from r1h2 [ 93.376617][ T1399] eth0: renamed from r1h1 [ 93.508693][ T1401] eth1: renamed from r1h2 [ 101.291937][ T1501] eth0: renamed from r1h1 [ 101.432803][ T1503] eth1: renamed from r1h2 [ 109.564112][ T1614] eth0: renamed from r1h1 [ 109.701434][ T1616] eth0: renamed from r2h1 [ 109.857464][ T1618] eth1: renamed from r1h2 [ 110.004623][ T1620] eth1: renamed from r2h2 [ 110.271846][ T1625] br0: port 1(eth0) entered blocking state [ 110.272052][ T1625] br0: port 1(eth0) entered disabled state [ 110.272230][ T1625] eth0: entered allmulticast mode [ 110.274033][ T1625] eth0: entered promiscuous mode [ 110.275526][ T40] br0: port 1(eth0) entered blocking state [ 110.275706][ T40] br0: port 1(eth0) entered forwarding state [ 110.326301][ T1626] br0: port 2(eth1) entered blocking state [ 110.326495][ T1626] br0: port 2(eth1) entered disabled state [ 110.326672][ T1626] eth1: entered allmulticast mode [ 110.327546][ T1626] eth1: entered promiscuous mode [ 110.328865][ T40] br0: port 2(eth1) entered blocking state [ 110.329067][ T40] br0: port 2(eth1) entered forwarding state [ 110.705949][ T1633] br0: port 1(eth0) entered blocking state [ 110.706252][ T1633] br0: port 1(eth0) entered disabled state [ 110.706453][ T1633] eth0: entered allmulticast mode [ 110.707369][ T1633] eth0: entered promiscuous mode [ 110.764149][ T1634] br0: port 2(eth1) entered blocking state [ 110.764345][ T1634] br0: port 2(eth1) entered disabled state [ 110.764525][ T1634] eth1: entered allmulticast mode [ 110.765395][ T1634] eth1: entered promiscuous mode [ 110.766417][ T40] br0: port 2(eth1) entered blocking state [ 110.766600][ T40] br0: port 2(eth1) entered forwarding state [ 111.548228][ T37] br0: port 1(eth0) entered blocking state [ 111.548431][ T37] br0: port 1(eth0) entered forwarding state [ 114.783213][ T11] eth1: left allmulticast mode [ 114.783380][ T11] eth1: left promiscuous mode [ 114.783651][ T11] br0: port 2(eth1) entered disabled state [ 114.784757][ T11] eth0: left allmulticast mode [ 114.784927][ T11] eth0: left promiscuous mode [ 114.785155][ T11] br0: port 1(eth0) entered disabled state [ 115.027010][ T11] eth1: left allmulticast mode [ 115.027210][ T11] eth1: left promiscuous mode [ 115.027456][ T11] br0: port 2(eth1) entered disabled state [ 115.028533][ T11] eth0: left allmulticast mode [ 115.028698][ T11] eth0: left promiscuous mode [ 115.028979][ T11] br0: port 1(eth0) entered disabled state [ 117.651645][ T1738] eth0: renamed from r1h1 [ 117.785746][ T1740] eth0: renamed from r2h1 [ 117.917662][ T1742] eth1: renamed from r1h2 [ 118.060698][ T1744] eth1: renamed from r2h2 [ 118.330544][ T1749] br0: port 1(eth0) entered blocking state [ 118.330823][ T1749] br0: port 1(eth0) entered disabled state [ 118.331006][ T1749] eth0: entered allmulticast mode [ 118.331880][ T1749] eth0: entered promiscuous mode [ 118.334447][ T40] br0: port 1(eth0) entered blocking state [ 118.334635][ T40] br0: port 1(eth0) entered forwarding state [ 118.389016][ T1750] br0: port 2(eth1) entered blocking state [ 118.389276][ T1750] br0: port 2(eth1) entered disabled state [ 118.389456][ T1750] eth1: entered allmulticast mode [ 118.390348][ T1750] eth1: entered promiscuous mode [ 118.391600][ T40] br0: port 2(eth1) entered blocking state [ 118.391798][ T40] br0: port 2(eth1) entered forwarding state [ 118.764116][ T1757] br0: port 1(eth0) entered blocking state [ 118.764323][ T1757] br0: port 1(eth0) entered disabled state [ 118.764501][ T1757] eth0: entered allmulticast mode [ 118.766237][ T1757] eth0: entered promiscuous mode [ 118.821870][ T1758] br0: port 2(eth1) entered blocking state [ 118.822163][ T1758] br0: port 2(eth1) entered disabled state [ 118.822355][ T1758] eth1: entered allmulticast mode [ 118.823260][ T1758] eth1: entered promiscuous mode [ 118.824334][ T58] br0: port 2(eth1) entered blocking state [ 118.824519][ T58] br0: port 2(eth1) entered forwarding state [ 119.612192][ T713] br0: port 1(eth0) entered blocking state [ 119.612461][ T713] br0: port 1(eth0) entered forwarding state [ 122.871951][ T11] eth1: left allmulticast mode [ 122.872116][ T11] eth1: left promiscuous mode [ 122.872390][ T11] br0: port 2(eth1) entered disabled state [ 122.873572][ T11] eth0: left allmulticast mode [ 122.873712][ T11] eth0: left promiscuous mode [ 122.874168][ T11] br0: port 1(eth0) entered disabled state [ 123.112261][ T11] eth1: left allmulticast mode [ 123.112429][ T11] eth1: left promiscuous mode [ 123.112664][ T11] br0: port 2(eth1) entered disabled state [ 123.113706][ T11] eth0: left allmulticast mode [ 123.113882][ T11] eth0: left promiscuous mode [ 123.114111][ T11] br0: port 1(eth0) entered disabled state