[ 13.724924][ T301] eth0: renamed from r1h1 [ 13.927914][ T303] eth0: renamed from r2h1 [ 14.188866][ T306] eth2: renamed from r2h2 [ 14.463083][ T309] eth1: renamed from r2r1 [ 14.887458][ T314] br0: port 1(eth0) entered blocking state [ 14.887906][ T314] br0: port 1(eth0) entered disabled state [ 14.888158][ T314] eth0: entered allmulticast mode [ 14.889359][ T314] eth0: entered promiscuous mode [ 14.892410][ T37] br0: port 1(eth0) entered blocking state [ 14.892787][ T37] br0: port 1(eth0) entered forwarding state [ 14.974771][ T315] br0: port 2(eth1) entered blocking state [ 14.975088][ T315] br0: port 2(eth1) entered disabled state [ 14.975318][ T315] eth1: entered allmulticast mode [ 14.976995][ T315] eth1: entered promiscuous mode [ 14.978958][ T71] br0: port 2(eth1) entered blocking state [ 14.979169][ T71] br0: port 2(eth1) entered forwarding state [ 31.589407][ T11] eth1: left allmulticast mode [ 31.590028][ T11] eth1: left promiscuous mode [ 31.590365][ T11] br0: port 2(eth1) entered disabled state [ 31.593651][ T11] eth0: left allmulticast mode [ 31.593830][ T11] eth0: left promiscuous mode [ 31.594114][ T11] br0: port 1(eth0) entered disabled state [ 37.227813][ T517] eth0: renamed from r1h1 [ 37.428869][ T519] eth0: renamed from r2h1 [ 37.699960][ T522] eth2: renamed from r2h2 [ 37.981713][ T525] eth1: renamed from r2r1 [ 39.189587][ T540] br0: port 1(eth0) entered blocking state [ 39.189890][ T540] br0: port 1(eth0) entered disabled state [ 39.190156][ T540] eth0: entered allmulticast mode [ 39.191366][ T540] eth0: entered promiscuous mode [ 39.193879][ T71] br0: port 1(eth0) entered blocking state [ 39.194183][ T71] br0: port 1(eth0) entered forwarding state [ 39.276995][ T541] br0: port 2(eth1) entered blocking state [ 39.277306][ T541] br0: port 2(eth1) entered disabled state [ 39.277584][ T541] eth1: entered allmulticast mode [ 39.278777][ T541] eth1: entered promiscuous mode [ 39.280198][ T127] br0: port 2(eth1) entered blocking state [ 39.280456][ T127] br0: port 2(eth1) entered forwarding state [ 55.992270][ T11] eth1: left allmulticast mode [ 55.992539][ T11] eth1: left promiscuous mode [ 55.992867][ T11] br0: port 2(eth1) entered disabled state [ 55.994529][ T11] eth0: left allmulticast mode [ 55.994742][ T11] eth0: left promiscuous mode [ 55.995040][ T11] br0: port 1(eth0) entered disabled state [ 56.025555][ T11] [ 56.025659][ T11] ============================================ [ 56.025854][ T11] WARNING: possible recursive locking detected [ 56.026048][ T11] 6.13.0-rc5-virtme #1 Not tainted [ 56.026202][ T11] -------------------------------------------- [ 56.026389][ T11] kworker/u16:0/11 is trying to acquire lock: [ 56.026579][ T11] ffffffff977f6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 56.026898][ T11] [ 56.026898][ T11] but task is already holding lock: [ 56.027121][ T11] ffffffff977f6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 56.027430][ T11] [ 56.027430][ T11] other info that might help us debug this: [ 56.027654][ T11] Possible unsafe locking scenario: [ 56.027654][ T11] [ 56.027888][ T11] CPU0 [ 56.027999][ T11] ---- [ 56.028111][ T11] lock((netdev_chain).rwsem); [ 56.028264][ T11] lock((netdev_chain).rwsem); [ 56.028417][ T11] [ 56.028417][ T11] *** DEADLOCK *** [ 56.028417][ T11] [ 56.028642][ T11] May be due to missing lock nesting notation [ 56.028642][ T11] [ 56.028869][ T11] 5 locks held by kworker/u16:0/11: [ 56.029029][ T11] #0: ffff8880010b5948 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0x7ec/0x16d0 [ 56.029345][ T11] #1: ffffc900000b7da0 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xe0b/0x16d0 [ 56.029618][ T11] #2: ffffffff977ec4d0 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xbc/0xba0 [ 56.029902][ T11] #3: ffffffff97807e88 (rtnl_mutex){+.+.}-{4:4}, at: cleanup_net+0x45e/0xba0 [ 56.030175][ T11] #4: ffffffff977f6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 56.030491][ T11] [ 56.030491][ T11] stack backtrace: [ 56.030682][ T11] CPU: 0 UID: 0 PID: 11 Comm: kworker/u16:0 Not tainted 6.13.0-rc5-virtme #1 [ 56.030960][ T11] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 56.031156][ T11] Workqueue: netns cleanup_net [ 56.031318][ T11] Call Trace: [ 56.031435][ T11] [ 56.031525][ T11] dump_stack_lvl+0x82/0xd0 [ 56.031689][ T11] print_deadlock_bug+0x40a/0x650 [ 56.031850][ T11] validate_chain+0x5bf/0xae0 [ 56.032033][ T11] ? __pfx_validate_chain+0x10/0x10 [ 56.032193][ T11] ? hlock_class+0x4e/0x130 [ 56.032343][ T11] ? mark_lock+0x38/0x3e0 [ 56.032457][ T11] __lock_acquire+0xb9a/0x1680 [ 56.032608][ T11] lock_acquire.part.0+0xeb/0x330 [ 56.032761][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 56.032954][ T11] ? __lock_acquire+0xb9a/0x1680 [ 56.033103][ T11] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 56.033255][ T11] ? trace_lock_acquire+0x14c/0x1f0 [ 56.033414][ T11] ? lock_acquire+0x32/0xc0 [ 56.033568][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 56.033762][ T11] down_read+0x9f/0x340 [ 56.033891][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 56.034088][ T11] ? __pfx_down_read+0x10/0x10 [ 56.034243][ T11] ? __lock_release+0x103/0x460 [ 56.034399][ T11] blocking_notifier_call_chain+0x50/0x90 [ 56.034559][ T11] __netdev_upper_dev_unlink+0xd9/0x220 [ 56.034720][ T11] ? mark_held_locks+0x9e/0xe0 [ 56.034876][ T11] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 56.035066][ T11] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 56.035260][ T11] ? __try_to_del_timer_sync+0xe7/0x140 [ 56.035420][ T11] ? __pfx___try_to_del_timer_sync+0x10/0x10 [ 56.035616][ T11] ? mark_held_locks+0x9e/0xe0 [ 56.035772][ T11] netdev_upper_dev_unlink+0x71/0xa0 [ 56.035932][ T11] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 56.036121][ T11] ? mutex_is_locked+0x1c/0x60 [ 56.036280][ T11] ? rtnl_is_locked+0x15/0x20 [ 56.036434][ T11] ? netdev_master_upper_dev_get+0x13/0x120 [ 56.036626][ T11] vrf_device_event+0x78/0xe0 [ 56.036780][ T11] notifier_call_chain+0xcd/0x150 [ 56.036965][ T11] blocking_notifier_call_chain+0x66/0x90 [ 56.037118][ T11] unregister_netdevice_many_notify+0xa83/0x1580 [ 56.037308][ T11] ? mark_held_locks+0x9e/0xe0 [ 56.037464][ T11] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 56.037652][ T11] ? mutex_is_locked+0x1c/0x60 [ 56.037807][ T11] ? rtnl_is_locked+0x15/0x20 [ 56.037975][ T11] ? mutex_is_locked+0x1c/0x60 [ 56.038149][ T11] ? nexthop_net_exit_batch_rtnl+0x83/0x210 [ 56.038361][ T11] cleanup_net+0x4cf/0xba0 [ 56.038532][ T11] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 56.038694][ T11] ? __pfx_cleanup_net+0x10/0x10 [ 56.038861][ T11] ? trace_lock_acquire+0x14c/0x1f0 [ 56.039029][ T11] ? lock_acquire+0x32/0xc0 [ 56.039199][ T11] ? process_one_work+0xe0b/0x16d0 [ 56.039373][ T11] process_one_work+0xe55/0x16d0 [ 56.039530][ T11] ? __pfx___lock_release+0x10/0x10 [ 56.039683][ T11] ? __pfx_process_one_work+0x10/0x10 [ 56.039840][ T11] ? assign_work+0x16c/0x240 [ 56.039996][ T11] worker_thread+0x58c/0xce0 [ 56.040155][ T11] ? __pfx_worker_thread+0x10/0x10 [ 56.040309][ T11] kthread+0x28a/0x350 [ 56.040434][ T11] ? __pfx_kthread+0x10/0x10 [ 56.040585][ T11] ret_from_fork+0x31/0x70 [ 56.040743][ T11] ? __pfx_kthread+0x10/0x10 [ 56.040895][ T11] ret_from_fork_asm+0x1a/0x30 [ 56.041059][ T11] [ 60.133599][ T744] eth0: renamed from r1h1 [ 60.277821][ T746] eth0: renamed from r2h1 [ 60.483566][ T749] eth2: renamed from r2h2 [ 60.693625][ T752] eth1: renamed from r2r1 [ 60.984574][ T757] br0: port 1(eth0) entered blocking state [ 60.984886][ T757] br0: port 1(eth0) entered disabled state [ 60.985082][ T757] eth0: entered allmulticast mode [ 60.986021][ T757] eth0: entered promiscuous mode [ 60.987546][ T37] br0: port 1(eth0) entered blocking state [ 60.987748][ T37] br0: port 1(eth0) entered forwarding state [ 61.048792][ T758] br0: port 2(eth1) entered blocking state [ 61.049090][ T758] br0: port 2(eth1) entered disabled state [ 61.049283][ T758] eth1: entered allmulticast mode [ 61.050182][ T758] eth1: entered promiscuous mode [ 61.051369][ T37] br0: port 2(eth1) entered blocking state [ 61.051578][ T37] br0: port 2(eth1) entered forwarding state [ 76.218172][ T11] eth1: left allmulticast mode [ 76.218355][ T11] eth1: left promiscuous mode [ 76.218639][ T11] br0: port 2(eth1) entered disabled state [ 76.221784][ T11] eth0: left allmulticast mode [ 76.221951][ T11] eth0: left promiscuous mode [ 76.222197][ T11] br0: port 1(eth0) entered disabled state [ 80.308223][ T971] eth0: renamed from r1h1 [ 80.439456][ T973] eth0: renamed from r2h1 [ 80.635253][ T976] eth2: renamed from r2h2 [ 80.846099][ T979] eth1: renamed from r2r1 [ 81.690417][ T994] br0: port 1(eth0) entered blocking state [ 81.690682][ T994] br0: port 1(eth0) entered disabled state [ 81.690897][ T994] eth0: entered allmulticast mode [ 81.691814][ T994] eth0: entered promiscuous mode [ 81.694314][ T37] br0: port 1(eth0) entered blocking state [ 81.694550][ T37] br0: port 1(eth0) entered forwarding state [ 81.759317][ T995] br0: port 2(eth1) entered blocking state [ 81.759682][ T995] br0: port 2(eth1) entered disabled state [ 81.759899][ T995] eth1: entered allmulticast mode [ 81.760783][ T995] eth1: entered promiscuous mode [ 81.762388][ T37] br0: port 2(eth1) entered blocking state [ 81.762628][ T37] br0: port 2(eth1) entered forwarding state [ 96.965500][ T11] eth1: left allmulticast mode [ 96.965681][ T11] eth1: left promiscuous mode [ 96.965975][ T11] br0: port 2(eth1) entered disabled state [ 96.967395][ T11] eth0: left allmulticast mode [ 96.967926][ T11] eth0: left promiscuous mode [ 96.968167][ T11] br0: port 1(eth0) entered disabled state