[ 112.737151][ T706] eth0: renamed from r1h1 [ 112.931948][ T708] eth0: renamed from r2h1 [ 113.204007][ T711] eth2: renamed from r2h2 [ 113.481715][ T714] eth1: renamed from r2r1 [ 113.886608][ T719] br0: port 1(eth0) entered blocking state [ 113.887002][ T719] br0: port 1(eth0) entered disabled state [ 113.887259][ T719] eth0: entered allmulticast mode [ 113.888519][ T719] eth0: entered promiscuous mode [ 113.892567][ T39] br0: port 1(eth0) entered blocking state [ 113.892999][ T39] br0: port 1(eth0) entered forwarding state [ 113.975167][ T720] br0: port 2(eth1) entered blocking state [ 113.975523][ T720] br0: port 2(eth1) entered disabled state [ 113.975775][ T720] eth1: entered allmulticast mode [ 113.976980][ T720] eth1: entered promiscuous mode [ 113.979711][ T39] br0: port 2(eth1) entered blocking state [ 113.979971][ T39] br0: port 2(eth1) entered forwarding state [ 130.620447][ T66] eth1: left allmulticast mode [ 130.620802][ T66] eth1: left promiscuous mode [ 130.621158][ T66] br0: port 2(eth1) entered disabled state [ 130.624164][ T66] eth0: left allmulticast mode [ 130.624597][ T66] eth0: left promiscuous mode [ 130.624873][ T66] br0: port 1(eth0) entered disabled state [ 136.408664][ T922] eth0: renamed from r1h1 [ 136.620860][ T924] eth0: renamed from r2h1 [ 136.920848][ T927] eth2: renamed from r2h2 [ 137.202680][ T930] eth1: renamed from r2r1 [ 138.485698][ T945] br0: port 1(eth0) entered blocking state [ 138.486018][ T945] br0: port 1(eth0) entered disabled state [ 138.486248][ T945] eth0: entered allmulticast mode [ 138.487551][ T945] eth0: entered promiscuous mode [ 138.489565][ T45] br0: port 1(eth0) entered blocking state [ 138.489771][ T45] br0: port 1(eth0) entered forwarding state [ 138.564725][ T946] br0: port 2(eth1) entered blocking state [ 138.565081][ T946] br0: port 2(eth1) entered disabled state [ 138.565356][ T946] eth1: entered allmulticast mode [ 138.566849][ T946] eth1: entered promiscuous mode [ 138.568451][ T372] br0: port 2(eth1) entered blocking state [ 138.568684][ T372] br0: port 2(eth1) entered forwarding state [ 155.070840][ T66] eth1: left allmulticast mode [ 155.071075][ T66] eth1: left promiscuous mode [ 155.071384][ T66] br0: port 2(eth1) entered disabled state [ 155.073573][ T66] eth0: left allmulticast mode [ 155.073745][ T66] eth0: left promiscuous mode [ 155.074274][ T66] br0: port 1(eth0) entered disabled state [ 155.102258][ T66] [ 155.102357][ T66] ============================================ [ 155.102527][ T66] WARNING: possible recursive locking detected [ 155.102698][ T66] 6.13.0-rc5-virtme #1 Not tainted [ 155.102835][ T66] -------------------------------------------- [ 155.103005][ T66] kworker/u16:1/66 is trying to acquire lock: [ 155.103172][ T66] ffffffffb27f6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 155.103463][ T66] [ 155.103463][ T66] but task is already holding lock: [ 155.103671][ T66] ffffffffb27f6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 155.103950][ T66] [ 155.103950][ T66] other info that might help us debug this: [ 155.104149][ T66] Possible unsafe locking scenario: [ 155.104149][ T66] [ 155.104353][ T66] CPU0 [ 155.104456][ T66] ---- [ 155.104563][ T66] lock((netdev_chain).rwsem); [ 155.104702][ T66] lock((netdev_chain).rwsem); [ 155.104839][ T66] [ 155.104839][ T66] *** DEADLOCK *** [ 155.104839][ T66] [ 155.105040][ T66] May be due to missing lock nesting notation [ 155.105040][ T66] [ 155.105240][ T66] 5 locks held by kworker/u16:1/66: [ 155.105382][ T66] #0: ffff8880010b5948 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0x7ec/0x16d0 [ 155.105675][ T66] #1: ffffc90000477da0 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xe0b/0x16d0 [ 155.105921][ T66] #2: ffffffffb27ec4d0 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xbc/0xba0 [ 155.106173][ T66] #3: ffffffffb2807e88 (rtnl_mutex){+.+.}-{4:4}, at: cleanup_net+0x45e/0xba0 [ 155.106422][ T66] #4: ffffffffb27f6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 155.106703][ T66] [ 155.106703][ T66] stack backtrace: [ 155.106878][ T66] CPU: 1 UID: 0 PID: 66 Comm: kworker/u16:1 Not tainted 6.13.0-rc5-virtme #1 [ 155.107121][ T66] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 155.107297][ T66] Workqueue: netns cleanup_net [ 155.107442][ T66] Call Trace: [ 155.107552][ T66] [ 155.107631][ T66] dump_stack_lvl+0x82/0xd0 [ 155.107781][ T66] print_deadlock_bug+0x40a/0x650 [ 155.107926][ T66] validate_chain+0x5bf/0xae0 [ 155.108069][ T66] ? __pfx_validate_chain+0x10/0x10 [ 155.108211][ T66] ? hlock_class+0x4e/0x130 [ 155.108348][ T66] ? mark_lock+0x38/0x3e0 [ 155.108458][ T66] __lock_acquire+0xb9a/0x1680 [ 155.108602][ T66] lock_acquire.part.0+0xeb/0x330 [ 155.108738][ T66] ? blocking_notifier_call_chain+0x50/0x90 [ 155.108910][ T66] ? __lock_acquire+0xb9a/0x1680 [ 155.109044][ T66] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 155.109182][ T66] ? trace_lock_acquire+0x14c/0x1f0 [ 155.109321][ T66] ? lock_acquire+0x32/0xc0 [ 155.109456][ T66] ? blocking_notifier_call_chain+0x50/0x90 [ 155.109630][ T66] down_read+0x9f/0x340 [ 155.109736][ T66] ? blocking_notifier_call_chain+0x50/0x90 [ 155.109907][ T66] ? __pfx_down_read+0x10/0x10 [ 155.110044][ T66] ? __lock_release+0x103/0x460 [ 155.110184][ T66] blocking_notifier_call_chain+0x50/0x90 [ 155.110321][ T66] __netdev_upper_dev_unlink+0xd9/0x220 [ 155.110460][ T66] ? mark_held_locks+0x9e/0xe0 [ 155.110602][ T66] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 155.110773][ T66] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 155.110942][ T66] ? __try_to_del_timer_sync+0xe7/0x140 [ 155.111083][ T66] ? __pfx___try_to_del_timer_sync+0x10/0x10 [ 155.111253][ T66] ? mark_held_locks+0x9e/0xe0 [ 155.111394][ T66] netdev_upper_dev_unlink+0x71/0xa0 [ 155.111532][ T66] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 155.111704][ T66] ? mutex_is_locked+0x1c/0x60 [ 155.111841][ T66] ? rtnl_is_locked+0x15/0x20 [ 155.111980][ T66] ? netdev_master_upper_dev_get+0x13/0x120 [ 155.112151][ T66] vrf_device_event+0x78/0xe0 [ 155.112289][ T66] notifier_call_chain+0xcd/0x150 [ 155.112428][ T66] blocking_notifier_call_chain+0x66/0x90 [ 155.112564][ T66] unregister_netdevice_many_notify+0xa83/0x1580 [ 155.112738][ T66] ? mark_held_locks+0x9e/0xe0 [ 155.112874][ T66] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 155.113042][ T66] ? mutex_is_locked+0x1c/0x60 [ 155.113179][ T66] ? rtnl_is_locked+0x15/0x20 [ 155.113318][ T66] ? mutex_is_locked+0x1c/0x60 [ 155.113453][ T66] ? nexthop_net_exit_batch_rtnl+0x83/0x210 [ 155.113632][ T66] cleanup_net+0x4cf/0xba0 [ 155.113772][ T66] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 155.113910][ T66] ? __pfx_cleanup_net+0x10/0x10 [ 155.114046][ T66] ? trace_lock_acquire+0x14c/0x1f0 [ 155.114183][ T66] ? lock_acquire+0x32/0xc0 [ 155.114319][ T66] ? process_one_work+0xe0b/0x16d0 [ 155.114457][ T66] process_one_work+0xe55/0x16d0 [ 155.114597][ T66] ? __pfx___lock_release+0x10/0x10 [ 155.114736][ T66] ? __pfx_process_one_work+0x10/0x10 [ 155.114877][ T66] ? assign_work+0x16c/0x240 [ 155.115016][ T66] worker_thread+0x58c/0xce0 [ 155.115157][ T66] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 155.115330][ T66] ? __pfx_worker_thread+0x10/0x10 [ 155.115470][ T66] ? __pfx_worker_thread+0x10/0x10 [ 155.115607][ T66] kthread+0x28a/0x350 [ 155.115717][ T66] ? __pfx_kthread+0x10/0x10 [ 155.115858][ T66] ret_from_fork+0x31/0x70 [ 155.116000][ T66] ? __pfx_kthread+0x10/0x10 [ 155.116139][ T66] ret_from_fork_asm+0x1a/0x30 [ 155.116282][ T66] [ 159.480582][ T1149] eth0: renamed from r1h1 [ 159.625594][ T1151] eth0: renamed from r2h1 [ 159.840532][ T1154] eth2: renamed from r2h2 [ 160.051196][ T1157] eth1: renamed from r2r1 [ 160.356814][ T1162] br0: port 1(eth0) entered blocking state [ 160.357061][ T1162] br0: port 1(eth0) entered disabled state [ 160.357275][ T1162] eth0: entered allmulticast mode [ 160.358387][ T1162] eth0: entered promiscuous mode [ 160.360133][ T40] br0: port 1(eth0) entered blocking state [ 160.360427][ T40] br0: port 1(eth0) entered forwarding state [ 160.419247][ T1163] br0: port 2(eth1) entered blocking state [ 160.419557][ T1163] br0: port 2(eth1) entered disabled state [ 160.419790][ T1163] eth1: entered allmulticast mode [ 160.420785][ T1163] eth1: entered promiscuous mode [ 160.422221][ T372] br0: port 2(eth1) entered blocking state [ 160.422444][ T372] br0: port 2(eth1) entered forwarding state [ 176.012209][ T66] eth1: left allmulticast mode [ 176.012422][ T66] eth1: left promiscuous mode [ 176.012729][ T66] br0: port 2(eth1) entered disabled state [ 176.013985][ T66] eth0: left allmulticast mode [ 176.014174][ T66] eth0: left promiscuous mode [ 176.014450][ T66] br0: port 1(eth0) entered disabled state [ 180.391501][ T1376] eth0: renamed from r1h1 [ 180.557675][ T1378] eth0: renamed from r2h1 [ 180.779544][ T1381] eth2: renamed from r2h2 [ 180.998536][ T1384] eth1: renamed from r2r1 [ 181.907660][ T1399] br0: port 1(eth0) entered blocking state [ 181.907889][ T1399] br0: port 1(eth0) entered disabled state [ 181.908091][ T1399] eth0: entered allmulticast mode [ 181.909243][ T1399] eth0: entered promiscuous mode [ 181.917181][ T45] br0: port 1(eth0) entered blocking state [ 181.917406][ T45] br0: port 1(eth0) entered forwarding state [ 181.973381][ T1400] br0: port 2(eth1) entered blocking state [ 181.973660][ T1400] br0: port 2(eth1) entered disabled state [ 181.973874][ T1400] eth1: entered allmulticast mode [ 181.975095][ T1400] eth1: entered promiscuous mode [ 181.976656][ T372] br0: port 2(eth1) entered blocking state [ 181.976856][ T372] br0: port 2(eth1) entered forwarding state [ 197.232894][ T66] eth1: left allmulticast mode [ 197.233142][ T66] eth1: left promiscuous mode [ 197.233469][ T66] br0: port 2(eth1) entered disabled state [ 197.234613][ T66] eth0: left allmulticast mode [ 197.234791][ T66] eth0: left promiscuous mode [ 197.235044][ T66] br0: port 1(eth0) entered disabled state