[ 11.907776][ T282] eth0: renamed from r1h1 [ 12.113798][ T284] eth1: renamed from r1h2 [ 17.964663][ T11] [ 17.964775][ T11] ============================================ [ 17.964968][ T11] WARNING: possible recursive locking detected [ 17.965148][ T11] 6.13.0-rc5-virtme #1 Not tainted [ 17.965300][ T11] -------------------------------------------- [ 17.965479][ T11] kworker/u16:0/11 is trying to acquire lock: [ 17.965663][ T11] ffffffff8cbf6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 17.965969][ T11] [ 17.965969][ T11] but task is already holding lock: [ 17.966187][ T11] ffffffff8cbf6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 17.966488][ T11] [ 17.966488][ T11] other info that might help us debug this: [ 17.966702][ T11] Possible unsafe locking scenario: [ 17.966702][ T11] [ 17.966916][ T11] CPU0 [ 17.967030][ T11] ---- [ 17.967139][ T11] lock((netdev_chain).rwsem); [ 17.967290][ T11] lock((netdev_chain).rwsem); [ 17.967440][ T11] [ 17.967440][ T11] *** DEADLOCK *** [ 17.967440][ T11] [ 17.967661][ T11] May be due to missing lock nesting notation [ 17.967661][ T11] [ 17.967885][ T11] 5 locks held by kworker/u16:0/11: [ 17.968037][ T11] #0: ffff8880010b5948 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0x7ec/0x16d0 [ 17.968345][ T11] #1: ffffc900000b7da0 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xe0b/0x16d0 [ 17.968619][ T11] #2: ffffffff8cbec4d0 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xbc/0xba0 [ 17.968881][ T11] #3: ffffffff8cc07e88 (rtnl_mutex){+.+.}-{4:4}, at: default_device_exit_batch+0x81/0x2e0 [ 17.969176][ T11] #4: ffffffff8cbf6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 17.969473][ T11] [ 17.969473][ T11] stack backtrace: [ 17.969650][ T11] CPU: 3 UID: 0 PID: 11 Comm: kworker/u16:0 Not tainted 6.13.0-rc5-virtme #1 [ 17.969903][ T11] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 17.970093][ T11] Workqueue: netns cleanup_net [ 17.970254][ T11] Call Trace: [ 17.970365][ T11] [ 17.970443][ T11] dump_stack_lvl+0x82/0xd0 [ 17.970607][ T11] print_deadlock_bug+0x40a/0x650 [ 17.970763][ T11] validate_chain+0x5bf/0xae0 [ 17.970916][ T11] ? __pfx_validate_chain+0x10/0x10 [ 17.971072][ T11] ? hlock_class+0x4e/0x130 [ 17.971220][ T11] ? mark_lock+0x38/0x3e0 [ 17.971334][ T11] __lock_acquire+0xb9a/0x1680 [ 17.971485][ T11] lock_acquire.part.0+0xeb/0x330 [ 17.971631][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 17.971812][ T11] ? __lock_acquire+0xb9a/0x1680 [ 17.971962][ T11] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 17.972111][ T11] ? trace_lock_acquire+0x14c/0x1f0 [ 17.972261][ T11] ? lock_acquire+0x32/0xc0 [ 17.972407][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 17.972591][ T11] down_read+0x9f/0x340 [ 17.972706][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 17.972892][ T11] ? __pfx_down_read+0x10/0x10 [ 17.973040][ T11] ? __lock_release+0x103/0x460 [ 17.973189][ T11] blocking_notifier_call_chain+0x50/0x90 [ 17.973336][ T11] __netdev_upper_dev_unlink+0xd9/0x220 [ 17.973484][ T11] ? mark_held_locks+0x9e/0xe0 [ 17.973635][ T11] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 17.973820][ T11] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 17.974005][ T11] ? __try_to_del_timer_sync+0xe7/0x140 [ 17.974155][ T11] ? __pfx___try_to_del_timer_sync+0x10/0x10 [ 17.974338][ T11] ? mark_held_locks+0x9e/0xe0 [ 17.974489][ T11] netdev_upper_dev_unlink+0x71/0xa0 [ 17.974634][ T11] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 17.974819][ T11] ? mutex_is_locked+0x1c/0x60 [ 17.974966][ T11] ? rtnl_is_locked+0x15/0x20 [ 17.975119][ T11] ? netdev_master_upper_dev_get+0x13/0x120 [ 17.975302][ T11] vrf_device_event+0x78/0xe0 [ 17.975451][ T11] notifier_call_chain+0xcd/0x150 [ 17.975604][ T11] blocking_notifier_call_chain+0x66/0x90 [ 17.975756][ T11] unregister_netdevice_many_notify+0xa83/0x1580 [ 17.975944][ T11] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 17.976128][ T11] ? default_device_exit_batch+0x81/0x2e0 [ 17.976280][ T11] ? rtnl_is_locked+0x15/0x20 [ 17.976427][ T11] ? unregister_netdevice_queue+0x70/0x410 [ 17.976618][ T11] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 17.976808][ T11] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 17.976999][ T11] default_device_exit_batch+0x241/0x2e0 [ 17.977150][ T11] ? __pfx_default_device_exit_batch+0x10/0x10 [ 17.977339][ T11] ? ops_exit_list+0xb4/0x170 [ 17.977490][ T11] cleanup_net+0x4ef/0xba0 [ 17.977638][ T11] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 17.977791][ T11] ? __pfx_cleanup_net+0x10/0x10 [ 17.977935][ T11] ? trace_lock_acquire+0x14c/0x1f0 [ 17.978084][ T11] ? lock_acquire+0x32/0xc0 [ 17.978234][ T11] ? process_one_work+0xe0b/0x16d0 [ 17.978381][ T11] process_one_work+0xe55/0x16d0 [ 17.978533][ T11] ? __pfx___lock_release+0x10/0x10 [ 17.978682][ T11] ? __pfx_process_one_work+0x10/0x10 [ 17.978841][ T11] ? assign_work+0x16c/0x240 [ 17.978993][ T11] worker_thread+0x58c/0xce0 [ 17.979149][ T11] ? __pfx_worker_thread+0x10/0x10 [ 17.979299][ T11] kthread+0x28a/0x350 [ 17.979416][ T11] ? __pfx_kthread+0x10/0x10 [ 17.979566][ T11] ret_from_fork+0x31/0x70 [ 17.979720][ T11] ? __pfx_kthread+0x10/0x10 [ 17.979873][ T11] ret_from_fork_asm+0x1a/0x30 [ 17.980021][ T11] [ 20.191509][ T379] eth0: renamed from r1h1 [ 20.332239][ T381] eth1: renamed from r1h2 [ 27.088173][ T475] eth0: renamed from r1h1 [ 27.232353][ T477] eth1: renamed from r1h2 [ 33.835072][ T570] eth0: renamed from r1h1 [ 33.966177][ T572] eth1: renamed from r1h2 [ 40.587647][ T663] eth0: renamed from r1h1 [ 40.734394][ T665] eth1: renamed from r1h2 [ 48.364785][ T760] eth0: renamed from r1h1 [ 48.504226][ T762] eth1: renamed from r1h2 [ 56.584143][ T864] eth0: renamed from r1h1 [ 56.732436][ T866] eth0: renamed from r2h1 [ 56.872762][ T868] eth1: renamed from r1h2 [ 57.026738][ T870] eth1: renamed from r2h2 [ 57.318852][ T875] br0: port 1(eth0) entered blocking state [ 57.319137][ T875] br0: port 1(eth0) entered disabled state [ 57.319425][ T875] eth0: entered allmulticast mode [ 57.320328][ T875] eth0: entered promiscuous mode [ 57.321841][ T40] br0: port 1(eth0) entered blocking state [ 57.322038][ T40] br0: port 1(eth0) entered forwarding state [ 57.379539][ T876] br0: port 2(eth1) entered blocking state [ 57.379826][ T876] br0: port 2(eth1) entered disabled state [ 57.380007][ T876] eth1: entered allmulticast mode [ 57.380975][ T876] eth1: entered promiscuous mode [ 57.382563][ T40] br0: port 2(eth1) entered blocking state [ 57.382787][ T40] br0: port 2(eth1) entered forwarding state [ 57.780604][ T883] br0: port 1(eth0) entered blocking state [ 57.780871][ T883] br0: port 1(eth0) entered disabled state [ 57.781050][ T883] eth0: entered allmulticast mode [ 57.781939][ T883] eth0: entered promiscuous mode [ 57.837569][ T884] br0: port 2(eth1) entered blocking state [ 57.837859][ T884] br0: port 2(eth1) entered disabled state [ 57.838057][ T884] eth1: entered allmulticast mode [ 57.839002][ T884] eth1: entered promiscuous mode [ 57.840125][ T37] br0: port 2(eth1) entered blocking state [ 57.840333][ T37] br0: port 2(eth1) entered forwarding state [ 58.520733][ T37] br0: port 1(eth0) entered blocking state [ 58.520968][ T37] br0: port 1(eth0) entered forwarding state [ 62.026881][ T11] eth1: left allmulticast mode [ 62.027056][ T11] eth1: left promiscuous mode [ 62.027482][ T11] br0: port 2(eth1) entered disabled state [ 62.028806][ T11] eth0: left allmulticast mode [ 62.028950][ T11] eth0: left promiscuous mode [ 62.029191][ T11] br0: port 1(eth0) entered disabled state [ 62.325115][ T11] eth1: left allmulticast mode [ 62.325305][ T11] eth1: left promiscuous mode [ 62.325551][ T11] br0: port 2(eth1) entered disabled state [ 62.326708][ T11] eth0: left allmulticast mode [ 62.326848][ T11] eth0: left promiscuous mode [ 62.327086][ T11] br0: port 1(eth0) entered disabled state [ 65.291087][ T988] eth0: renamed from r1h1 [ 65.436257][ T990] eth0: renamed from r2h1 [ 65.594093][ T992] eth1: renamed from r1h2 [ 65.743562][ T994] eth1: renamed from r2h2 [ 66.037486][ T999] br0: port 1(eth0) entered blocking state [ 66.037717][ T999] br0: port 1(eth0) entered disabled state [ 66.037919][ T999] eth0: entered allmulticast mode [ 66.038876][ T999] eth0: entered promiscuous mode [ 66.040760][ T37] br0: port 1(eth0) entered blocking state [ 66.040951][ T37] br0: port 1(eth0) entered forwarding state [ 66.094565][ T1000] br0: port 2(eth1) entered blocking state [ 66.094868][ T1000] br0: port 2(eth1) entered disabled state [ 66.095064][ T1000] eth1: entered allmulticast mode [ 66.095972][ T1000] eth1: entered promiscuous mode [ 66.097276][ T55] br0: port 2(eth1) entered blocking state [ 66.097488][ T55] br0: port 2(eth1) entered forwarding state [ 66.497636][ T1007] br0: port 1(eth0) entered blocking state [ 66.497901][ T1007] br0: port 1(eth0) entered disabled state [ 66.498079][ T1007] eth0: entered allmulticast mode [ 66.498986][ T1007] eth0: entered promiscuous mode [ 66.561772][ T1008] br0: port 2(eth1) entered blocking state [ 66.562084][ T1008] br0: port 2(eth1) entered disabled state [ 66.562298][ T1008] eth1: entered allmulticast mode [ 66.563210][ T1008] eth1: entered promiscuous mode [ 66.564394][ T37] br0: port 2(eth1) entered blocking state [ 66.564593][ T37] br0: port 2(eth1) entered forwarding state [ 67.288855][ T159] br0: port 1(eth0) entered blocking state [ 67.289101][ T159] br0: port 1(eth0) entered forwarding state [ 70.741123][ T11] eth1: left allmulticast mode [ 70.741512][ T11] eth1: left promiscuous mode [ 70.741758][ T11] br0: port 2(eth1) entered disabled state [ 70.744677][ T11] eth0: left allmulticast mode [ 70.744900][ T11] eth0: left promiscuous mode [ 70.745174][ T11] br0: port 1(eth0) entered disabled state [ 71.035021][ T11] eth1: left allmulticast mode [ 71.035208][ T11] eth1: left promiscuous mode [ 71.035484][ T11] br0: port 2(eth1) entered disabled state [ 71.036724][ T11] eth0: left allmulticast mode [ 71.036882][ T11] eth0: left promiscuous mode [ 71.037130][ T11] br0: port 1(eth0) entered disabled state [ 73.292124][ T1101] eth0: renamed from r1h1 [ 73.444577][ T1103] eth1: renamed from r1h2 [ 80.415866][ T1202] eth0: renamed from r1h1 [ 80.563257][ T1204] eth1: renamed from r1h2 [ 87.726681][ T1302] eth0: renamed from r1h1 [ 87.894311][ T1304] eth1: renamed from r1h2 [ 95.087562][ T1400] eth0: renamed from r1h1 [ 95.243057][ T1402] eth1: renamed from r1h2 [ 103.216776][ T1502] eth0: renamed from r1h1 [ 103.371440][ T1504] eth1: renamed from r1h2 [ 111.909721][ T1615] eth0: renamed from r1h1 [ 112.060340][ T1617] eth0: renamed from r2h1 [ 112.214896][ T1619] eth1: renamed from r1h2 [ 112.366682][ T1621] eth1: renamed from r2h2 [ 112.641308][ T1626] br0: port 1(eth0) entered blocking state [ 112.641514][ T1626] br0: port 1(eth0) entered disabled state [ 112.641706][ T1626] eth0: entered allmulticast mode [ 112.642634][ T1626] eth0: entered promiscuous mode [ 112.644414][ T40] br0: port 1(eth0) entered blocking state [ 112.644614][ T40] br0: port 1(eth0) entered forwarding state [ 112.701166][ T1627] br0: port 2(eth1) entered blocking state [ 112.701488][ T1627] br0: port 2(eth1) entered disabled state [ 112.701697][ T1627] eth1: entered allmulticast mode [ 112.707808][ T1627] eth1: entered promiscuous mode [ 112.710115][ T55] br0: port 2(eth1) entered blocking state [ 112.710328][ T55] br0: port 2(eth1) entered forwarding state [ 113.110481][ T1634] br0: port 1(eth0) entered blocking state [ 113.110688][ T1634] br0: port 1(eth0) entered disabled state [ 113.110877][ T1634] eth0: entered allmulticast mode [ 113.111744][ T1634] eth0: entered promiscuous mode [ 113.181641][ T1635] br0: port 2(eth1) entered blocking state [ 113.181921][ T1635] br0: port 2(eth1) entered disabled state [ 113.182118][ T1635] eth1: entered allmulticast mode [ 113.183048][ T1635] eth1: entered promiscuous mode [ 113.184183][ T37] br0: port 2(eth1) entered blocking state [ 113.184426][ T37] br0: port 2(eth1) entered forwarding state [ 113.880682][ T159] br0: port 1(eth0) entered blocking state [ 113.880896][ T159] br0: port 1(eth0) entered forwarding state [ 117.356523][ T11] eth1: left allmulticast mode [ 117.356703][ T11] eth1: left promiscuous mode [ 117.356951][ T11] br0: port 2(eth1) entered disabled state [ 117.358008][ T11] eth0: left allmulticast mode [ 117.358159][ T11] eth0: left promiscuous mode [ 117.358435][ T11] br0: port 1(eth0) entered disabled state [ 117.612420][ T11] eth1: left allmulticast mode [ 117.612610][ T11] eth1: left promiscuous mode [ 117.612862][ T11] br0: port 2(eth1) entered disabled state [ 117.613948][ T11] eth0: left allmulticast mode [ 117.614098][ T11] eth0: left promiscuous mode [ 117.614380][ T11] br0: port 1(eth0) entered disabled state [ 120.412314][ T1739] eth0: renamed from r1h1 [ 120.561205][ T1741] eth0: renamed from r2h1 [ 120.699985][ T1743] eth1: renamed from r1h2 [ 120.834804][ T1745] eth1: renamed from r2h2 [ 121.117838][ T1750] br0: port 1(eth0) entered blocking state [ 121.118153][ T1750] br0: port 1(eth0) entered disabled state [ 121.118633][ T1750] eth0: entered allmulticast mode [ 121.119509][ T1750] eth0: entered promiscuous mode [ 121.121115][ T55] br0: port 1(eth0) entered blocking state [ 121.121319][ T55] br0: port 1(eth0) entered forwarding state [ 121.185900][ T1751] br0: port 2(eth1) entered blocking state [ 121.186174][ T1751] br0: port 2(eth1) entered disabled state [ 121.186386][ T1751] eth1: entered allmulticast mode [ 121.187315][ T1751] eth1: entered promiscuous mode [ 121.188333][ T40] br0: port 2(eth1) entered blocking state [ 121.188527][ T40] br0: port 2(eth1) entered forwarding state [ 121.569156][ T1758] br0: port 1(eth0) entered blocking state [ 121.569470][ T1758] br0: port 1(eth0) entered disabled state [ 121.569670][ T1758] eth0: entered allmulticast mode [ 121.570528][ T1758] eth0: entered promiscuous mode [ 121.635252][ T1759] br0: port 2(eth1) entered blocking state [ 121.635543][ T1759] br0: port 2(eth1) entered disabled state [ 121.635736][ T1759] eth1: entered allmulticast mode [ 121.636669][ T1759] eth1: entered promiscuous mode [ 121.637898][ T37] br0: port 2(eth1) entered blocking state [ 121.638106][ T37] br0: port 2(eth1) entered forwarding state [ 122.392683][ T159] br0: port 1(eth0) entered blocking state [ 122.392908][ T159] br0: port 1(eth0) entered forwarding state [ 125.794396][ T11] eth1: left allmulticast mode [ 125.794633][ T11] eth1: left promiscuous mode [ 125.794918][ T11] br0: port 2(eth1) entered disabled state [ 125.796058][ T11] eth0: left allmulticast mode [ 125.796233][ T11] eth0: left promiscuous mode [ 125.796517][ T11] br0: port 1(eth0) entered disabled state [ 126.094811][ T11] eth1: left allmulticast mode [ 126.094999][ T11] eth1: left promiscuous mode [ 126.095251][ T11] br0: port 2(eth1) entered disabled state [ 126.096431][ T11] eth0: left allmulticast mode [ 126.096578][ T11] eth0: left promiscuous mode [ 126.096819][ T11] br0: port 1(eth0) entered disabled state