[ 1632.845644][T19620] br0: port 1(gw_l) entered blocking state [ 1632.846188][T19620] br0: port 1(gw_l) entered disabled state [ 1632.846490][T19620] gw_l: entered allmulticast mode [ 1632.848181][T19620] gw_l: entered promiscuous mode [ 1632.850478][T19620] br0: port 1(gw_l) entered blocking state [ 1632.850965][T19620] br0: port 1(gw_l) entered forwarding state [ 1633.371862][T19622] br0: port 2(amtg) entered blocking state [ 1633.372515][T19622] br0: port 2(amtg) entered disabled state [ 1633.372836][T19622] amtg: entered allmulticast mode [ 1633.374233][T19622] amtg: entered promiscuous mode [ 1635.037711][T19633] br0: port 2(amtg) entered blocking state [ 1635.038701][T19633] br0: port 2(amtg) entered forwarding state [ 1635.743211][T19639] amtr: entered allmulticast mode [ 1635.743978][T19639] relay_gw: entered allmulticast mode [ 1635.744307][T19639] relay_src: entered allmulticast mode [ 2866.323312][ T11] br0: port 1(gw_l) entered disabled state [ 2866.431142][ T11] gw_l (unregistering): left allmulticast mode [ 2866.431579][ T11] gw_l (unregistering): left promiscuous mode [ 2866.431833][ T11] br0: port 1(gw_l) entered disabled state [ 2866.432824][ T11] [ 2866.432924][ T11] ============================================ [ 2866.433116][ T11] WARNING: possible recursive locking detected [ 2866.433327][ T11] 6.13.0-rc5-virtme #1 Not tainted [ 2866.433480][ T11] -------------------------------------------- [ 2866.433667][ T11] kworker/u16:0/11 is trying to acquire lock: [ 2866.433855][ T11] ffffffff8cff6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 2866.434172][ T11] [ 2866.434172][ T11] but task is already holding lock: [ 2866.434399][ T11] ffffffff8cff6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 2866.434711][ T11] [ 2866.434711][ T11] other info that might help us debug this: [ 2866.434939][ T11] Possible unsafe locking scenario: [ 2866.434939][ T11] [ 2866.435164][ T11] CPU0 [ 2866.435278][ T11] ---- [ 2866.435399][ T11] lock((netdev_chain).rwsem); [ 2866.435556][ T11] lock((netdev_chain).rwsem); [ 2866.435710][ T11] [ 2866.435710][ T11] *** DEADLOCK *** [ 2866.435710][ T11] [ 2866.435964][ T11] May be due to missing lock nesting notation [ 2866.435964][ T11] [ 2866.436195][ T11] 5 locks held by kworker/u16:0/11: [ 2866.436364][ T11] #0: ffff8880010b5948 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0x7ec/0x16d0 [ 2866.436682][ T11] #1: ffffc900000b7da0 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xe0b/0x16d0 [ 2866.436954][ T11] #2: ffffffff8cfec4d0 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xbc/0xba0 [ 2866.437235][ T11] #3: ffffffff8d007e88 (rtnl_mutex){+.+.}-{4:4}, at: default_device_exit_batch+0x81/0x2e0 [ 2866.437545][ T11] #4: ffffffff8cff6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 2866.437864][ T11] [ 2866.437864][ T11] stack backtrace: [ 2866.438057][ T11] CPU: 3 UID: 0 PID: 11 Comm: kworker/u16:0 Not tainted 6.13.0-rc5-virtme #1 [ 2866.438327][ T11] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 2866.438524][ T11] Workqueue: netns cleanup_net [ 2866.438682][ T11] Call Trace: [ 2866.438804][ T11] [ 2866.438882][ T11] dump_stack_lvl+0x82/0xd0 [ 2866.439040][ T11] print_deadlock_bug+0x40a/0x650 [ 2866.439200][ T11] validate_chain+0x5bf/0xae0 [ 2866.439353][ T11] ? __pfx_validate_chain+0x10/0x10 [ 2866.439516][ T11] ? hlock_class+0x4e/0x130 [ 2866.439670][ T11] ? mark_lock+0x38/0x3e0 [ 2866.439790][ T11] __lock_acquire+0xb9a/0x1680 [ 2866.439951][ T11] lock_acquire.part.0+0xeb/0x330 [ 2866.440111][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 2866.440300][ T11] ? find_held_lock+0x2c/0x110 [ 2866.440449][ T11] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 2866.440599][ T11] ? trace_lock_acquire+0x14c/0x1f0 [ 2866.440755][ T11] ? lock_acquire+0x32/0xc0 [ 2866.440908][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 2866.441097][ T11] down_read+0x9f/0x340 [ 2866.441213][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 2866.441408][ T11] ? __pfx_down_read+0x10/0x10 [ 2866.441561][ T11] ? lockdep_hardirqs_on_prepare+0x12b/0x410 [ 2866.441753][ T11] blocking_notifier_call_chain+0x50/0x90 [ 2866.441912][ T11] __netdev_upper_dev_unlink+0xd9/0x220 [ 2866.442071][ T11] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 2866.442262][ T11] ? find_held_lock+0x2c/0x110 [ 2866.442415][ T11] ? del_nbp+0x377/0xbe0 [ 2866.442534][ T11] ? hlock_class+0x4e/0x130 [ 2866.442688][ T11] netdev_upper_dev_unlink+0x71/0xa0 [ 2866.442845][ T11] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 2866.443038][ T11] ? mutex_is_locked+0x12/0x60 [ 2866.443193][ T11] ? rtnl_is_locked+0x15/0x20 [ 2866.443350][ T11] del_nbp+0x602/0xbe0 [ 2866.443467][ T11] br_del_if+0xa3/0x1f0 [ 2866.443583][ T11] br_device_event+0x53d/0x800 [ 2866.443740][ T11] ? __pfx_br_device_event+0x10/0x10 [ 2866.443894][ T11] ? packet_notifier+0x3b0/0x810 [ 2866.444048][ T11] notifier_call_chain+0xcd/0x150 [ 2866.444200][ T11] blocking_notifier_call_chain+0x66/0x90 [ 2866.444353][ T11] unregister_netdevice_many_notify+0xa83/0x1580 [ 2866.444544][ T11] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 2866.444734][ T11] ? default_device_exit_batch+0x81/0x2e0 [ 2866.444890][ T11] ? rtnl_is_locked+0x15/0x20 [ 2866.445047][ T11] ? unregister_netdevice_queue+0x70/0x410 [ 2866.445236][ T11] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 2866.445430][ T11] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 2866.445622][ T11] default_device_exit_batch+0x241/0x2e0 [ 2866.445779][ T11] ? __pfx_default_device_exit_batch+0x10/0x10 [ 2866.445992][ T11] ? ops_exit_list+0xb4/0x170 [ 2866.446152][ T11] cleanup_net+0x4ef/0xba0 [ 2866.446309][ T11] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 2866.446466][ T11] ? __pfx_cleanup_net+0x10/0x10 [ 2866.446621][ T11] ? trace_lock_acquire+0x14c/0x1f0 [ 2866.446779][ T11] ? lock_acquire+0x32/0xc0 [ 2866.446939][ T11] ? process_one_work+0xe0b/0x16d0 [ 2866.447096][ T11] process_one_work+0xe55/0x16d0 [ 2866.447258][ T11] ? __pfx___lock_release+0x10/0x10 [ 2866.447425][ T11] ? __pfx_process_one_work+0x10/0x10 [ 2866.447582][ T11] ? assign_work+0x16c/0x240 [ 2866.447736][ T11] worker_thread+0x58c/0xce0 [ 2866.447891][ T11] ? __pfx_worker_thread+0x10/0x10 [ 2866.448044][ T11] kthread+0x28a/0x350 [ 2866.448164][ T11] ? __pfx_kthread+0x10/0x10 [ 2866.448317][ T11] ret_from_fork+0x31/0x70 [ 2866.448474][ T11] ? __pfx_kthread+0x10/0x10 [ 2866.448630][ T11] ret_from_fork_asm+0x1a/0x30 [ 2866.448791][ T11] [ 2866.496779][ T11] amtg: left allmulticast mode [ 2866.496961][ T11] amtg: left promiscuous mode [ 2866.497212][ T11] br0: port 2(amtg) entered disabled state [ 2866.522786][T19639] amtr: left allmulticast mode [ 2866.523024][T19639] relay_gw: left allmulticast mode [ 2866.523212][T19639] relay_src: left allmulticast mode