[ 10.237453][ T245] ip (245) used greatest stack depth: 24168 bytes left [ 12.598826][ T292] bond0: (slave veth0): Enslaving as a backup interface with a down link [ 12.681791][ T293] bond0: (slave veth1): Enslaving as a backup interface with a down link [ 12.756273][ T294] br0: port 1(veth0) entered blocking state [ 12.756559][ T294] br0: port 1(veth0) entered disabled state [ 12.756824][ T294] veth0: entered allmulticast mode [ 12.759228][ T294] veth0: entered promiscuous mode [ 12.843691][ T295] br0: port 2(veth1) entered blocking state [ 12.843985][ T295] br0: port 2(veth1) entered disabled state [ 12.844229][ T295] veth1: entered allmulticast mode [ 12.845441][ T295] veth1: entered promiscuous mode [ 13.361320][ T38] br0: port 1(veth0) entered blocking state [ 13.361686][ T38] br0: port 1(veth0) entered forwarding state [ 13.363355][ T38] br0: port 2(veth1) entered blocking state [ 13.363766][ T38] br0: port 2(veth1) entered forwarding state [ 14.593630][ T70] bond0: (slave veth1): link status definitely up [ 14.594002][ T70] bond0: (slave veth1): making interface the new active one [ 14.595541][ T70] bond0: active interface up! [ 15.036094][ T70] veth1: left allmulticast mode [ 15.036418][ T70] veth1: left promiscuous mode [ 15.036776][ T70] br0: port 2(veth1) entered disabled state [ 15.039269][ T70] veth0: left allmulticast mode [ 15.039451][ T70] veth0: left promiscuous mode [ 15.039738][ T70] br0: port 1(veth0) entered disabled state [ 15.234153][ T70] [ 15.234337][ T70] ============================================ [ 15.234510][ T70] WARNING: possible recursive locking detected [ 15.234680][ T70] 6.13.0-rc5-virtme #1 Not tainted [ 15.234829][ T70] -------------------------------------------- [ 15.235001][ T70] kworker/u16:1/70 is trying to acquire lock: [ 15.235174][ T70] ffffffff8e9f0a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 15.235457][ T70] [ 15.235457][ T70] but task is already holding lock: [ 15.235659][ T70] ffffffff8e9f0a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 15.235933][ T70] [ 15.235933][ T70] other info that might help us debug this: [ 15.236136][ T70] Possible unsafe locking scenario: [ 15.236136][ T70] [ 15.236334][ T70] CPU0 [ 15.236454][ T70] ---- [ 15.236554][ T70] lock((netdev_chain).rwsem); [ 15.236690][ T70] lock((netdev_chain).rwsem); [ 15.236830][ T70] [ 15.236830][ T70] *** DEADLOCK *** [ 15.236830][ T70] [ 15.237034][ T70] May be due to missing lock nesting notation [ 15.237034][ T70] [ 15.237236][ T70] 5 locks held by kworker/u16:1/70: [ 15.237373][ T70] #0: ffff8880010ad948 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0x7ec/0x16d0 [ 15.237660][ T70] #1: ffffc900004b7da0 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xe0b/0x16d0 [ 15.237905][ T70] #2: ffffffff8e9e6550 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xbc/0xa50 [ 15.238149][ T70] #3: ffffffff8ea01dc8 (rtnl_mutex){+.+.}-{4:4}, at: default_device_exit_batch+0x81/0x2e0 [ 15.238427][ T70] #4: ffffffff8e9f0a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 15.238701][ T70] [ 15.238701][ T70] stack backtrace: [ 15.238870][ T70] CPU: 3 UID: 0 PID: 70 Comm: kworker/u16:1 Not tainted 6.13.0-rc5-virtme #1 [ 15.239109][ T70] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 15.239280][ T70] Workqueue: netns cleanup_net [ 15.239425][ T70] Call Trace: [ 15.239534][ T70] [ 15.239608][ T70] dump_stack_lvl+0x82/0xd0 [ 15.239749][ T70] print_deadlock_bug+0x40a/0x650 [ 15.239888][ T70] validate_chain+0x5bf/0xae0 [ 15.240030][ T70] ? __pfx_validate_chain+0x10/0x10 [ 15.240173][ T70] ? hlock_class+0x4e/0x130 [ 15.240316][ T70] ? mark_lock+0x38/0x3e0 [ 15.240424][ T70] __lock_acquire+0xb9a/0x1680 [ 15.240566][ T70] lock_acquire.part.0+0xeb/0x330 [ 15.240702][ T70] ? blocking_notifier_call_chain+0x50/0x90 [ 15.240876][ T70] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 15.241016][ T70] ? trace_lock_acquire+0x14c/0x1f0 [ 15.241153][ T70] ? lock_acquire+0x32/0xc0 [ 15.241290][ T70] ? blocking_notifier_call_chain+0x50/0x90 [ 15.241464][ T70] down_read+0x9f/0x340 [ 15.241572][ T70] ? blocking_notifier_call_chain+0x50/0x90 [ 15.241742][ T70] ? __pfx_down_read+0x10/0x10 [ 15.241880][ T70] ? __pfx_validate_chain+0x10/0x10 [ 15.242020][ T70] ? hlock_class+0x4e/0x130 [ 15.242156][ T70] ? mark_lock+0x38/0x3e0 [ 15.242261][ T70] blocking_notifier_call_chain+0x50/0x90 [ 15.242401][ T70] netdev_lower_state_changed+0xa3/0x130 [ 15.242538][ T70] ? __pfx_netdev_lower_state_changed+0x10/0x10 [ 15.242707][ T70] ? __pfx_netdev_has_upper_dev+0x10/0x10 [ 15.242846][ T70] __bond_release_one+0xcc7/0x13f0 [ 15.242987][ T70] ? __lock_release+0x103/0x460 [ 15.243126][ T70] ? __try_to_del_timer_sync+0xe7/0x140 [ 15.243267][ T70] ? __pfx___bond_release_one+0x10/0x10 [ 15.243403][ T70] ? hlock_class+0x4e/0x130 [ 15.243544][ T70] ? mark_lock+0x38/0x3e0 [ 15.243650][ T70] ? mark_held_locks+0x9e/0xe0 [ 15.243787][ T70] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 15.243957][ T70] ? __try_to_del_timer_sync+0xe7/0x140 [ 15.244095][ T70] ? __pfx___try_to_del_timer_sync+0x10/0x10 [ 15.244270][ T70] ? mark_held_locks+0x9e/0xe0 [ 15.244410][ T70] bond_slave_netdev_event+0x73a/0x870 [ 15.244549][ T70] ? ipmr_device_event+0x3d/0x1b0 [ 15.244687][ T70] notifier_call_chain+0xcd/0x150 [ 15.244836][ T70] blocking_notifier_call_chain+0x66/0x90 [ 15.244973][ T70] unregister_netdevice_many_notify+0xa7b/0x1580 [ 15.245147][ T70] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 15.245322][ T70] ? default_device_exit_batch+0x81/0x2e0 [ 15.245464][ T70] ? rtnl_is_locked+0x15/0x20 [ 15.245604][ T70] ? unregister_netdevice_queue+0x70/0x410 [ 15.245776][ T70] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 15.245946][ T70] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 15.246117][ T70] default_device_exit_batch+0x241/0x2e0 [ 15.246257][ T70] ? __pfx_default_device_exit_batch+0x10/0x10 [ 15.246429][ T70] ? mutex_is_locked+0x1c/0x60 [ 15.246568][ T70] ? nexthop_net_exit_batch_rtnl+0x83/0x210 [ 15.246742][ T70] cleanup_net+0x4ef/0xa50 [ 15.246881][ T70] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 15.247020][ T70] ? __pfx_cleanup_net+0x10/0x10 [ 15.247157][ T70] ? trace_lock_acquire+0x14c/0x1f0 [ 15.247298][ T70] ? lock_acquire+0x32/0xc0 [ 15.247436][ T70] ? process_one_work+0xe0b/0x16d0 [ 15.247574][ T70] process_one_work+0xe55/0x16d0 [ 15.247714][ T70] ? __pfx___lock_release+0x10/0x10 [ 15.247857][ T70] ? __pfx_process_one_work+0x10/0x10 [ 15.248003][ T70] ? assign_work+0x16c/0x240 [ 15.248139][ T70] worker_thread+0x58c/0xce0 [ 15.248280][ T70] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 15.248453][ T70] ? __pfx_worker_thread+0x10/0x10 [ 15.248590][ T70] ? __pfx_worker_thread+0x10/0x10 [ 15.248726][ T70] kthread+0x28a/0x350 [ 15.248831][ T70] ? __pfx_kthread+0x10/0x10 [ 15.248971][ T70] ret_from_fork+0x31/0x70 [ 15.249108][ T70] ? __pfx_kthread+0x10/0x10 [ 15.249245][ T70] ret_from_fork_asm+0x1a/0x30 [ 15.249387][ T70] [ 15.249651][ T70] bond0: (slave veth1): Releasing backup interface [ 15.350040][ T70] bond0: (slave veth0): Releasing backup interface [ 15.489874][ T70] bond0 (unregistering): Released all slaves