[ 11.627015][ T245] ip (245) used greatest stack depth: 24488 bytes left [ 14.037283][ T286] bond0: (slave veth0): Enslaving as a backup interface with a down link [ 14.138729][ T287] bond0: (slave veth1): Enslaving as a backup interface with a down link [ 14.219603][ T288] br0: port 1(veth0) entered blocking state [ 14.219881][ T288] br0: port 1(veth0) entered disabled state [ 14.220145][ T288] veth0: entered allmulticast mode [ 14.221447][ T288] veth0: entered promiscuous mode [ 14.313931][ T289] br0: port 2(veth1) entered blocking state [ 14.314261][ T289] br0: port 2(veth1) entered disabled state [ 14.314536][ T289] veth1: entered allmulticast mode [ 14.315820][ T289] veth1: entered promiscuous mode [ 14.730864][ T38] br0: port 1(veth0) entered blocking state [ 14.731456][ T38] br0: port 1(veth0) entered forwarding state [ 14.734534][ T38] br0: port 2(veth1) entered blocking state [ 14.734888][ T38] br0: port 2(veth1) entered forwarding state [ 16.000875][ T11] bond0: (slave veth1): link status definitely up [ 16.001354][ T11] bond0: (slave veth1): making interface the new active one [ 16.002731][ T11] bond0: active interface up! [ 16.445776][ T319] veth1: left allmulticast mode [ 16.446116][ T319] veth1: left promiscuous mode [ 16.446520][ T319] br0: port 2(veth1) entered disabled state [ 16.449761][ T319] veth0: left allmulticast mode [ 16.449987][ T319] veth0: left promiscuous mode [ 16.450307][ T319] br0: port 1(veth0) entered disabled state [ 16.652809][ T319] [ 16.652972][ T319] ============================================ [ 16.653168][ T319] WARNING: possible recursive locking detected [ 16.653369][ T319] 6.13.0-rc5-virtme #1 Not tainted [ 16.653524][ T319] -------------------------------------------- [ 16.653715][ T319] kworker/u16:2/319 is trying to acquire lock: [ 16.653925][ T319] ffffffff875f0a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 16.654276][ T319] [ 16.654276][ T319] but task is already holding lock: [ 16.654510][ T319] ffffffff875f0a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 16.654842][ T319] [ 16.654842][ T319] other info that might help us debug this: [ 16.655078][ T319] Possible unsafe locking scenario: [ 16.655078][ T319] [ 16.655308][ T319] CPU0 [ 16.655436][ T319] ---- [ 16.655558][ T319] lock((netdev_chain).rwsem); [ 16.655718][ T319] lock((netdev_chain).rwsem); [ 16.655861][ T319] [ 16.655861][ T319] *** DEADLOCK *** [ 16.655861][ T319] [ 16.656078][ T319] May be due to missing lock nesting notation [ 16.656078][ T319] [ 16.656291][ T319] 5 locks held by kworker/u16:2/319: [ 16.656438][ T319] #0: ffff8880010ad948 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0x7ec/0x16d0 [ 16.656756][ T319] #1: ffffc90000e57da0 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xe0b/0x16d0 [ 16.657037][ T319] #2: ffffffff875e6550 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xbc/0xa50 [ 16.657323][ T319] #3: ffffffff87601dc8 (rtnl_mutex){+.+.}-{4:4}, at: default_device_exit_batch+0x81/0x2e0 [ 16.657646][ T319] #4: ffffffff875f0a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 16.657984][ T319] [ 16.657984][ T319] stack backtrace: [ 16.658179][ T319] CPU: 1 UID: 0 PID: 319 Comm: kworker/u16:2 Not tainted 6.13.0-rc5-virtme #1 [ 16.658451][ T319] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 16.658658][ T319] Workqueue: netns cleanup_net [ 16.658839][ T319] Call Trace: [ 16.658967][ T319] [ 16.659055][ T319] dump_stack_lvl+0x82/0xd0 [ 16.659228][ T319] print_deadlock_bug+0x40a/0x650 [ 16.659397][ T319] validate_chain+0x5bf/0xae0 [ 16.659563][ T319] ? __pfx_validate_chain+0x10/0x10 [ 16.659743][ T319] ? hlock_class+0x4e/0x130 [ 16.659901][ T319] ? mark_lock+0x38/0x3e0 [ 16.660025][ T319] __lock_acquire+0xb9a/0x1680 [ 16.660198][ T319] lock_acquire.part.0+0xeb/0x330 [ 16.660357][ T319] ? blocking_notifier_call_chain+0x50/0x90 [ 16.660584][ T319] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 16.660755][ T319] ? trace_lock_acquire+0x14c/0x1f0 [ 16.660910][ T319] ? lock_acquire+0x32/0xc0 [ 16.661078][ T319] ? blocking_notifier_call_chain+0x50/0x90 [ 16.661311][ T319] down_read+0x9f/0x340 [ 16.661425][ T319] ? blocking_notifier_call_chain+0x50/0x90 [ 16.661643][ T319] ? __pfx_down_read+0x10/0x10 [ 16.661805][ T319] ? __pfx_validate_chain+0x10/0x10 [ 16.661966][ T319] ? hlock_class+0x4e/0x130 [ 16.662129][ T319] ? mark_lock+0x38/0x3e0 [ 16.662257][ T319] blocking_notifier_call_chain+0x50/0x90 [ 16.662425][ T319] netdev_lower_state_changed+0xa3/0x130 [ 16.662583][ T319] ? __pfx_netdev_lower_state_changed+0x10/0x10 [ 16.662782][ T319] ? __pfx_netdev_has_upper_dev+0x10/0x10 [ 16.662947][ T319] __bond_release_one+0xcc7/0x13f0 [ 16.663107][ T319] ? __lock_release+0x103/0x460 [ 16.663266][ T319] ? __try_to_del_timer_sync+0xe7/0x140 [ 16.663430][ T319] ? __pfx___bond_release_one+0x10/0x10 [ 16.663589][ T319] ? hlock_class+0x4e/0x130 [ 16.663751][ T319] ? mark_lock+0x38/0x3e0 [ 16.663889][ T319] ? mark_held_locks+0x9e/0xe0 [ 16.664064][ T319] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 16.664270][ T319] ? __try_to_del_timer_sync+0xe7/0x140 [ 16.664419][ T319] ? __pfx___try_to_del_timer_sync+0x10/0x10 [ 16.664634][ T319] ? mark_held_locks+0x9e/0xe0 [ 16.664793][ T319] bond_slave_netdev_event+0x73a/0x870 [ 16.664953][ T319] ? ipmr_device_event+0x3d/0x1b0 [ 16.665131][ T319] notifier_call_chain+0xcd/0x150 [ 16.665295][ T319] blocking_notifier_call_chain+0x66/0x90 [ 16.665467][ T319] unregister_netdevice_many_notify+0xa7b/0x1580 [ 16.665683][ T319] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 16.665893][ T319] ? default_device_exit_batch+0x81/0x2e0 [ 16.666064][ T319] ? rtnl_is_locked+0x15/0x20 [ 16.666234][ T319] ? unregister_netdevice_queue+0x70/0x410 [ 16.666442][ T319] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 16.666653][ T319] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 16.666846][ T319] default_device_exit_batch+0x241/0x2e0 [ 16.667001][ T319] ? __pfx_default_device_exit_batch+0x10/0x10 [ 16.667194][ T319] ? mutex_is_locked+0x1c/0x60 [ 16.667351][ T319] ? nexthop_net_exit_batch_rtnl+0x83/0x210 [ 16.667564][ T319] cleanup_net+0x4ef/0xa50 [ 16.667738][ T319] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 16.667910][ T319] ? __pfx_cleanup_net+0x10/0x10 [ 16.668070][ T319] ? trace_lock_acquire+0x14c/0x1f0 [ 16.668240][ T319] ? lock_acquire+0x32/0xc0 [ 16.668396][ T319] ? process_one_work+0xe0b/0x16d0 [ 16.668563][ T319] process_one_work+0xe55/0x16d0 [ 16.668724][ T319] ? __pfx___lock_release+0x10/0x10 [ 16.668885][ T319] ? __pfx_process_one_work+0x10/0x10 [ 16.669053][ T319] ? assign_work+0x16c/0x240 [ 16.669213][ T319] worker_thread+0x58c/0xce0 [ 16.669371][ T319] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 16.669567][ T319] ? __pfx_worker_thread+0x10/0x10 [ 16.669747][ T319] ? __pfx_worker_thread+0x10/0x10 [ 16.669914][ T319] kthread+0x28a/0x350 [ 16.670036][ T319] ? __pfx_kthread+0x10/0x10 [ 16.670204][ T319] ret_from_fork+0x31/0x70 [ 16.670379][ T319] ? __pfx_kthread+0x10/0x10 [ 16.670547][ T319] ret_from_fork_asm+0x1a/0x30 [ 16.670738][ T319] [ 16.672701][ T319] bond0: (slave veth1): Releasing backup interface