[ 13.919185][ T319] ip (319) used greatest stack depth: 23664 bytes left [ 14.185710][ T326] ip (326) used greatest stack depth: 23592 bytes left [ 16.649701][ T358] br0: port 1(gw_l) entered blocking state [ 16.650207][ T358] br0: port 1(gw_l) entered disabled state [ 16.650486][ T358] gw_l: entered allmulticast mode [ 16.651752][ T358] gw_l: entered promiscuous mode [ 16.653610][ T358] br0: port 1(gw_l) entered blocking state [ 16.653903][ T358] br0: port 1(gw_l) entered forwarding state [ 17.040386][ T360] br0: port 2(amtg) entered blocking state [ 17.040870][ T360] br0: port 2(amtg) entered disabled state [ 17.041149][ T360] amtg: entered allmulticast mode [ 17.042495][ T360] amtg: entered promiscuous mode [ 18.483438][ T371] br0: port 2(amtg) entered blocking state [ 18.483950][ T371] br0: port 2(amtg) entered forwarding state [ 19.324719][ T378] amtr: entered allmulticast mode [ 19.325160][ T378] relay_gw: entered allmulticast mode [ 19.325435][ T378] relay_src: entered allmulticast mode [ 1191.490405][ T11] br0: port 1(gw_l) entered disabled state [ 1191.568913][ T11] gw_l (unregistering): left allmulticast mode [ 1191.569331][ T11] gw_l (unregistering): left promiscuous mode [ 1191.569567][ T11] br0: port 1(gw_l) entered disabled state [ 1191.570692][ T11] [ 1191.570806][ T11] ============================================ [ 1191.571004][ T11] WARNING: possible recursive locking detected [ 1191.571199][ T11] 6.13.0-rc5-virtme #1 Not tainted [ 1191.571357][ T11] -------------------------------------------- [ 1191.571549][ T11] kworker/u16:0/11 is trying to acquire lock: [ 1191.571743][ T11] ffffffffb0df6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 1191.572067][ T11] [ 1191.572067][ T11] but task is already holding lock: [ 1191.572310][ T11] ffffffffb0df6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 1191.572625][ T11] [ 1191.572625][ T11] other info that might help us debug this: [ 1191.572859][ T11] Possible unsafe locking scenario: [ 1191.572859][ T11] [ 1191.573087][ T11] CPU0 [ 1191.573205][ T11] ---- [ 1191.573324][ T11] lock((netdev_chain).rwsem); [ 1191.573482][ T11] lock((netdev_chain).rwsem); [ 1191.573640][ T11] [ 1191.573640][ T11] *** DEADLOCK *** [ 1191.573640][ T11] [ 1191.573872][ T11] May be due to missing lock nesting notation [ 1191.573872][ T11] [ 1191.574106][ T11] 5 locks held by kworker/u16:0/11: [ 1191.574265][ T11] #0: ffff8880010b5948 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0x7ec/0x16d0 [ 1191.574592][ T11] #1: ffffc900000b7da0 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xe0b/0x16d0 [ 1191.574869][ T11] #2: ffffffffb0dec4d0 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xbc/0xba0 [ 1191.575157][ T11] #3: ffffffffb0e07e88 (rtnl_mutex){+.+.}-{4:4}, at: default_device_exit_batch+0x81/0x2e0 [ 1191.575473][ T11] #4: ffffffffb0df6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 1191.575796][ T11] [ 1191.575796][ T11] stack backtrace: [ 1191.576007][ T11] CPU: 2 UID: 0 PID: 11 Comm: kworker/u16:0 Not tainted 6.13.0-rc5-virtme #1 [ 1191.576278][ T11] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 1191.576471][ T11] Workqueue: netns cleanup_net [ 1191.576637][ T11] Call Trace: [ 1191.576753][ T11] [ 1191.576836][ T11] dump_stack_lvl+0x82/0xd0 [ 1191.576998][ T11] print_deadlock_bug+0x40a/0x650 [ 1191.577154][ T11] validate_chain+0x5bf/0xae0 [ 1191.577315][ T11] ? __pfx_validate_chain+0x10/0x10 [ 1191.577471][ T11] ? hlock_class+0x4e/0x130 [ 1191.577622][ T11] ? mark_lock+0x38/0x3e0 [ 1191.577739][ T11] __lock_acquire+0xb9a/0x1680 [ 1191.577900][ T11] lock_acquire.part.0+0xeb/0x330 [ 1191.578061][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 1191.578259][ T11] ? find_held_lock+0x2c/0x110 [ 1191.578413][ T11] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1191.578565][ T11] ? trace_lock_acquire+0x14c/0x1f0 [ 1191.578723][ T11] ? lock_acquire+0x32/0xc0 [ 1191.578876][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 1191.579067][ T11] down_read+0x9f/0x340 [ 1191.579195][ T11] ? blocking_notifier_call_chain+0x50/0x90 [ 1191.579385][ T11] ? __pfx_down_read+0x10/0x10 [ 1191.579534][ T11] ? lockdep_hardirqs_on_prepare+0x12b/0x410 [ 1191.579727][ T11] blocking_notifier_call_chain+0x50/0x90 [ 1191.579886][ T11] __netdev_upper_dev_unlink+0xd9/0x220 [ 1191.580040][ T11] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 1191.580231][ T11] ? find_held_lock+0x2c/0x110 [ 1191.580384][ T11] ? del_nbp+0x377/0xbe0 [ 1191.580503][ T11] ? hlock_class+0x4e/0x130 [ 1191.580655][ T11] netdev_upper_dev_unlink+0x71/0xa0 [ 1191.580807][ T11] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 1191.581000][ T11] ? mutex_is_locked+0x12/0x60 [ 1191.581155][ T11] ? rtnl_is_locked+0x15/0x20 [ 1191.581313][ T11] del_nbp+0x602/0xbe0 [ 1191.581435][ T11] br_del_if+0xa3/0x1f0 [ 1191.581552][ T11] br_device_event+0x53d/0x800 [ 1191.581708][ T11] ? __pfx_br_device_event+0x10/0x10 [ 1191.581863][ T11] ? packet_notifier+0x3b0/0x810 [ 1191.582021][ T11] notifier_call_chain+0xcd/0x150 [ 1191.582178][ T11] blocking_notifier_call_chain+0x66/0x90 [ 1191.582340][ T11] unregister_netdevice_many_notify+0xa83/0x1580 [ 1191.582531][ T11] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 1191.582728][ T11] ? default_device_exit_batch+0x81/0x2e0 [ 1191.582885][ T11] ? rtnl_is_locked+0x15/0x20 [ 1191.583040][ T11] ? unregister_netdevice_queue+0x70/0x410 [ 1191.583226][ T11] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 1191.583424][ T11] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 1191.583612][ T11] default_device_exit_batch+0x241/0x2e0 [ 1191.583768][ T11] ? __pfx_default_device_exit_batch+0x10/0x10 [ 1191.583958][ T11] ? ops_exit_list+0xb4/0x170 [ 1191.584114][ T11] cleanup_net+0x4ef/0xba0 [ 1191.584263][ T11] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 1191.584415][ T11] ? __pfx_cleanup_net+0x10/0x10 [ 1191.584566][ T11] ? trace_lock_acquire+0x14c/0x1f0 [ 1191.584721][ T11] ? lock_acquire+0x32/0xc0 [ 1191.584870][ T11] ? process_one_work+0xe0b/0x16d0 [ 1191.585025][ T11] process_one_work+0xe55/0x16d0 [ 1191.585179][ T11] ? __pfx___lock_release+0x10/0x10 [ 1191.585335][ T11] ? __pfx_process_one_work+0x10/0x10 [ 1191.585489][ T11] ? assign_work+0x16c/0x240 [ 1191.585650][ T11] worker_thread+0x58c/0xce0 [ 1191.585808][ T11] ? __pfx_worker_thread+0x10/0x10 [ 1191.585970][ T11] kthread+0x28a/0x350 [ 1191.586089][ T11] ? __pfx_kthread+0x10/0x10 [ 1191.586240][ T11] ret_from_fork+0x31/0x70 [ 1191.586403][ T11] ? __pfx_kthread+0x10/0x10 [ 1191.586559][ T11] ret_from_fork_asm+0x1a/0x30 [ 1191.586722][ T11] [ 1191.624506][ T11] amtg: left allmulticast mode [ 1191.624724][ T11] amtg: left promiscuous mode [ 1191.625004][ T11] br0: port 2(amtg) entered disabled state [ 1191.768350][ T11] relay_gw (unregistering): left allmulticast mode [ 1191.785588][ T11] amtr (unregistering): left allmulticast mode