[ 13.015020][ T270] ip (270) used greatest stack depth: 23120 bytes left [ 13.273508][ T276] fab-br0: port 1(fbond) entered blocking state [ 13.273992][ T276] fab-br0: port 1(fbond) entered disabled state [ 13.274434][ T276] fbond: entered allmulticast mode [ 13.276578][ T276] fbond: entered promiscuous mode [ 13.478738][ T279] veth1-bond: entered promiscuous mode [ 13.479187][ T279] veth1-bond: entered allmulticast mode [ 13.479995][ T279] [ 13.480105][ T279] ============================================ [ 13.480321][ T279] WARNING: possible recursive locking detected [ 13.480528][ T279] 6.13.0-rc5-virtme #1 Not tainted [ 13.480698][ T279] -------------------------------------------- [ 13.480914][ T279] ip/279 is trying to acquire lock: [ 13.481077][ T279] ffffffffae3f0a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 13.481431][ T279] [ 13.481431][ T279] but task is already holding lock: [ 13.481669][ T279] ffffffffae3f0a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 13.481981][ T279] [ 13.481981][ T279] other info that might help us debug this: [ 13.482210][ T279] Possible unsafe locking scenario: [ 13.482210][ T279] [ 13.482446][ T279] CPU0 [ 13.482570][ T279] ---- [ 13.482699][ T279] lock((netdev_chain).rwsem); [ 13.482874][ T279] lock((netdev_chain).rwsem); [ 13.483031][ T279] [ 13.483031][ T279] *** DEADLOCK *** [ 13.483031][ T279] [ 13.483256][ T279] May be due to missing lock nesting notation [ 13.483256][ T279] [ 13.483492][ T279] 2 locks held by ip/279: [ 13.483621][ T279] #0: ffffffffae401dc8 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x653/0xa70 [ 13.483925][ T279] #1: ffffffffae3f0a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 13.484261][ T279] [ 13.484261][ T279] stack backtrace: [ 13.484466][ T279] CPU: 0 UID: 0 PID: 279 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 13.484723][ T279] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 13.484934][ T279] Call Trace: [ 13.485063][ T279] [ 13.485160][ T279] dump_stack_lvl+0x82/0xd0 [ 13.485357][ T279] print_deadlock_bug+0x40a/0x650 [ 13.485527][ T279] validate_chain+0x5bf/0xae0 [ 13.485691][ T279] ? __pfx_validate_chain+0x10/0x10 [ 13.485863][ T279] ? hlock_class+0x4e/0x130 [ 13.486042][ T279] ? mark_lock+0x38/0x3e0 [ 13.486175][ T279] __lock_acquire+0xb9a/0x1680 [ 13.486360][ T279] lock_acquire.part.0+0xeb/0x330 [ 13.486539][ T279] ? blocking_notifier_call_chain+0x50/0x90 [ 13.486806][ T279] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 13.486994][ T279] ? trace_lock_acquire+0x14c/0x1f0 [ 13.487166][ T279] ? lock_acquire+0x32/0xc0 [ 13.487346][ T279] ? blocking_notifier_call_chain+0x50/0x90 [ 13.487575][ T279] down_read+0x9f/0x340 [ 13.487715][ T279] ? blocking_notifier_call_chain+0x50/0x90 [ 13.487931][ T279] ? __pfx_down_read+0x10/0x10 [ 13.488117][ T279] blocking_notifier_call_chain+0x50/0x90 [ 13.488308][ T279] netdev_update_features+0xb0/0xc0 [ 13.488493][ T279] ? __pfx_netdev_update_features+0x10/0x10 [ 13.488747][ T279] br_device_event+0x549/0x700 [ 13.488934][ T279] ? __pfx_br_device_event+0x10/0x10 [ 13.489108][ T279] ? packet_notifier+0x3b0/0x810 [ 13.489321][ T279] notifier_call_chain+0xcd/0x150 [ 13.489514][ T279] blocking_notifier_call_chain+0x66/0x90 [ 13.489708][ T279] netdev_change_features+0x7f/0xb0 [ 13.489885][ T279] ? __pfx_netdev_change_features+0x10/0x10 [ 13.490093][ T279] ? __lock_release+0x103/0x460 [ 13.490270][ T279] ? dev_mc_add+0xc6/0xf0 [ 13.490397][ T279] bond_compute_features+0x4da/0x780 [ 13.490566][ T279] ? mark_held_locks+0x9e/0xe0 [ 13.490736][ T279] ? __pfx_bond_compute_features+0x10/0x10 [ 13.490945][ T279] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 13.491133][ T279] ? dev_mc_add+0xc6/0xf0 [ 13.491255][ T279] ? __local_bh_enable_ip+0xa6/0x120 [ 13.491415][ T279] bond_enslave+0x2a1a/0x51b0 [ 13.491578][ T279] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 13.491738][ T279] ? __pfx_bond_enslave+0x10/0x10 [ 13.491894][ T279] ? is_bpf_text_address+0x67/0x120 [ 13.492149][ T279] ? validate_chain+0x1fe/0xae0 [ 13.492307][ T279] ? __kernel_text_address+0x12/0x40 [ 13.492460][ T279] ? unwind_get_return_address+0x5e/0xa0 [ 13.492611][ T279] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 13.492891][ T279] ? __pfx_validate_chain+0x10/0x10 [ 13.493039][ T279] ? __pfx_validate_linkmsg+0x10/0x10 [ 13.493194][ T279] ? mutex_is_locked+0x1c/0x60 [ 13.493345][ T279] ? rtnl_is_locked+0x15/0x20 [ 13.493585][ T279] ? netdev_master_upper_dev_get+0x13/0x120 [ 13.493773][ T279] do_setlink.constprop.0+0x80e/0x2300 [ 13.493929][ T279] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 13.494199][ T279] ? lock_acquire.part.0+0xeb/0x330 [ 13.494348][ T279] ? rtnl_newlink+0x653/0xa70 [ 13.494500][ T279] ? rtnl_newlink+0xb9/0xa70 [ 13.494647][ T279] ? rtnetlink_rcv_msg+0x712/0xc10 [ 13.494901][ T279] ? __mutex_trylock_common+0xfa/0x260 [ 13.495052][ T279] ? __pfx___mutex_trylock_common+0x10/0x10 [ 13.495239][ T279] ? lock_acquire+0x32/0xc0 [ 13.495388][ T279] ? trace_contention_end+0xef/0x150 [ 13.495541][ T279] ? __mutex_lock+0x190/0xbc0 [ 13.495695][ T279] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 13.495848][ T279] ? rtnl_newlink+0x653/0xa70 [ 13.495999][ T279] ? __pfx___mutex_lock+0x10/0x10 [ 13.496239][ T279] ? __rtnl_newlink+0x3f2/0xa80 [ 13.496387][ T279] rtnl_newlink+0x69c/0xa70 [ 13.496538][ T279] ? __pfx_rtnl_newlink+0x10/0x10 [ 13.496696][ T279] ? find_held_lock+0x2c/0x110 [ 13.496952][ T279] ? __pfx___lock_release+0x10/0x10 [ 13.497110][ T279] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 13.497259][ T279] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 13.497410][ T279] ? __pfx_rtnl_newlink+0x10/0x10 [ 13.497662][ T279] rtnetlink_rcv_msg+0x712/0xc10 [ 13.497825][ T279] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 13.497993][ T279] ? hlock_class+0x4e/0x130 [ 13.498165][ T279] ? mark_lock+0x38/0x3e0 [ 13.498384][ T279] ? __lock_acquire+0xb9a/0x1680 [ 13.498547][ T279] netlink_rcv_skb+0x130/0x360 [ 13.498714][ T279] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 13.498889][ T279] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 13.499152][ T279] ? netlink_deliver_tap+0x13e/0x340 [ 13.499318][ T279] ? netlink_deliver_tap+0xc3/0x340 [ 13.499494][ T279] netlink_unicast+0x44b/0x710 [ 13.499672][ T279] ? __pfx_netlink_unicast+0x10/0x10 [ 13.499922][ T279] ? find_held_lock+0x2c/0x110 [ 13.500073][ T279] netlink_sendmsg+0x723/0xbe0 [ 13.500233][ T279] ? __pfx_netlink_sendmsg+0x10/0x10 [ 13.500401][ T279] ____sys_sendmsg+0x7ac/0xa10 [ 13.500641][ T279] ? __pfx_____sys_sendmsg+0x10/0x10 [ 13.500803][ T279] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 13.501007][ T279] ___sys_sendmsg+0xee/0x170 [ 13.501166][ T279] ? __pfx____sys_sendmsg+0x10/0x10 [ 13.501419][ T279] ? kasan_save_stack+0x34/0x50 [ 13.501570][ T279] ? kasan_save_stack+0x24/0x50 [ 13.501727][ T279] ? __kasan_record_aux_stack+0x8e/0xa0 [ 13.501884][ T279] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 13.502172][ T279] ? __x64_sys_close+0x7c/0xd0 [ 13.502323][ T279] ? do_syscall_64+0xc1/0x1d0 [ 13.502488][ T279] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 13.502778][ T279] ? __lock_acquire+0xb9a/0x1680 [ 13.502931][ T279] ? find_held_lock+0x2c/0x110 [ 13.503091][ T279] ? __lock_release+0x103/0x460 [ 13.503247][ T279] ? __virt_addr_valid+0x22b/0x430 [ 13.503414][ T279] ? __pfx___lock_release+0x10/0x10 [ 13.503562][ T279] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 13.503717][ T279] __sys_sendmsg+0x109/0x1a0 [ 13.503882][ T279] ? __pfx___sys_sendmsg+0x10/0x10 [ 13.504043][ T279] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 13.504251][ T279] do_syscall_64+0xc1/0x1d0 [ 13.504407][ T279] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 13.504605][ T279] RIP: 0033:0x7fa2b02de9a7 [ 13.504870][ T279] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 13.505423][ T279] RSP: 002b:00007ffc2be79128 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 13.505671][ T279] RAX: ffffffffffffffda RBX: 00007ffc2be79850 RCX: 00007fa2b02de9a7 [ 13.505899][ T279] RDX: 0000000000000000 RSI: 00007ffc2be79190 RDI: 0000000000000005 [ 13.506217][ T279] RBP: 0000000000000003 R08: 0000000000000003 R09: 0000000000000000 [ 13.506456][ T279] R10: 0000000014e24910 R11: 0000000000000246 R12: 0000000000000003 [ 13.506687][ T279] R13: 000000006779541a R14: 0000000000498600 R15: 0000000000000000 [ 13.507020][ T279] [ 13.507596][ T279] fbond: (slave veth1-bond): Enslaving as a backup interface with a down link [ 13.583233][ T280] veth2-bond: entered promiscuous mode [ 13.583698][ T280] veth2-bond: entered allmulticast mode [ 13.584191][ T280] fbond: (slave veth2-bond): Enslaving as a backup interface with a down link [ 13.685444][ T69] fbond: Warning: No 802.3ad response from the link partner for any adapters in the bond [ 13.773680][ T69] fbond: (slave veth1-bond): link status definitely up, 10000 Mbps full duplex [ 13.774282][ T69] fbond: (slave veth2-bond): link status definitely up, 10000 Mbps full duplex [ 13.774618][ T69] fbond: active interface up! [ 13.805170][ T283] fab-br0: port 1(fbond) entered blocking state [ 13.805505][ T283] fab-br0: port 1(fbond) entered forwarding state [ 16.160177][ T332] fbond: left allmulticast mode [ 16.160364][ T332] veth1-bond: left allmulticast mode [ 16.161142][ T332] veth2-bond: left allmulticast mode [ 16.161288][ T332] fbond: left promiscuous mode [ 16.161448][ T332] veth1-bond: left promiscuous mode [ 16.161769][ T332] veth2-bond: left promiscuous mode [ 16.162178][ T332] fab-br0: port 1(fbond) entered disabled state [ 16.435370][ T333] fbond (unregistering): (slave veth1-bond): Removing an active aggregator [ 16.436014][ T333] fbond (unregistering): (slave veth1-bond): Releasing backup interface [ 16.449659][ T333] fbond (unregistering): (slave veth2-bond): Removing an active aggregator [ 16.450258][ T333] fbond (unregistering): (slave veth2-bond): Releasing backup interface [ 16.462101][ T333] fbond (unregistering): Released all slaves