[ 12.837571][ T266] ip (266) used greatest stack depth: 23248 bytes left [ 13.133403][ T277] fab-br0: port 1(fbond) entered blocking state [ 13.133820][ T277] fab-br0: port 1(fbond) entered disabled state [ 13.134194][ T277] fbond: entered allmulticast mode [ 13.135834][ T277] fbond: entered promiscuous mode [ 13.259392][ T280] veth1-bond: entered promiscuous mode [ 13.259809][ T280] veth1-bond: entered allmulticast mode [ 13.261117][ T280] [ 13.261236][ T280] ============================================ [ 13.261453][ T280] WARNING: possible recursive locking detected [ 13.261656][ T280] 6.13.0-rc5-virtme #1 Not tainted [ 13.261805][ T280] -------------------------------------------- [ 13.262008][ T280] ip/280 is trying to acquire lock: [ 13.262159][ T280] ffffffff9edf0a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 13.262483][ T280] [ 13.262483][ T280] but task is already holding lock: [ 13.262701][ T280] ffffffff9edf0a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 13.263006][ T280] [ 13.263006][ T280] other info that might help us debug this: [ 13.263234][ T280] Possible unsafe locking scenario: [ 13.263234][ T280] [ 13.263462][ T280] CPU0 [ 13.263584][ T280] ---- [ 13.263703][ T280] lock((netdev_chain).rwsem); [ 13.263854][ T280] lock((netdev_chain).rwsem); [ 13.264024][ T280] [ 13.264024][ T280] *** DEADLOCK *** [ 13.264024][ T280] [ 13.264245][ T280] May be due to missing lock nesting notation [ 13.264245][ T280] [ 13.264471][ T280] 2 locks held by ip/280: [ 13.264602][ T280] #0: ffffffff9ee01dc8 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x653/0xa70 [ 13.264897][ T280] #1: ffffffff9edf0a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 13.265217][ T280] [ 13.265217][ T280] stack backtrace: [ 13.265412][ T280] CPU: 0 UID: 0 PID: 280 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 13.265655][ T280] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 13.265857][ T280] Call Trace: [ 13.265970][ T280] [ 13.266052][ T280] dump_stack_lvl+0x82/0xd0 [ 13.266215][ T280] print_deadlock_bug+0x40a/0x650 [ 13.266368][ T280] validate_chain+0x5bf/0xae0 [ 13.266518][ T280] ? __pfx_validate_chain+0x10/0x10 [ 13.266676][ T280] ? hlock_class+0x4e/0x130 [ 13.266824][ T280] ? mark_lock+0x38/0x3e0 [ 13.266958][ T280] __lock_acquire+0xb9a/0x1680 [ 13.267120][ T280] lock_acquire.part.0+0xeb/0x330 [ 13.267267][ T280] ? blocking_notifier_call_chain+0x50/0x90 [ 13.267451][ T280] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 13.267601][ T280] ? trace_lock_acquire+0x14c/0x1f0 [ 13.267752][ T280] ? lock_acquire+0x32/0xc0 [ 13.267901][ T280] ? blocking_notifier_call_chain+0x50/0x90 [ 13.268099][ T280] down_read+0x9f/0x340 [ 13.268217][ T280] ? blocking_notifier_call_chain+0x50/0x90 [ 13.268399][ T280] ? __pfx_down_read+0x10/0x10 [ 13.268548][ T280] blocking_notifier_call_chain+0x50/0x90 [ 13.268699][ T280] netdev_update_features+0xb0/0xc0 [ 13.268867][ T280] ? __pfx_netdev_update_features+0x10/0x10 [ 13.269055][ T280] br_device_event+0x549/0x700 [ 13.269207][ T280] ? __pfx_br_device_event+0x10/0x10 [ 13.269370][ T280] ? packet_notifier+0x3b0/0x810 [ 13.269519][ T280] notifier_call_chain+0xcd/0x150 [ 13.269683][ T280] blocking_notifier_call_chain+0x66/0x90 [ 13.269830][ T280] netdev_change_features+0x7f/0xb0 [ 13.269979][ T280] ? __pfx_netdev_change_features+0x10/0x10 [ 13.270172][ T280] ? __lock_release+0x103/0x460 [ 13.270321][ T280] ? dev_mc_add+0xc6/0xf0 [ 13.270433][ T280] bond_compute_features+0x4da/0x780 [ 13.270593][ T280] ? mark_held_locks+0x9e/0xe0 [ 13.270745][ T280] ? __pfx_bond_compute_features+0x10/0x10 [ 13.270927][ T280] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 13.271120][ T280] ? dev_mc_add+0xc6/0xf0 [ 13.271236][ T280] ? __local_bh_enable_ip+0xa6/0x120 [ 13.271390][ T280] bond_enslave+0x2a1a/0x51b0 [ 13.271542][ T280] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 13.271700][ T280] ? __pfx_bond_enslave+0x10/0x10 [ 13.271866][ T280] ? is_bpf_text_address+0x67/0x120 [ 13.272033][ T280] ? validate_chain+0x1fe/0xae0 [ 13.272196][ T280] ? __kernel_text_address+0x12/0x40 [ 13.272343][ T280] ? unwind_get_return_address+0x5e/0xa0 [ 13.272495][ T280] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 13.272687][ T280] ? __pfx_validate_chain+0x10/0x10 [ 13.272834][ T280] ? __pfx_validate_linkmsg+0x10/0x10 [ 13.272983][ T280] ? mutex_is_locked+0x1c/0x60 [ 13.273136][ T280] ? rtnl_is_locked+0x15/0x20 [ 13.273295][ T280] ? netdev_master_upper_dev_get+0x13/0x120 [ 13.273484][ T280] do_setlink.constprop.0+0x80e/0x2300 [ 13.273649][ T280] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 13.273835][ T280] ? lock_acquire.part.0+0xeb/0x330 [ 13.273982][ T280] ? rtnl_newlink+0x653/0xa70 [ 13.274140][ T280] ? rtnl_newlink+0xb9/0xa70 [ 13.274291][ T280] ? rtnetlink_rcv_msg+0x712/0xc10 [ 13.274442][ T280] ? __mutex_trylock_common+0xfa/0x260 [ 13.274601][ T280] ? __pfx___mutex_trylock_common+0x10/0x10 [ 13.274789][ T280] ? lock_acquire+0x32/0xc0 [ 13.274946][ T280] ? trace_contention_end+0xef/0x150 [ 13.275096][ T280] ? __mutex_lock+0x190/0xbc0 [ 13.275252][ T280] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 13.275406][ T280] ? rtnl_newlink+0x653/0xa70 [ 13.275555][ T280] ? __pfx___mutex_lock+0x10/0x10 [ 13.275719][ T280] ? __rtnl_newlink+0x3f2/0xa80 [ 13.275871][ T280] rtnl_newlink+0x69c/0xa70 [ 13.276024][ T280] ? __pfx_rtnl_newlink+0x10/0x10 [ 13.276171][ T280] ? find_held_lock+0x2c/0x110 [ 13.276319][ T280] ? __pfx___lock_release+0x10/0x10 [ 13.276500][ T280] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 13.276655][ T280] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 13.276805][ T280] ? __pfx_rtnl_newlink+0x10/0x10 [ 13.276968][ T280] rtnetlink_rcv_msg+0x712/0xc10 [ 13.277116][ T280] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 13.277265][ T280] ? hlock_class+0x4e/0x130 [ 13.277418][ T280] ? mark_lock+0x38/0x3e0 [ 13.277533][ T280] ? __lock_acquire+0xb9a/0x1680 [ 13.277693][ T280] netlink_rcv_skb+0x130/0x360 [ 13.277844][ T280] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 13.277997][ T280] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 13.278150][ T280] ? netlink_deliver_tap+0x13e/0x340 [ 13.278301][ T280] ? netlink_deliver_tap+0xc3/0x340 [ 13.278449][ T280] netlink_unicast+0x44b/0x710 [ 13.278601][ T280] ? __pfx_netlink_unicast+0x10/0x10 [ 13.278757][ T280] ? find_held_lock+0x2c/0x110 [ 13.278905][ T280] netlink_sendmsg+0x723/0xbe0 [ 13.279055][ T280] ? __pfx_netlink_sendmsg+0x10/0x10 [ 13.279208][ T280] ____sys_sendmsg+0x7ac/0xa10 [ 13.279360][ T280] ? __pfx_____sys_sendmsg+0x10/0x10 [ 13.279508][ T280] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 13.279699][ T280] ___sys_sendmsg+0xee/0x170 [ 13.279856][ T280] ? __pfx____sys_sendmsg+0x10/0x10 [ 13.280013][ T280] ? kasan_save_stack+0x34/0x50 [ 13.280163][ T280] ? kasan_save_stack+0x24/0x50 [ 13.280310][ T280] ? __kasan_record_aux_stack+0x8e/0xa0 [ 13.280465][ T280] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 13.280655][ T280] ? __x64_sys_close+0x7c/0xd0 [ 13.280806][ T280] ? do_syscall_64+0xc1/0x1d0 [ 13.280958][ T280] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 13.281237][ T280] ? __lock_acquire+0xb9a/0x1680 [ 13.281386][ T280] ? find_held_lock+0x2c/0x110 [ 13.281537][ T280] ? __lock_release+0x103/0x460 [ 13.281687][ T280] ? __virt_addr_valid+0x22b/0x430 [ 13.281925][ T280] ? __pfx___lock_release+0x10/0x10 [ 13.282071][ T280] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 13.282225][ T280] __sys_sendmsg+0x109/0x1a0 [ 13.282373][ T280] ? __pfx___sys_sendmsg+0x10/0x10 [ 13.282607][ T280] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 13.282797][ T280] do_syscall_64+0xc1/0x1d0 [ 13.282950][ T280] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 13.283234][ T280] RIP: 0033:0x7f99a654a9a7 [ 13.283390][ T280] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 13.284030][ T280] RSP: 002b:00007ffc984ef138 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 13.284254][ T280] RAX: ffffffffffffffda RBX: 00007ffc984ef860 RCX: 00007f99a654a9a7 [ 13.284476][ T280] RDX: 0000000000000000 RSI: 00007ffc984ef1a0 RDI: 0000000000000005 [ 13.284793][ T280] RBP: 0000000000000003 R08: 0000000000000003 R09: 0000000000000000 [ 13.285013][ T280] R10: 00000000227c7910 R11: 0000000000000246 R12: 0000000000000003 [ 13.285325][ T280] R13: 000000006778ff54 R14: 0000000000498600 R15: 0000000000000000 [ 13.285547][ T280] [ 13.286499][ T280] fbond: (slave veth1-bond): Enslaving as a backup interface with a down link [ 13.305184][ T280] ip (280) used greatest stack depth: 23088 bytes left [ 13.368081][ T281] veth2-bond: entered promiscuous mode [ 13.368447][ T281] veth2-bond: entered allmulticast mode [ 13.368855][ T281] fbond: (slave veth2-bond): Enslaving as a backup interface with a down link [ 13.520338][ T11] fbond: Warning: No 802.3ad response from the link partner for any adapters in the bond [ 13.552752][ T284] fab-br0: port 1(fbond) entered blocking state [ 13.553074][ T284] fab-br0: port 1(fbond) entered forwarding state [ 13.616608][ T11] fbond: (slave veth1-bond): link status definitely up, 10000 Mbps full duplex [ 13.617080][ T11] fbond: (slave veth2-bond): link status definitely up, 10000 Mbps full duplex [ 13.617341][ T11] fbond: active interface up! [ 15.820361][ T333] fbond: left allmulticast mode [ 15.820557][ T333] veth1-bond: left allmulticast mode [ 15.820720][ T333] veth2-bond: left allmulticast mode [ 15.820860][ T333] fbond: left promiscuous mode [ 15.820994][ T333] veth1-bond: left promiscuous mode [ 15.821325][ T333] veth2-bond: left promiscuous mode [ 15.821726][ T333] fab-br0: port 1(fbond) entered disabled state [ 16.132353][ T334] fbond (unregistering): (slave veth1-bond): Removing an active aggregator [ 16.132975][ T334] fbond (unregistering): (slave veth1-bond): Releasing backup interface [ 16.153602][ T334] fbond (unregistering): (slave veth2-bond): Removing an active aggregator [ 16.154218][ T334] fbond (unregistering): (slave veth2-bond): Releasing backup interface [ 16.162141][ T334] fbond (unregistering): Released all slaves