[ 12.330275][ T277] fab-br0: port 1(fbond) entered blocking state [ 12.331121][ T277] fab-br0: port 1(fbond) entered disabled state [ 12.331611][ T277] fbond: entered allmulticast mode [ 12.333563][ T277] fbond: entered promiscuous mode [ 12.463022][ T280] veth1-bond: entered promiscuous mode [ 12.463514][ T280] veth1-bond: entered allmulticast mode [ 12.464500][ T280] [ 12.464608][ T280] ============================================ [ 12.464853][ T280] WARNING: possible recursive locking detected [ 12.465076][ T280] 6.13.0-rc5-virtme #1 Not tainted [ 12.465267][ T280] -------------------------------------------- [ 12.465502][ T280] ip/280 is trying to acquire lock: [ 12.465690][ T280] ffffffff8a9f0a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 12.466072][ T280] [ 12.466072][ T280] but task is already holding lock: [ 12.466338][ T280] ffffffff8a9f0a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 12.466717][ T280] [ 12.466717][ T280] other info that might help us debug this: [ 12.466988][ T280] Possible unsafe locking scenario: [ 12.466988][ T280] [ 12.467257][ T280] CPU0 [ 12.467399][ T280] ---- [ 12.467541][ T280] lock((netdev_chain).rwsem); [ 12.467734][ T280] lock((netdev_chain).rwsem); [ 12.467921][ T280] [ 12.467921][ T280] *** DEADLOCK *** [ 12.467921][ T280] [ 12.468191][ T280] May be due to missing lock nesting notation [ 12.468191][ T280] [ 12.468471][ T280] 2 locks held by ip/280: [ 12.468614][ T280] #0: ffffffff8aa01dc8 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x653/0xa70 [ 12.468961][ T280] #1: ffffffff8a9f0a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 12.469333][ T280] [ 12.469333][ T280] stack backtrace: [ 12.469559][ T280] CPU: 3 UID: 0 PID: 280 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 12.469837][ T280] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 12.470086][ T280] Call Trace: [ 12.470223][ T280] [ 12.470321][ T280] dump_stack_lvl+0x82/0xd0 [ 12.470511][ T280] print_deadlock_bug+0x40a/0x650 [ 12.470700][ T280] validate_chain+0x5bf/0xae0 [ 12.470890][ T280] ? __pfx_validate_chain+0x10/0x10 [ 12.471087][ T280] ? hlock_class+0x4e/0x130 [ 12.471277][ T280] ? mark_lock+0x38/0x3e0 [ 12.471403][ T280] __lock_acquire+0xb9a/0x1680 [ 12.471584][ T280] lock_acquire.part.0+0xeb/0x330 [ 12.471761][ T280] ? blocking_notifier_call_chain+0x50/0x90 [ 12.471980][ T280] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 12.472157][ T280] ? trace_lock_acquire+0x14c/0x1f0 [ 12.472334][ T280] ? lock_acquire+0x32/0xc0 [ 12.472519][ T280] ? blocking_notifier_call_chain+0x50/0x90 [ 12.472738][ T280] down_read+0x9f/0x340 [ 12.472870][ T280] ? blocking_notifier_call_chain+0x50/0x90 [ 12.473091][ T280] ? __pfx_down_read+0x10/0x10 [ 12.473270][ T280] blocking_notifier_call_chain+0x50/0x90 [ 12.473441][ T280] netdev_update_features+0xb0/0xc0 [ 12.473620][ T280] ? __pfx_netdev_update_features+0x10/0x10 [ 12.473838][ T280] br_device_event+0x549/0x700 [ 12.474007][ T280] ? __pfx_br_device_event+0x10/0x10 [ 12.474178][ T280] ? packet_notifier+0x3b0/0x810 [ 12.474351][ T280] notifier_call_chain+0xcd/0x150 [ 12.474527][ T280] blocking_notifier_call_chain+0x66/0x90 [ 12.474701][ T280] netdev_change_features+0x7f/0xb0 [ 12.474865][ T280] ? __pfx_netdev_change_features+0x10/0x10 [ 12.475067][ T280] ? __lock_release+0x103/0x460 [ 12.475232][ T280] ? dev_mc_add+0xc6/0xf0 [ 12.475357][ T280] bond_compute_features+0x4da/0x780 [ 12.475530][ T280] ? mark_held_locks+0x9e/0xe0 [ 12.475702][ T280] ? __pfx_bond_compute_features+0x10/0x10 [ 12.475917][ T280] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 12.476142][ T280] ? dev_mc_add+0xc6/0xf0 [ 12.476276][ T280] ? __local_bh_enable_ip+0xa6/0x120 [ 12.476507][ T280] bond_enslave+0x2a1a/0x51b0 [ 12.476690][ T280] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 12.476866][ T280] ? __pfx_bond_enslave+0x10/0x10 [ 12.477044][ T280] ? is_bpf_text_address+0x67/0x120 [ 12.477217][ T280] ? validate_chain+0x1fe/0xae0 [ 12.477397][ T280] ? __kernel_text_address+0x12/0x40 [ 12.477572][ T280] ? unwind_get_return_address+0x5e/0xa0 [ 12.477751][ T280] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 12.477965][ T280] ? __pfx_validate_chain+0x10/0x10 [ 12.478141][ T280] ? __pfx_validate_linkmsg+0x10/0x10 [ 12.478318][ T280] ? mutex_is_locked+0x1c/0x60 [ 12.478495][ T280] ? rtnl_is_locked+0x15/0x20 [ 12.478666][ T280] ? netdev_master_upper_dev_get+0x13/0x120 [ 12.478885][ T280] do_setlink.constprop.0+0x80e/0x2300 [ 12.479059][ T280] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 12.479272][ T280] ? lock_acquire.part.0+0xeb/0x330 [ 12.479440][ T280] ? rtnl_newlink+0x653/0xa70 [ 12.479613][ T280] ? rtnl_newlink+0xb9/0xa70 [ 12.479786][ T280] ? rtnetlink_rcv_msg+0x712/0xc10 [ 12.479970][ T280] ? __mutex_trylock_common+0xfa/0x260 [ 12.480149][ T280] ? __pfx___mutex_trylock_common+0x10/0x10 [ 12.480359][ T280] ? lock_acquire+0x32/0xc0 [ 12.480528][ T280] ? trace_contention_end+0xef/0x150 [ 12.480696][ T280] ? __mutex_lock+0x190/0xbc0 [ 12.480871][ T280] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 12.481039][ T280] ? rtnl_newlink+0x653/0xa70 [ 12.481207][ T280] ? __pfx___mutex_lock+0x10/0x10 [ 12.481381][ T280] ? __rtnl_newlink+0x3f2/0xa80 [ 12.481551][ T280] rtnl_newlink+0x69c/0xa70 [ 12.481722][ T280] ? __pfx_rtnl_newlink+0x10/0x10 [ 12.481897][ T280] ? find_held_lock+0x2c/0x110 [ 12.482062][ T280] ? __pfx___lock_release+0x10/0x10 [ 12.482234][ T280] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 12.482406][ T280] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 12.482587][ T280] ? __pfx_rtnl_newlink+0x10/0x10 [ 12.482758][ T280] rtnetlink_rcv_msg+0x712/0xc10 [ 12.482928][ T280] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 12.483095][ T280] ? hlock_class+0x4e/0x130 [ 12.483267][ T280] ? mark_lock+0x38/0x3e0 [ 12.483396][ T280] ? __lock_acquire+0xb9a/0x1680 [ 12.483567][ T280] netlink_rcv_skb+0x130/0x360 [ 12.483739][ T280] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 12.483920][ T280] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 12.484094][ T280] ? netlink_deliver_tap+0x13e/0x340 [ 12.484265][ T280] ? netlink_deliver_tap+0xc3/0x340 [ 12.484434][ T280] netlink_unicast+0x44b/0x710 [ 12.484699][ T280] ? __pfx_netlink_unicast+0x10/0x10 [ 12.484971][ T280] ? find_held_lock+0x2c/0x110 [ 12.485322][ T280] netlink_sendmsg+0x723/0xbe0 [ 12.485499][ T280] ? __pfx_netlink_sendmsg+0x10/0x10 [ 12.485674][ T280] ____sys_sendmsg+0x7ac/0xa10 [ 12.485845][ T280] ? __pfx_____sys_sendmsg+0x10/0x10 [ 12.486018][ T280] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 12.486227][ T280] ___sys_sendmsg+0xee/0x170 [ 12.486406][ T280] ? __pfx____sys_sendmsg+0x10/0x10 [ 12.486583][ T280] ? kasan_save_stack+0x34/0x50 [ 12.486758][ T280] ? kasan_save_stack+0x24/0x50 [ 12.486930][ T280] ? __kasan_record_aux_stack+0x8e/0xa0 [ 12.487106][ T280] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 12.487314][ T280] ? __x64_sys_close+0x7c/0xd0 [ 12.487492][ T280] ? do_syscall_64+0xc1/0x1d0 [ 12.487668][ T280] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 12.488062][ T280] ? __lock_acquire+0xb9a/0x1680 [ 12.488324][ T280] ? find_held_lock+0x2c/0x110 [ 12.488506][ T280] ? __lock_release+0x103/0x460 [ 12.488678][ T280] ? __virt_addr_valid+0x22b/0x430 [ 12.488848][ T280] ? __pfx___lock_release+0x10/0x10 [ 12.489020][ T280] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 12.489192][ T280] __sys_sendmsg+0x109/0x1a0 [ 12.489358][ T280] ? __pfx___sys_sendmsg+0x10/0x10 [ 12.489532][ T280] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 12.489748][ T280] do_syscall_64+0xc1/0x1d0 [ 12.490014][ T280] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 12.490225][ T280] RIP: 0033:0x7f3e4d0559a7 [ 12.490409][ T280] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 12.491018][ T280] RSP: 002b:00007ffc7754f4d8 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 12.491267][ T280] RAX: ffffffffffffffda RBX: 00007ffc7754fc00 RCX: 00007f3e4d0559a7 [ 12.491521][ T280] RDX: 0000000000000000 RSI: 00007ffc7754f540 RDI: 0000000000000005 [ 12.491776][ T280] RBP: 0000000000000003 R08: 0000000000000003 R09: 0000000000000000 [ 12.492222][ T280] R10: 0000000014565910 R11: 0000000000000246 R12: 0000000000000003 [ 12.492572][ T280] R13: 0000000067790365 R14: 0000000000498600 R15: 0000000000000000 [ 12.493029][ T280] [ 12.495738][ T280] fbond: (slave veth1-bond): Enslaving as a backup interface with a down link [ 12.514672][ T280] ip (280) used greatest stack depth: 23016 bytes left [ 12.588830][ T281] veth2-bond: entered promiscuous mode [ 12.589216][ T281] veth2-bond: entered allmulticast mode [ 12.589648][ T281] fbond: (slave veth2-bond): Enslaving as a backup interface with a down link [ 12.671875][ T11] fbond: Warning: No 802.3ad response from the link partner for any adapters in the bond [ 12.673262][ T11] fbond: (slave veth1-bond): link status definitely up, 10000 Mbps full duplex [ 12.673583][ T11] fbond: active interface up! [ 12.775625][ T285] fab-br0: port 1(fbond) entered blocking state [ 12.775918][ T285] fab-br0: port 1(fbond) entered forwarding state [ 12.878102][ T284] fbond: (slave veth2-bond): link status definitely up, 10000 Mbps full duplex [ 15.042087][ T334] fbond: left allmulticast mode [ 15.042280][ T334] veth1-bond: left allmulticast mode [ 15.042440][ T334] veth2-bond: left allmulticast mode [ 15.042595][ T334] fbond: left promiscuous mode [ 15.042746][ T334] veth1-bond: left promiscuous mode [ 15.043632][ T334] veth2-bond: left promiscuous mode [ 15.044058][ T334] fab-br0: port 1(fbond) entered disabled state [ 15.339952][ T335] fbond (unregistering): (slave veth1-bond): Removing an active aggregator [ 15.340646][ T335] fbond (unregistering): (slave veth1-bond): Releasing backup interface [ 15.358128][ T335] fbond (unregistering): (slave veth2-bond): Removing an active aggregator [ 15.358918][ T335] fbond (unregistering): (slave veth2-bond): Releasing backup interface [ 15.382664][ T335] fbond (unregistering): Released all slaves