[ 13.458593][ T277] fab-br0: port 1(fbond) entered blocking state [ 13.459402][ T277] fab-br0: port 1(fbond) entered disabled state [ 13.459864][ T277] fbond: entered allmulticast mode [ 13.461633][ T277] fbond: entered promiscuous mode [ 13.582167][ T279] veth1-bond: entered promiscuous mode [ 13.582651][ T279] veth1-bond: entered allmulticast mode [ 13.584772][ T279] [ 13.584910][ T279] ============================================ [ 13.585232][ T279] WARNING: possible recursive locking detected [ 13.585546][ T279] 6.13.0-rc5-virtme #1 Not tainted [ 13.585787][ T279] -------------------------------------------- [ 13.586087][ T279] ip/279 is trying to acquire lock: [ 13.586328][ T279] ffffffffa03f0a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 13.586742][ T279] [ 13.586742][ T279] but task is already holding lock: [ 13.586984][ T279] ffffffffa03f0a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 13.587313][ T279] [ 13.587313][ T279] other info that might help us debug this: [ 13.587564][ T279] Possible unsafe locking scenario: [ 13.587564][ T279] [ 13.587812][ T279] CPU0 [ 13.587934][ T279] ---- [ 13.588056][ T279] lock((netdev_chain).rwsem); [ 13.588218][ T279] lock((netdev_chain).rwsem); [ 13.588378][ T279] [ 13.588378][ T279] *** DEADLOCK *** [ 13.588378][ T279] [ 13.588626][ T279] May be due to missing lock nesting notation [ 13.588626][ T279] [ 13.588877][ T279] 2 locks held by ip/279: [ 13.589004][ T279] #0: ffffffffa0401dc8 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x653/0xa70 [ 13.589307][ T279] #1: ffffffffa03f0a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 13.589650][ T279] [ 13.589650][ T279] stack backtrace: [ 13.589851][ T279] CPU: 2 UID: 0 PID: 279 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 13.590110][ T279] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 13.590334][ T279] Call Trace: [ 13.590461][ T279] [ 13.590547][ T279] dump_stack_lvl+0x82/0xd0 [ 13.590777][ T279] print_deadlock_bug+0x40a/0x650 [ 13.590941][ T279] validate_chain+0x5bf/0xae0 [ 13.591107][ T279] ? __pfx_validate_chain+0x10/0x10 [ 13.591274][ T279] ? hlock_class+0x4e/0x130 [ 13.591463][ T279] ? mark_lock+0x38/0x3e0 [ 13.591599][ T279] __lock_acquire+0xb9a/0x1680 [ 13.591800][ T279] lock_acquire.part.0+0xeb/0x330 [ 13.591976][ T279] ? blocking_notifier_call_chain+0x50/0x90 [ 13.592198][ T279] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 13.592383][ T279] ? trace_lock_acquire+0x14c/0x1f0 [ 13.592558][ T279] ? lock_acquire+0x32/0xc0 [ 13.592731][ T279] ? blocking_notifier_call_chain+0x50/0x90 [ 13.592955][ T279] down_read+0x9f/0x340 [ 13.593087][ T279] ? blocking_notifier_call_chain+0x50/0x90 [ 13.593302][ T279] ? __pfx_down_read+0x10/0x10 [ 13.593487][ T279] blocking_notifier_call_chain+0x50/0x90 [ 13.593662][ T279] netdev_update_features+0xb0/0xc0 [ 13.593836][ T279] ? __pfx_netdev_update_features+0x10/0x10 [ 13.594052][ T279] br_device_event+0x549/0x700 [ 13.594231][ T279] ? __pfx_br_device_event+0x10/0x10 [ 13.594416][ T279] ? packet_notifier+0x3b0/0x810 [ 13.594589][ T279] notifier_call_chain+0xcd/0x150 [ 13.594765][ T279] blocking_notifier_call_chain+0x66/0x90 [ 13.594943][ T279] netdev_change_features+0x7f/0xb0 [ 13.595162][ T279] ? __pfx_netdev_change_features+0x10/0x10 [ 13.595438][ T279] ? __lock_release+0x103/0x460 [ 13.595692][ T279] ? dev_mc_add+0xc6/0xf0 [ 13.595885][ T279] bond_compute_features+0x4da/0x780 [ 13.596089][ T279] ? mark_held_locks+0x9e/0xe0 [ 13.596310][ T279] ? __pfx_bond_compute_features+0x10/0x10 [ 13.596602][ T279] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 13.596823][ T279] ? dev_mc_add+0xc6/0xf0 [ 13.596955][ T279] ? __local_bh_enable_ip+0xa6/0x120 [ 13.597137][ T279] bond_enslave+0x2a1a/0x51b0 [ 13.597314][ T279] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 13.597514][ T279] ? __pfx_bond_enslave+0x10/0x10 [ 13.597765][ T279] ? is_bpf_text_address+0x67/0x120 [ 13.597949][ T279] ? validate_chain+0x1fe/0xae0 [ 13.598128][ T279] ? __kernel_text_address+0x12/0x40 [ 13.598306][ T279] ? unwind_get_return_address+0x5e/0xa0 [ 13.598490][ T279] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 13.598707][ T279] ? __pfx_validate_chain+0x10/0x10 [ 13.598880][ T279] ? __pfx_validate_linkmsg+0x10/0x10 [ 13.599064][ T279] ? mutex_is_locked+0x1c/0x60 [ 13.599240][ T279] ? rtnl_is_locked+0x15/0x20 [ 13.599418][ T279] ? netdev_master_upper_dev_get+0x13/0x120 [ 13.599639][ T279] do_setlink.constprop.0+0x80e/0x2300 [ 13.599813][ T279] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 13.600033][ T279] ? lock_acquire.part.0+0xeb/0x330 [ 13.600212][ T279] ? rtnl_newlink+0x653/0xa70 [ 13.600388][ T279] ? rtnl_newlink+0xb9/0xa70 [ 13.600562][ T279] ? rtnetlink_rcv_msg+0x712/0xc10 [ 13.600733][ T279] ? __mutex_trylock_common+0xfa/0x260 [ 13.600909][ T279] ? __pfx___mutex_trylock_common+0x10/0x10 [ 13.601132][ T279] ? lock_acquire+0x32/0xc0 [ 13.601308][ T279] ? trace_contention_end+0xef/0x150 [ 13.601504][ T279] ? __mutex_lock+0x190/0xbc0 [ 13.601683][ T279] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 13.601857][ T279] ? rtnl_newlink+0x653/0xa70 [ 13.602039][ T279] ? __pfx___mutex_lock+0x10/0x10 [ 13.602217][ T279] ? __rtnl_newlink+0x3f2/0xa80 [ 13.602395][ T279] rtnl_newlink+0x69c/0xa70 [ 13.602572][ T279] ? __pfx_rtnl_newlink+0x10/0x10 [ 13.602747][ T279] ? find_held_lock+0x2c/0x110 [ 13.602927][ T279] ? __pfx___lock_release+0x10/0x10 [ 13.603102][ T279] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 13.603282][ T279] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 13.603463][ T279] ? __pfx_rtnl_newlink+0x10/0x10 [ 13.603640][ T279] rtnetlink_rcv_msg+0x712/0xc10 [ 13.603816][ T279] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 13.603992][ T279] ? hlock_class+0x4e/0x130 [ 13.604168][ T279] ? mark_lock+0x38/0x3e0 [ 13.604304][ T279] ? __lock_acquire+0xb9a/0x1680 [ 13.604486][ T279] netlink_rcv_skb+0x130/0x360 [ 13.604665][ T279] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 13.604838][ T279] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 13.605016][ T279] ? netlink_deliver_tap+0x13e/0x340 [ 13.605191][ T279] ? netlink_deliver_tap+0xc3/0x340 [ 13.605380][ T279] netlink_unicast+0x44b/0x710 [ 13.605556][ T279] ? __pfx_netlink_unicast+0x10/0x10 [ 13.605730][ T279] ? find_held_lock+0x2c/0x110 [ 13.605908][ T279] netlink_sendmsg+0x723/0xbe0 [ 13.606083][ T279] ? __pfx_netlink_sendmsg+0x10/0x10 [ 13.606261][ T279] ____sys_sendmsg+0x7ac/0xa10 [ 13.606450][ T279] ? __pfx_____sys_sendmsg+0x10/0x10 [ 13.606627][ T279] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 13.606852][ T279] ___sys_sendmsg+0xee/0x170 [ 13.607031][ T279] ? __pfx____sys_sendmsg+0x10/0x10 [ 13.607206][ T279] ? kasan_save_stack+0x34/0x50 [ 13.607384][ T279] ? kasan_save_stack+0x24/0x50 [ 13.607557][ T279] ? __kasan_record_aux_stack+0x8e/0xa0 [ 13.607731][ T279] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 13.607951][ T279] ? __x64_sys_close+0x7c/0xd0 [ 13.608138][ T279] ? do_syscall_64+0xc1/0x1d0 [ 13.608312][ T279] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 13.608529][ T279] ? __lock_acquire+0xb9a/0x1680 [ 13.608710][ T279] ? find_held_lock+0x2c/0x110 [ 13.608886][ T279] ? __lock_release+0x103/0x460 [ 13.609058][ T279] ? __virt_addr_valid+0x22b/0x430 [ 13.609240][ T279] ? __pfx___lock_release+0x10/0x10 [ 13.609419][ T279] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 13.609598][ T279] __sys_sendmsg+0x109/0x1a0 [ 13.609774][ T279] ? __pfx___sys_sendmsg+0x10/0x10 [ 13.609946][ T279] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 13.610171][ T279] do_syscall_64+0xc1/0x1d0 [ 13.610346][ T279] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 13.610564][ T279] RIP: 0033:0x7fad580da9a7 [ 13.610756][ T279] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 13.611373][ T279] RSP: 002b:00007ffc2166cbf8 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 13.611649][ T279] RAX: ffffffffffffffda RBX: 00007ffc2166d320 RCX: 00007fad580da9a7 [ 13.611917][ T279] RDX: 0000000000000000 RSI: 00007ffc2166cc60 RDI: 0000000000000005 [ 13.612189][ T279] RBP: 0000000000000003 R08: 0000000000000003 R09: 0000000000000000 [ 13.612457][ T279] R10: 00000000049ed910 R11: 0000000000000246 R12: 0000000000000003 [ 13.612721][ T279] R13: 000000006779291a R14: 0000000000498600 R15: 0000000000000000 [ 13.612988][ T279] [ 13.613575][ T279] fbond: (slave veth1-bond): Enslaving as a backup interface with a down link [ 13.621366][ T279] ip (279) used greatest stack depth: 23240 bytes left [ 13.680566][ T280] veth2-bond: entered promiscuous mode [ 13.680921][ T280] veth2-bond: entered allmulticast mode [ 13.681351][ T280] fbond: (slave veth2-bond): Enslaving as a backup interface with a down link [ 13.783155][ T11] fbond: Warning: No 802.3ad response from the link partner for any adapters in the bond [ 13.869717][ T283] fab-br0: port 1(fbond) entered blocking state [ 13.869980][ T283] fab-br0: port 1(fbond) entered forwarding state [ 13.878328][ T11] fbond: (slave veth1-bond): link status definitely up, 10000 Mbps full duplex [ 13.878785][ T11] fbond: (slave veth2-bond): link status definitely up, 10000 Mbps full duplex [ 13.879042][ T11] fbond: active interface up! [ 16.228732][ T333] fbond: left allmulticast mode [ 16.228940][ T333] veth1-bond: left allmulticast mode [ 16.229260][ T333] veth2-bond: left allmulticast mode [ 16.229444][ T333] fbond: left promiscuous mode [ 16.229590][ T333] veth1-bond: left promiscuous mode [ 16.229900][ T333] veth2-bond: left promiscuous mode [ 16.230318][ T333] fab-br0: port 1(fbond) entered disabled state [ 16.507075][ T334] fbond (unregistering): (slave veth1-bond): Removing an active aggregator [ 16.507804][ T334] fbond (unregistering): (slave veth1-bond): Releasing backup interface [ 16.525509][ T334] fbond (unregistering): (slave veth2-bond): Removing an active aggregator [ 16.526108][ T334] fbond (unregistering): (slave veth2-bond): Releasing backup interface [ 16.550326][ T334] fbond (unregistering): Released all slaves