[ 11.844919][ T272] ip (272) used greatest stack depth: 23424 bytes left [ 11.987213][ T276] fab-br0: port 1(fbond) entered blocking state [ 11.987635][ T276] fab-br0: port 1(fbond) entered disabled state [ 11.987987][ T276] fbond: entered allmulticast mode [ 11.989790][ T276] fbond: entered promiscuous mode [ 12.080633][ T278] veth1-bond: entered promiscuous mode [ 12.081013][ T278] veth1-bond: entered allmulticast mode [ 12.081868][ T278] [ 12.081956][ T278] ============================================ [ 12.082143][ T278] WARNING: possible recursive locking detected [ 12.082328][ T278] 6.13.0-rc5-virtme #1 Not tainted [ 12.082481][ T278] -------------------------------------------- [ 12.082663][ T278] ip/278 is trying to acquire lock: [ 12.082809][ T278] ffffffffb0bf0a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 12.083120][ T278] [ 12.083120][ T278] but task is already holding lock: [ 12.083336][ T278] ffffffffb0bf0a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 12.083699][ T278] [ 12.083699][ T278] other info that might help us debug this: [ 12.083918][ T278] Possible unsafe locking scenario: [ 12.083918][ T278] [ 12.084139][ T278] CPU0 [ 12.084249][ T278] ---- [ 12.084361][ T278] lock((netdev_chain).rwsem); [ 12.084513][ T278] lock((netdev_chain).rwsem); [ 12.084665][ T278] [ 12.084665][ T278] *** DEADLOCK *** [ 12.084665][ T278] [ 12.084886][ T278] May be due to missing lock nesting notation [ 12.084886][ T278] [ 12.085110][ T278] 2 locks held by ip/278: [ 12.085225][ T278] #0: ffffffffb0c01dc8 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x653/0xa70 [ 12.085493][ T278] #1: ffffffffb0bf0a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 12.085798][ T278] [ 12.085798][ T278] stack backtrace: [ 12.085985][ T278] CPU: 3 UID: 0 PID: 278 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 12.086215][ T278] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 12.086403][ T278] Call Trace: [ 12.086520][ T278] [ 12.086599][ T278] dump_stack_lvl+0x82/0xd0 [ 12.086760][ T278] print_deadlock_bug+0x40a/0x650 [ 12.086915][ T278] validate_chain+0x5bf/0xae0 [ 12.087070][ T278] ? __pfx_validate_chain+0x10/0x10 [ 12.087223][ T278] ? hlock_class+0x4e/0x130 [ 12.087374][ T278] ? mark_lock+0x38/0x3e0 [ 12.087492][ T278] __lock_acquire+0xb9a/0x1680 [ 12.087646][ T278] lock_acquire.part.0+0xeb/0x330 [ 12.087795][ T278] ? blocking_notifier_call_chain+0x50/0x90 [ 12.087985][ T278] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 12.088140][ T278] ? trace_lock_acquire+0x14c/0x1f0 [ 12.088292][ T278] ? lock_acquire+0x32/0xc0 [ 12.088446][ T278] ? blocking_notifier_call_chain+0x50/0x90 [ 12.088634][ T278] down_read+0x9f/0x340 [ 12.088750][ T278] ? blocking_notifier_call_chain+0x50/0x90 [ 12.088963][ T278] ? __pfx_down_read+0x10/0x10 [ 12.089117][ T278] blocking_notifier_call_chain+0x50/0x90 [ 12.089357][ T278] netdev_update_features+0xb0/0xc0 [ 12.089511][ T278] ? __pfx_netdev_update_features+0x10/0x10 [ 12.089706][ T278] br_device_event+0x549/0x700 [ 12.089946][ T278] ? __pfx_br_device_event+0x10/0x10 [ 12.090099][ T278] ? packet_notifier+0x3b0/0x810 [ 12.090337][ T278] notifier_call_chain+0xcd/0x150 [ 12.090490][ T278] blocking_notifier_call_chain+0x66/0x90 [ 12.090731][ T278] netdev_change_features+0x7f/0xb0 [ 12.090969][ T278] ? __pfx_netdev_change_features+0x10/0x10 [ 12.091154][ T278] ? __lock_release+0x103/0x460 [ 12.091304][ T278] ? dev_mc_add+0xc6/0xf0 [ 12.091418][ T278] bond_compute_features+0x4da/0x780 [ 12.091573][ T278] ? mark_held_locks+0x9e/0xe0 [ 12.091725][ T278] ? __pfx_bond_compute_features+0x10/0x10 [ 12.091998][ T278] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 12.092188][ T278] ? dev_mc_add+0xc6/0xf0 [ 12.092304][ T278] ? __local_bh_enable_ip+0xa6/0x120 [ 12.092462][ T278] bond_enslave+0x2a1a/0x51b0 [ 12.092623][ T278] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 12.092776][ T278] ? __pfx_bond_enslave+0x10/0x10 [ 12.093015][ T278] ? is_bpf_text_address+0x67/0x120 [ 12.093167][ T278] ? validate_chain+0x1fe/0xae0 [ 12.093320][ T278] ? __kernel_text_address+0x12/0x40 [ 12.093530][ T278] ? unwind_get_return_address+0x5e/0xa0 [ 12.093978][ T278] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 12.094183][ T278] ? __pfx_validate_chain+0x10/0x10 [ 12.094338][ T278] ? __pfx_validate_linkmsg+0x10/0x10 [ 12.094578][ T278] ? mutex_is_locked+0x1c/0x60 [ 12.094729][ T278] ? rtnl_is_locked+0x15/0x20 [ 12.094875][ T278] ? netdev_master_upper_dev_get+0x13/0x120 [ 12.095067][ T278] do_setlink.constprop.0+0x80e/0x2300 [ 12.095307][ T278] ? __pfx_do_setlink.constprop.0+0x10/0x10 [ 12.095494][ T278] ? lock_acquire.part.0+0xeb/0x330 [ 12.095646][ T278] ? rtnl_newlink+0x653/0xa70 [ 12.095796][ T278] ? rtnl_newlink+0xb9/0xa70 [ 12.096031][ T278] ? rtnetlink_rcv_msg+0x712/0xc10 [ 12.096244][ T278] ? __mutex_trylock_common+0xfa/0x260 [ 12.096428][ T278] ? __pfx___mutex_trylock_common+0x10/0x10 [ 12.096619][ T278] ? lock_acquire+0x32/0xc0 [ 12.096860][ T278] ? trace_contention_end+0xef/0x150 [ 12.097021][ T278] ? __mutex_lock+0x190/0xbc0 [ 12.097182][ T278] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 12.097340][ T278] ? rtnl_newlink+0x653/0xa70 [ 12.097578][ T278] ? __pfx___mutex_lock+0x10/0x10 [ 12.097823][ T278] ? __rtnl_newlink+0x3f2/0xa80 [ 12.097974][ T278] rtnl_newlink+0x69c/0xa70 [ 12.098135][ T278] ? __pfx_rtnl_newlink+0x10/0x10 [ 12.098291][ T278] ? find_held_lock+0x2c/0x110 [ 12.098443][ T278] ? __pfx___lock_release+0x10/0x10 [ 12.098596][ T278] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 12.098750][ T278] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 12.098902][ T278] ? __pfx_rtnl_newlink+0x10/0x10 [ 12.099063][ T278] rtnetlink_rcv_msg+0x712/0xc10 [ 12.099224][ T278] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 12.099383][ T278] ? hlock_class+0x4e/0x130 [ 12.099533][ T278] ? mark_lock+0x38/0x3e0 [ 12.099650][ T278] ? __lock_acquire+0xb9a/0x1680 [ 12.099803][ T278] netlink_rcv_skb+0x130/0x360 [ 12.099956][ T278] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 12.100121][ T278] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 12.100331][ T278] ? netlink_deliver_tap+0x13e/0x340 [ 12.100559][ T278] ? netlink_deliver_tap+0xc3/0x340 [ 12.100927][ T278] netlink_unicast+0x44b/0x710 [ 12.101160][ T278] ? __pfx_netlink_unicast+0x10/0x10 [ 12.101387][ T278] ? find_held_lock+0x2c/0x110 [ 12.101618][ T278] netlink_sendmsg+0x723/0xbe0 [ 12.101854][ T278] ? __pfx_netlink_sendmsg+0x10/0x10 [ 12.102096][ T278] ____sys_sendmsg+0x7ac/0xa10 [ 12.102337][ T278] ? __pfx_____sys_sendmsg+0x10/0x10 [ 12.102583][ T278] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 12.102885][ T278] ___sys_sendmsg+0xee/0x170 [ 12.103276][ T278] ? __pfx____sys_sendmsg+0x10/0x10 [ 12.103524][ T278] ? kasan_save_stack+0x34/0x50 [ 12.103761][ T278] ? kasan_save_stack+0x24/0x50 [ 12.103997][ T278] ? __kasan_record_aux_stack+0x8e/0xa0 [ 12.104388][ T278] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 12.104685][ T278] ? __x64_sys_close+0x7c/0xd0 [ 12.104892][ T278] ? do_syscall_64+0xc1/0x1d0 [ 12.105158][ T278] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 12.105348][ T278] ? __lock_acquire+0xb9a/0x1680 [ 12.105500][ T278] ? find_held_lock+0x2c/0x110 [ 12.105650][ T278] ? __lock_release+0x103/0x460 [ 12.105885][ T278] ? __virt_addr_valid+0x22b/0x430 [ 12.106047][ T278] ? __pfx___lock_release+0x10/0x10 [ 12.106223][ T278] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 12.106377][ T278] __sys_sendmsg+0x109/0x1a0 [ 12.106614][ T278] ? __pfx___sys_sendmsg+0x10/0x10 [ 12.106765][ T278] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 12.106953][ T278] do_syscall_64+0xc1/0x1d0 [ 12.107110][ T278] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 12.107405][ T278] RIP: 0033:0x7f4812e4f9a7 [ 12.107563][ T278] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 12.108190][ T278] RSP: 002b:00007fffb5930dc8 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 12.108416][ T278] RAX: ffffffffffffffda RBX: 00007fffb59314f0 RCX: 00007f4812e4f9a7 [ 12.108747][ T278] RDX: 0000000000000000 RSI: 00007fffb5930e30 RDI: 0000000000000005 [ 12.108969][ T278] RBP: 0000000000000003 R08: 0000000000000003 R09: 0000000000000000 [ 12.109205][ T278] R10: 000000000bb85910 R11: 0000000000000246 R12: 0000000000000003 [ 12.109428][ T278] R13: 0000000067795823 R14: 0000000000498600 R15: 0000000000000000 [ 12.109663][ T278] [ 12.115695][ T278] fbond: (slave veth1-bond): Enslaving as a backup interface with a down link [ 12.130344][ T278] ip (278) used greatest stack depth: 23088 bytes left [ 12.179314][ T279] veth2-bond: entered promiscuous mode [ 12.179709][ T279] veth2-bond: entered allmulticast mode [ 12.180093][ T279] fbond: (slave veth2-bond): Enslaving as a backup interface with a down link [ 12.275579][ T11] fbond: (slave veth1-bond): link status definitely up, 10000 Mbps full duplex [ 12.275914][ T11] fbond: Warning: No 802.3ad response from the link partner for any adapters in the bond [ 12.276228][ T11] fbond: active interface up! [ 12.351501][ T283] fab-br0: port 1(fbond) entered blocking state [ 12.351770][ T283] fab-br0: port 1(fbond) entered forwarding state [ 12.484467][ T11] fbond: (slave veth2-bond): link status definitely up, 10000 Mbps full duplex [ 14.769447][ T339] fbond: left allmulticast mode [ 14.769639][ T339] veth1-bond: left allmulticast mode [ 14.769799][ T339] veth2-bond: left allmulticast mode [ 14.769962][ T339] fbond: left promiscuous mode [ 14.770110][ T339] veth1-bond: left promiscuous mode [ 14.770435][ T339] veth2-bond: left promiscuous mode [ 14.770837][ T339] fab-br0: port 1(fbond) entered disabled state [ 15.063224][ T340] fbond (unregistering): (slave veth1-bond): Removing an active aggregator [ 15.069523][ T340] fbond (unregistering): (slave veth1-bond): Releasing backup interface [ 15.089367][ T340] fbond (unregistering): (slave veth2-bond): Removing an active aggregator [ 15.089925][ T340] fbond (unregistering): (slave veth2-bond): Releasing backup interface [ 15.113062][ T340] fbond (unregistering): Released all slaves