[ 19.178328][ T300] veth1: entered promiscuous mode [ 19.418712][ T304] veth1: left promiscuous mode [ 19.461294][ T304] ip (304) used greatest stack depth: 23408 bytes left [ 21.255380][ T327] veth1: entered promiscuous mode [ 44.597065][ T409] veth1: entered allmulticast mode [ 50.600232][ T424] veth1: left allmulticast mode [ 66.238052][ T588] veth1: left promiscuous mode [ 69.193922][ T628] br0: port 1(veth1) entered blocking state [ 69.194387][ T628] br0: port 1(veth1) entered disabled state [ 69.194774][ T628] veth1: entered allmulticast mode [ 69.197065][ T628] veth1: entered promiscuous mode [ 69.284159][ T124] br0: port 1(veth1) entered blocking state [ 69.284645][ T124] br0: port 1(veth1) entered forwarding state [ 69.762282][ T635] br0: port 1(veth1) entered disabled state [ 69.766048][ T635] br0: port 1(veth1) entered blocking state [ 69.766534][ T635] br0: port 1(veth1) entered forwarding state [ 70.344490][ T642] br0: entered promiscuous mode [ 93.408438][ T724] br0: entered allmulticast mode [ 99.538786][ T739] br0: left allmulticast mode [ 105.335528][ T807] br0: left promiscuous mode [ 105.668632][ T812] br0: port 1(veth1) entered disabled state [ 106.178135][ T817] veth1: left allmulticast mode [ 106.178459][ T817] veth1: left promiscuous mode [ 106.178841][ T817] br0: port 1(veth1) entered disabled state [ 108.025163][ T846] br0: port 1(veth1) entered blocking state [ 108.025479][ T846] br0: port 1(veth1) entered disabled state [ 108.025769][ T846] veth1: entered allmulticast mode [ 108.028046][ T846] veth1: entered promiscuous mode [ 108.029140][ T846] br0: port 1(veth1) entered blocking state [ 108.029435][ T846] br0: port 1(veth1) entered forwarding state [ 108.555770][ T853] br0: port 1(veth1) entered disabled state [ 108.557513][ T853] br0: port 1(veth1) entered blocking state [ 108.557823][ T853] br0: port 1(veth1) entered forwarding state [ 109.126128][ T860] br0: entered promiscuous mode [ 132.520850][ T943] br0: entered allmulticast mode [ 138.662341][ T958] br0: left allmulticast mode [ 144.467802][ T1026] br0: left promiscuous mode [ 144.842319][ T1031] br0: port 1(veth1) entered disabled state [ 145.426403][ T1036] veth1: left allmulticast mode [ 145.426678][ T1036] veth1: left promiscuous mode [ 145.427033][ T1036] br0: port 1(veth1) entered disabled state [ 146.894345][ T1062] veth1: entered promiscuous mode [ 147.117346][ T1066] veth1: left promiscuous mode [ 147.943597][ T1075] 8021q: 802.1Q VLAN Support v1.8 [ 149.736647][ T1098] veth1: entered promiscuous mode [ 163.397412][ T1138] veth1.100: entered promiscuous mode [ 169.537883][ T1153] veth1.100: left promiscuous mode [ 173.087994][ T1180] veth1.100: entered allmulticast mode [ 173.088338][ T1180] veth1: entered allmulticast mode [ 179.325169][ T1195] veth1.100: left allmulticast mode [ 179.325587][ T1195] veth1: left allmulticast mode [ 195.102879][ T1359] veth1: left promiscuous mode [ 195.300032][ T1361] [ 195.300186][ T1361] ============================================ [ 195.300402][ T1361] WARNING: possible recursive locking detected [ 195.300607][ T1361] 6.13.0-rc5-virtme #1 Not tainted [ 195.300778][ T1361] -------------------------------------------- [ 195.300965][ T1361] ip/1361 is trying to acquire lock: [ 195.301121][ T1361] ffffffffa73d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 195.301450][ T1361] [ 195.301450][ T1361] but task is already holding lock: [ 195.301670][ T1361] ffffffffa73d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 195.301982][ T1361] [ 195.301982][ T1361] other info that might help us debug this: [ 195.302216][ T1361] Possible unsafe locking scenario: [ 195.302216][ T1361] [ 195.302457][ T1361] CPU0 [ 195.302580][ T1361] ---- [ 195.302706][ T1361] lock((netdev_chain).rwsem); [ 195.302868][ T1361] lock((netdev_chain).rwsem); [ 195.303035][ T1361] [ 195.303035][ T1361] *** DEADLOCK *** [ 195.303035][ T1361] [ 195.303281][ T1361] May be due to missing lock nesting notation [ 195.303281][ T1361] [ 195.303529][ T1361] 2 locks held by ip/1361: [ 195.303699][ T1361] #0: ffffffffa73e7a48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_dellink+0x228/0xa40 [ 195.304005][ T1361] #1: ffffffffa73d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 195.304339][ T1361] [ 195.304339][ T1361] stack backtrace: [ 195.304542][ T1361] CPU: 2 UID: 0 PID: 1361 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 195.304791][ T1361] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 195.305003][ T1361] Call Trace: [ 195.305130][ T1361] [ 195.305220][ T1361] dump_stack_lvl+0x82/0xd0 [ 195.305391][ T1361] print_deadlock_bug+0x40a/0x650 [ 195.305558][ T1361] validate_chain+0x5bf/0xae0 [ 195.305728][ T1361] ? __pfx_validate_chain+0x10/0x10 [ 195.305897][ T1361] ? hlock_class+0x4e/0x130 [ 195.306063][ T1361] ? mark_lock+0x38/0x3e0 [ 195.306189][ T1361] __lock_acquire+0xb9a/0x1680 [ 195.306365][ T1361] lock_acquire.part.0+0xeb/0x330 [ 195.306532][ T1361] ? blocking_notifier_call_chain+0x50/0x90 [ 195.306742][ T1361] ? netconsole_process_cleanups_core+0x2e/0x3d0 [ 195.306952][ T1361] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 195.307119][ T1361] ? trace_lock_acquire+0x14c/0x1f0 [ 195.307283][ T1361] ? lock_acquire+0x32/0xc0 [ 195.307437][ T1361] ? blocking_notifier_call_chain+0x50/0x90 [ 195.307643][ T1361] down_read+0x9f/0x340 [ 195.307773][ T1361] ? blocking_notifier_call_chain+0x50/0x90 [ 195.307978][ T1361] ? __pfx_down_read+0x10/0x10 [ 195.308162][ T1361] ? __lock_release+0x103/0x460 [ 195.308317][ T1361] ? netconsole_netdev_event+0x2c1/0x620 [ 195.308504][ T1361] ? __pfx___lock_release+0x10/0x10 [ 195.308676][ T1361] blocking_notifier_call_chain+0x50/0x90 [ 195.308846][ T1361] __netdev_upper_dev_unlink+0xd9/0x220 [ 195.309019][ T1361] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 195.309225][ T1361] ? __mutex_unlock_slowpath+0x14a/0x3d0 [ 195.309377][ T1361] ? __pfx___mutex_unlock_slowpath+0x10/0x10 [ 195.309570][ T1361] ? rtnl_is_locked+0x15/0x20 [ 195.309736][ T1361] netdev_upper_dev_unlink+0x71/0xa0 [ 195.309894][ T1361] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 195.310092][ T1361] ? mutex_is_locked+0x1c/0x60 [ 195.310273][ T1361] ? rtnl_is_locked+0x15/0x20 [ 195.310441][ T1361] ? netdev_master_upper_dev_get+0x13/0x120 [ 195.310652][ T1361] vrf_device_event+0x78/0xe0 [vrf] [ 195.310820][ T1361] notifier_call_chain+0xcd/0x150 [ 195.310985][ T1361] blocking_notifier_call_chain+0x66/0x90 [ 195.311157][ T1361] unregister_netdevice_many_notify+0xa7b/0x1580 [ 195.311362][ T1361] ? __lock_release+0x103/0x460 [ 195.311527][ T1361] ? __pfx___lock_release+0x10/0x10 [ 195.311694][ T1361] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 195.311896][ T1361] ? hlock_class+0x4e/0x130 [ 195.312060][ T1361] ? mark_held_locks+0x9e/0xe0 [ 195.312237][ T1361] ? __pfx_vlan_info_rcu_free+0x10/0x10 [ 195.312432][ T1361] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 195.312615][ T1361] rtnl_dellink+0x348/0xa40 [ 195.312765][ T1361] ? __pfx_rtnl_dellink+0x10/0x10 [ 195.312927][ T1361] ? find_held_lock+0x2c/0x110 [ 195.313102][ T1361] ? __lock_release+0x103/0x460 [ 195.313268][ T1361] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 195.313431][ T1361] ? __pfx___lock_release+0x10/0x10 [ 195.313605][ T1361] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 195.313769][ T1361] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 195.313930][ T1361] ? __pfx_rtnl_dellink+0x10/0x10 [ 195.314094][ T1361] rtnetlink_rcv_msg+0x712/0xc10 [ 195.314259][ T1361] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 195.314424][ T1361] ? hlock_class+0x4e/0x130 [ 195.314665][ T1361] ? mark_lock+0x38/0x3e0 [ 195.314796][ T1361] ? __lock_acquire+0xb9a/0x1680 [ 195.314960][ T1361] netlink_rcv_skb+0x130/0x360 [ 195.315124][ T1361] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 195.315276][ T1361] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 195.315428][ T1361] ? netlink_deliver_tap+0x13e/0x340 [ 195.315579][ T1361] ? netlink_deliver_tap+0xc3/0x340 [ 195.315728][ T1361] netlink_unicast+0x44b/0x710 [ 195.315882][ T1361] ? __pfx_netlink_unicast+0x10/0x10 [ 195.316031][ T1361] ? find_held_lock+0x2c/0x110 [ 195.316184][ T1361] netlink_sendmsg+0x723/0xbe0 [ 195.316335][ T1361] ? __pfx_netlink_sendmsg+0x10/0x10 [ 195.316486][ T1361] ____sys_sendmsg+0x7ac/0xa10 [ 195.316636][ T1361] ? __pfx_____sys_sendmsg+0x10/0x10 [ 195.316784][ T1361] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 195.316978][ T1361] ___sys_sendmsg+0xee/0x170 [ 195.317128][ T1361] ? __pfx____sys_sendmsg+0x10/0x10 [ 195.317277][ T1361] ? kasan_save_stack+0x34/0x50 [ 195.317428][ T1361] ? kasan_save_stack+0x24/0x50 [ 195.317577][ T1361] ? __kasan_record_aux_stack+0x8e/0xa0 [ 195.317728][ T1361] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 195.317914][ T1361] ? __x64_sys_close+0x7c/0xd0 [ 195.318065][ T1361] ? do_syscall_64+0xc1/0x1d0 [ 195.318237][ T1361] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 195.318439][ T1361] ? __lock_acquire+0xb9a/0x1680 [ 195.318606][ T1361] ? find_held_lock+0x2c/0x110 [ 195.318770][ T1361] ? __lock_release+0x103/0x460 [ 195.318932][ T1361] ? __virt_addr_valid+0x22b/0x430 [ 195.319090][ T1361] ? __pfx___lock_release+0x10/0x10 [ 195.319240][ T1361] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 195.319397][ T1361] __sys_sendmsg+0x109/0x1a0 [ 195.319545][ T1361] ? __pfx___sys_sendmsg+0x10/0x10 [ 195.319694][ T1361] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 195.319887][ T1361] do_syscall_64+0xc1/0x1d0 [ 195.320088][ T1361] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 195.320328][ T1361] RIP: 0033:0x7f798c0b89a7 [ 195.320569][ T1361] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 195.321134][ T1361] RSP: 002b:00007fffb4aa1848 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 195.321363][ T1361] RAX: ffffffffffffffda RBX: 00007fffb4aa1f70 RCX: 00007f798c0b89a7 [ 195.321619][ T1361] RDX: 0000000000000000 RSI: 00007fffb4aa18b0 RDI: 0000000000000005 [ 195.321872][ T1361] RBP: 0000000000000002 R08: 0000000000000003 R09: 0000000000000078 [ 195.322124][ T1361] R10: 00007f798bf76ef8 R11: 0000000000000246 R12: 0000000000000002 [ 195.322387][ T1361] R13: 000000006779269f R14: 0000000000498600 R15: 0000000000000000 [ 195.322639][ T1361] [ 196.624633][ T1392] veth1: entered promiscuous mode [ 196.775802][ T1396] veth1: left promiscuous mode [ 198.876863][ T1427] br0: port 1(veth1) entered blocking state [ 198.877133][ T1427] br0: port 1(veth1) entered disabled state [ 198.877342][ T1427] veth1: entered allmulticast mode [ 198.879208][ T1427] veth1: entered promiscuous mode [ 198.880067][ T1427] br0: port 1(veth1) entered blocking state [ 198.880278][ T1427] br0: port 1(veth1) entered forwarding state [ 212.115737][ T1472] veth1.100: entered promiscuous mode [ 217.965440][ T1487] veth1.100: left promiscuous mode [ 221.043548][ T1514] veth1.100: entered allmulticast mode [ 226.821904][ T1529] veth1.100: left allmulticast mode [ 239.697189][ T1694] veth1: left allmulticast mode [ 239.697436][ T1694] veth1: left promiscuous mode [ 239.697788][ T1694] br0: port 1(veth1) entered disabled state [ 241.363300][ T1727] veth1: entered promiscuous mode [ 241.543822][ T1731] veth1: left promiscuous mode [ 243.437800][ T1762] br0: port 1(veth1) entered blocking state [ 243.438218][ T1762] br0: port 1(veth1) entered disabled state [ 243.438547][ T1762] veth1: entered allmulticast mode [ 243.441023][ T1762] veth1: entered promiscuous mode [ 243.442419][ T1762] br0: port 1(veth1) entered blocking state [ 243.442716][ T1762] br0: port 1(veth1) entered forwarding state [ 256.600648][ T1807] veth1.100: entered promiscuous mode [ 262.364109][ T1822] veth1.100: left promiscuous mode [ 265.536647][ T1849] veth1.100: entered allmulticast mode [ 271.349936][ T1864] veth1.100: left allmulticast mode [ 284.236160][ T2029] veth1: left allmulticast mode [ 284.236681][ T2029] veth1: left promiscuous mode [ 284.236957][ T2029] br0: port 1(veth1) entered disabled state [ 286.366403][ T2069] br0: port 1(veth1) entered blocking state [ 286.366674][ T2069] br0: port 1(veth1) entered disabled state [ 286.366930][ T2069] veth1: entered allmulticast mode [ 286.368813][ T2069] veth1: entered promiscuous mode [ 286.457766][ T124] br0: port 1(veth1) entered blocking state [ 286.458052][ T124] br0: port 1(veth1) entered forwarding state [ 286.803381][ T2076] br0: port 1(veth1) entered disabled state [ 286.805328][ T2076] br0: port 1(veth1) entered blocking state [ 286.805575][ T2076] br0: port 1(veth1) entered forwarding state [ 287.441879][ T2086] br0: entered promiscuous mode [ 300.201442][ T2127] br0.100: entered promiscuous mode [ 306.023249][ T2142] br0.100: left promiscuous mode [ 309.153172][ T2169] br0.100: entered allmulticast mode [ 309.153437][ T2169] br0: entered allmulticast mode [ 315.001000][ T2184] br0.100: left allmulticast mode [ 315.001275][ T2184] br0: left allmulticast mode [ 319.814593][ T2252] br0: left promiscuous mode [ 320.011318][ T2256] br0: port 1(veth1) entered disabled state [ 320.411331][ T2261] veth1: left allmulticast mode [ 320.412041][ T2261] veth1: left promiscuous mode [ 320.412409][ T2261] br0: port 1(veth1) entered disabled state [ 322.100427][ T2293] br0: port 1(veth1) entered blocking state [ 322.100664][ T2293] br0: port 1(veth1) entered disabled state [ 322.100911][ T2293] veth1: entered allmulticast mode [ 322.103040][ T2293] veth1: entered promiscuous mode [ 322.103921][ T2293] br0: port 1(veth1) entered blocking state [ 322.104170][ T2293] br0: port 1(veth1) entered forwarding state [ 322.498987][ T2300] br0: port 1(veth1) entered disabled state [ 322.500563][ T2300] br0: port 1(veth1) entered blocking state [ 322.500832][ T2300] br0: port 1(veth1) entered forwarding state [ 323.144524][ T2311] br0: entered promiscuous mode [ 336.137275][ T2353] br0.100: entered promiscuous mode [ 342.068665][ T2368] br0.100: left promiscuous mode [ 345.236628][ T2395] br0.100: entered allmulticast mode [ 345.236947][ T2395] br0: entered allmulticast mode [ 351.097862][ T2410] br0.100: left allmulticast mode [ 351.098078][ T2410] br0: left allmulticast mode [ 355.861442][ T2480] br0: left promiscuous mode [ 356.071875][ T2484] br0: port 1(veth1) entered disabled state [ 356.470613][ T2489] veth1: left allmulticast mode [ 356.470885][ T2489] veth1: left promiscuous mode [ 356.471226][ T2489] br0: port 1(veth1) entered disabled state