[ 903.479734][ T7778] openvswitch: Open vSwitch switching datapath [ 903.786560][ T7773] python3 (7773) used greatest stack depth: 24240 bytes left [ 907.688635][ T7808] netlink: 'python3': attribute type 2 has an invalid length. [ 907.695293][ T7808] arpping: entered promiscuous mode [ 908.871505][ T7852] ip (7852) used greatest stack depth: 24144 bytes left [ 910.993393][ T7859] c0: entered promiscuous mode [ 911.808839][ T7882] systemd-sysctl (7882) used greatest stack depth: 24048 bytes left [ 914.073107][ T7897] s0: entered promiscuous mode [ 920.683325][ T7961] [ 920.683521][ T7961] ============================================ [ 920.683719][ T7961] WARNING: possible recursive locking detected [ 920.683902][ T7961] 6.13.0-rc5-virtme #1 Not tainted [ 920.684048][ T7961] -------------------------------------------- [ 920.684230][ T7961] ip/7961 is trying to acquire lock: [ 920.684383][ T7961] ffffffffb73f6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 920.684690][ T7961] [ 920.684690][ T7961] but task is already holding lock: [ 920.684905][ T7961] ffffffffb73f6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 920.685201][ T7961] [ 920.685201][ T7961] other info that might help us debug this: [ 920.685416][ T7961] Possible unsafe locking scenario: [ 920.685416][ T7961] [ 920.685632][ T7961] CPU0 [ 920.685742][ T7961] ---- [ 920.685852][ T7961] lock((netdev_chain).rwsem); [ 920.686002][ T7961] lock((netdev_chain).rwsem); [ 920.686152][ T7961] [ 920.686152][ T7961] *** DEADLOCK *** [ 920.686152][ T7961] [ 920.686375][ T7961] May be due to missing lock nesting notation [ 920.686375][ T7961] [ 920.686595][ T7961] 2 locks held by ip/7961: [ 920.686744][ T7961] #0: ffffffffb7407e88 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_dellink+0x228/0xa40 [ 920.687012][ T7961] #1: ffffffffb73f6a70 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 920.687311][ T7961] [ 920.687311][ T7961] stack backtrace: [ 920.687492][ T7961] CPU: 2 UID: 0 PID: 7961 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 920.687716][ T7961] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 920.687904][ T7961] Call Trace: [ 920.688018][ T7961] [ 920.688095][ T7961] dump_stack_lvl+0x82/0xd0 [ 920.688250][ T7961] print_deadlock_bug+0x40a/0x650 [ 920.688403][ T7961] validate_chain+0x5bf/0xae0 [ 920.688554][ T7961] ? __lock_acquire+0xb9a/0x1680 [ 920.688706][ T7961] ? __pfx_validate_chain+0x10/0x10 [ 920.688855][ T7961] ? hlock_class+0x4e/0x130 [ 920.689008][ T7961] ? mark_lock+0x38/0x3e0 [ 920.689124][ T7961] __lock_acquire+0xb9a/0x1680 [ 920.689283][ T7961] ? acpi_ns_build_internal_name+0x1b7/0x500 [ 920.689473][ T7961] lock_acquire.part.0+0xeb/0x330 [ 920.689622][ T7961] ? blocking_notifier_call_chain+0x50/0x90 [ 920.689812][ T7961] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 920.689963][ T7961] ? trace_lock_acquire+0x14c/0x1f0 [ 920.690112][ T7961] ? lock_acquire+0x32/0xc0 [ 920.690260][ T7961] ? blocking_notifier_call_chain+0x50/0x90 [ 920.690446][ T7961] down_read+0x9f/0x340 [ 920.690563][ T7961] ? blocking_notifier_call_chain+0x50/0x90 [ 920.690753][ T7961] ? __pfx_down_read+0x10/0x10 [ 920.690905][ T7961] ? __mutex_unlock_slowpath+0x14a/0x3d0 [ 920.691056][ T7961] blocking_notifier_call_chain+0x50/0x90 [ 920.691207][ T7961] __netdev_upper_dev_unlink+0xd9/0x220 [ 920.691360][ T7961] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 920.691549][ T7961] ? synchronize_rcu_expedited+0x3b0/0x450 [ 920.691737][ T7961] ? __pfx_autoremove_wake_function+0x10/0x10 [ 920.691925][ T7961] netdev_upper_dev_unlink+0x71/0xa0 [ 920.692074][ T7961] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 920.692258][ T7961] ? mutex_is_locked+0x1c/0x60 [ 920.692406][ T7961] ? rtnl_is_locked+0x15/0x20 [ 920.692557][ T7961] ? netdev_master_upper_dev_get+0x13/0x120 [ 920.692749][ T7961] ovs_netdev_detach_dev+0xb0/0x170 [openvswitch] [ 920.692952][ T7961] ? ovs_netdev_get_vport+0x78/0xf0 [openvswitch] [ 920.693156][ T7961] dp_device_event+0x68/0x140 [openvswitch] [ 920.693355][ T7961] ? trace_notifier_run+0xe7/0x150 [ 920.693505][ T7961] notifier_call_chain+0xcd/0x150 [ 920.693655][ T7961] blocking_notifier_call_chain+0x66/0x90 [ 920.693807][ T7961] unregister_netdevice_many_notify+0xa83/0x1580 [ 920.694003][ T7961] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 920.694188][ T7961] ? rtnl_dellink+0x228/0xa40 [ 920.694336][ T7961] ? sock_def_readable+0x11e/0x300 [ 920.694490][ T7961] ? rtnl_is_locked+0x15/0x20 [ 920.694640][ T7961] ? unregister_netdevice_queue+0x70/0x410 [ 920.694825][ T7961] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 920.695012][ T7961] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 920.695201][ T7961] rtnl_dellink+0x348/0xa40 [ 920.695351][ T7961] ? __pfx_rtnl_dellink+0x10/0x10 [ 920.695517][ T7961] ? find_held_lock+0x2c/0x110 [ 920.695667][ T7961] ? __lock_release+0x103/0x460 [ 920.695832][ T7961] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 920.696001][ T7961] ? __pfx___lock_release+0x10/0x10 [ 920.696165][ T7961] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 920.696329][ T7961] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 920.696494][ T7961] ? __pfx_rtnl_dellink+0x10/0x10 [ 920.696662][ T7961] rtnetlink_rcv_msg+0x712/0xc10 [ 920.696821][ T7961] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 920.696970][ T7961] ? hlock_class+0x4e/0x130 [ 920.697119][ T7961] ? mark_lock+0x38/0x3e0 [ 920.697233][ T7961] ? __lock_acquire+0xb9a/0x1680 [ 920.697381][ T7961] netlink_rcv_skb+0x130/0x360 [ 920.697529][ T7961] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 920.697684][ T7961] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 920.697836][ T7961] ? netlink_deliver_tap+0x13e/0x340 [ 920.697986][ T7961] ? netlink_deliver_tap+0xc3/0x340 [ 920.698135][ T7961] netlink_unicast+0x44b/0x710 [ 920.698286][ T7961] ? __pfx_netlink_unicast+0x10/0x10 [ 920.698436][ T7961] ? find_held_lock+0x2c/0x110 [ 920.698584][ T7961] netlink_sendmsg+0x723/0xbe0 [ 920.698739][ T7961] ? __pfx_netlink_sendmsg+0x10/0x10 [ 920.698890][ T7961] ____sys_sendmsg+0x7ac/0xa10 [ 920.699041][ T7961] ? __pfx_____sys_sendmsg+0x10/0x10 [ 920.699188][ T7961] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 920.699384][ T7961] ___sys_sendmsg+0xee/0x170 [ 920.699533][ T7961] ? __pfx____sys_sendmsg+0x10/0x10 [ 920.699681][ T7961] ? kasan_save_stack+0x34/0x50 [ 920.699833][ T7961] ? kasan_save_stack+0x24/0x50 [ 920.699982][ T7961] ? __kasan_record_aux_stack+0x8e/0xa0 [ 920.700133][ T7961] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 920.700319][ T7961] ? __x64_sys_close+0x7c/0xd0 [ 920.700469][ T7961] ? do_syscall_64+0xc1/0x1d0 [ 920.700619][ T7961] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 920.700806][ T7961] ? __lock_acquire+0xb9a/0x1680 [ 920.700955][ T7961] ? find_held_lock+0x2c/0x110 [ 920.701109][ T7961] ? __lock_release+0x103/0x460 [ 920.701260][ T7961] ? __virt_addr_valid+0x22b/0x430 [ 920.701413][ T7961] ? __pfx___lock_release+0x10/0x10 [ 920.701562][ T7961] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 920.701713][ T7961] __sys_sendmsg+0x109/0x1a0 [ 920.701864][ T7961] ? __pfx___sys_sendmsg+0x10/0x10 [ 920.702013][ T7961] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 920.702208][ T7961] do_syscall_64+0xc1/0x1d0 [ 920.702359][ T7961] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 920.702545][ T7961] RIP: 0033:0x7fd5adb3a9a7 [ 920.702704][ T7961] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 920.703234][ T7961] RSP: 002b:00007ffec51ff7b8 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 920.703457][ T7961] RAX: ffffffffffffffda RBX: 00007ffec51ffee0 RCX: 00007fd5adb3a9a7 [ 920.703680][ T7961] RDX: 0000000000000000 RSI: 00007ffec51ff820 RDI: 0000000000000005 [ 920.703902][ T7961] RBP: 0000000000000001 R08: 0000000000000003 R09: 0000000000000078 [ 920.704128][ T7961] R10: 00007fd5ad9f8ef8 R11: 0000000000000246 R12: 0000000000000001 [ 920.704351][ T7961] R13: 000000006779310e R14: 0000000000498600 R15: 0000000000000000 [ 920.704576][ T7961] [ 920.704813][ T7961] s0 (unregistering): left promiscuous mode [ 920.774335][ T7961] ip (7961) used greatest stack depth: 23616 bytes left [ 921.013832][ T7969] c0 (unregistering): left promiscuous mode [ 922.535268][ T7975] arpping: left promiscuous mode [ 926.950635][ T8019] netlink: 'python3': attribute type 2 has an invalid length. [ 926.954992][ T8019] ct4: entered promiscuous mode [ 929.276094][ T8069] c0: entered promiscuous mode [ 931.529399][ T8107] s0: entered promiscuous mode [ 955.306717][ T8262] s0 (unregistering): left promiscuous mode [ 955.606766][ T8270] c0 (unregistering): left promiscuous mode [ 957.256380][ T8276] ct4: left promiscuous mode [ 961.660198][ T8319] netlink: 'python3': attribute type 2 has an invalid length. [ 961.664680][ T8319] cv4: entered promiscuous mode [ 964.001374][ T8369] c0: entered promiscuous mode [ 966.297749][ T8407] s0: entered promiscuous mode [ 975.155811][ T8494] s0 (unregistering): left promiscuous mode [ 975.470831][ T8502] c0 (unregistering): left promiscuous mode [ 977.042065][ T8508] cv4: left promiscuous mode [ 981.364190][ T8552] netlink: 'python3': attribute type 2 has an invalid length. [ 981.368493][ T8552] nat4: entered promiscuous mode [ 983.757747][ T8603] c0: entered promiscuous mode [ 986.058348][ T8641] s0: entered promiscuous mode [ 1008.730831][ T8781] s0 (unregistering): left promiscuous mode [ 1009.063133][ T8789] c0 (unregistering): left promiscuous mode [ 1010.660222][ T8795] nat4: left promiscuous mode [ 1014.940585][ T8839] netlink: 'python3': attribute type 2 has an invalid length. [ 1014.944816][ T8839] natrelated4: entered promiscuous mode [ 1017.242717][ T8889] c0: entered promiscuous mode [ 1019.460965][ T8927] s0: entered promiscuous mode [ 1031.919710][ T9080] s0 (unregistering): left promiscuous mode [ 1032.212729][ T9088] c0 (unregistering): left promiscuous mode [ 1033.674261][ T9094] natrelated4: left promiscuous mode [ 1037.933456][ T9138] netlink: 'python3': attribute type 2 has an invalid length. [ 1037.937869][ T9138] nv0: entered promiscuous mode [ 1039.490714][ T9162] netlink: 'python3': attribute type 2 has an invalid length. [ 1039.491705][ T9162] openvswitch: nv0: Dropping previously announced user features [ 1041.839220][ T9211] left0: entered promiscuous mode [ 1044.070227][ T9249] right0: entered promiscuous mode [ 1046.915700][ T9281] right0: left promiscuous mode [ 1049.806120][ T9317] openvswitch: netlink: Flow actions may not be safe on all matching packets. [ 1049.903008][ T9317] python3 (9317) used greatest stack depth: 22472 bytes left [ 1051.388330][ T9340] openvswitch: netlink: Flow actions may not be safe on all matching packets. [ 1052.023756][ T9367] left0 (unregistering): left promiscuous mode [ 1053.467438][ T9373] nv0: left promiscuous mode [ 1059.158901][ T9432] ui0: entered promiscuous mode [ 1061.612186][ T9482] left0: entered promiscuous mode [ 1064.102804][ T9513] left0 (unregistering): left promiscuous mode [ 1065.541155][ T9521] ui0: left promiscuous mode [ 1069.839156][ T9565] netlink: 'python3': attribute type 2 has an invalid length. [ 1069.843619][ T9565] dropreason: entered promiscuous mode [ 1072.381470][ T9615] c0: entered promiscuous mode [ 1074.659219][ T9654] s0: entered promiscuous mode [ 1109.703471][ T9825] s0 (unregistering): left promiscuous mode [ 1109.952816][ T9833] c0 (unregistering): left promiscuous mode [ 1111.494402][ T9839] dropreason: left promiscuous mode [ 1115.957458][ T9882] psample: entered promiscuous mode [ 1118.829566][ T9933] c0: entered promiscuous mode [ 1119.712619][ T9964] s0: entered promiscuous mode [ 1122.949521][T10027] openvswitch: netlink: Flow actions may not be safe on all matching packets. [ 1124.666258][T10050] openvswitch: netlink: Flow actions may not be safe on all matching packets. [ 1126.350604][T10073] openvswitch: netlink: Flow actions may not be safe on all matching packets. [ 1136.651841][T10214] s0 (unregistering): left promiscuous mode [ 1137.023701][T10224] c0 (unregistering): left promiscuous mode [ 1138.586831][T10231] psample: left promiscuous mode