[ 18.042321][ T299] veth1: entered promiscuous mode [ 18.256522][ T303] veth1: left promiscuous mode [ 20.137118][ T326] veth1: entered promiscuous mode [ 42.899347][ T408] veth1: entered allmulticast mode [ 48.934802][ T423] veth1: left allmulticast mode [ 63.498146][ T587] veth1: left promiscuous mode [ 66.462705][ T628] br0: port 1(veth1) entered blocking state [ 66.463068][ T628] br0: port 1(veth1) entered disabled state [ 66.463416][ T628] veth1: entered allmulticast mode [ 66.465534][ T628] veth1: entered promiscuous mode [ 66.552955][ T210] br0: port 1(veth1) entered blocking state [ 66.553438][ T210] br0: port 1(veth1) entered forwarding state [ 66.983363][ T636] br0: port 1(veth1) entered disabled state [ 66.986749][ T636] br0: port 1(veth1) entered blocking state [ 66.987066][ T636] br0: port 1(veth1) entered forwarding state [ 67.531278][ T643] br0: entered promiscuous mode [ 90.200000][ T725] br0: entered allmulticast mode [ 96.219153][ T740] br0: left allmulticast mode [ 101.576681][ T808] br0: left promiscuous mode [ 101.831206][ T813] br0: port 1(veth1) entered disabled state [ 102.349974][ T818] veth1: left allmulticast mode [ 102.350329][ T818] veth1: left promiscuous mode [ 102.350747][ T818] br0: port 1(veth1) entered disabled state [ 104.267140][ T847] br0: port 1(veth1) entered blocking state [ 104.267604][ T847] br0: port 1(veth1) entered disabled state [ 104.268361][ T847] veth1: entered allmulticast mode [ 104.271473][ T847] veth1: entered promiscuous mode [ 104.272599][ T847] br0: port 1(veth1) entered blocking state [ 104.272879][ T847] br0: port 1(veth1) entered forwarding state [ 104.775321][ T854] br0: port 1(veth1) entered disabled state [ 104.776504][ T854] br0: port 1(veth1) entered blocking state [ 104.776791][ T854] br0: port 1(veth1) entered forwarding state [ 105.313594][ T861] br0: entered promiscuous mode [ 128.108256][ T944] br0: entered allmulticast mode [ 134.193833][ T959] br0: left allmulticast mode [ 139.669058][ T1027] br0: left promiscuous mode [ 139.979228][ T1032] br0: port 1(veth1) entered disabled state [ 140.449990][ T1037] veth1: left allmulticast mode [ 140.450351][ T1037] veth1: left promiscuous mode [ 140.450848][ T1037] br0: port 1(veth1) entered disabled state [ 141.703691][ T1063] veth1: entered promiscuous mode [ 141.904631][ T1067] veth1: left promiscuous mode [ 142.623698][ T1076] 8021q: 802.1Q VLAN Support v1.8 [ 144.207319][ T1098] veth1: entered promiscuous mode [ 157.578182][ T1138] veth1.100: entered promiscuous mode [ 163.649965][ T1153] veth1.100: left promiscuous mode [ 167.027186][ T1180] veth1.100: entered allmulticast mode [ 167.027470][ T1180] veth1: entered allmulticast mode [ 173.042569][ T1195] veth1.100: left allmulticast mode [ 173.042954][ T1195] veth1: left allmulticast mode [ 187.976745][ T1359] veth1: left promiscuous mode [ 188.144170][ T1360] [ 188.144307][ T1360] ============================================ [ 188.144495][ T1360] WARNING: possible recursive locking detected [ 188.144677][ T1360] 6.13.0-rc5-virtme #1 Not tainted [ 188.144829][ T1360] -------------------------------------------- [ 188.145085][ T1360] ip/1360 is trying to acquire lock: [ 188.145308][ T1360] ffffffff9ebd6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 188.145683][ T1360] [ 188.145683][ T1360] but task is already holding lock: [ 188.145897][ T1360] ffffffff9ebd6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 188.146793][ T1360] [ 188.146793][ T1360] other info that might help us debug this: [ 188.147043][ T1360] Possible unsafe locking scenario: [ 188.147043][ T1360] [ 188.147292][ T1360] CPU0 [ 188.147412][ T1360] ---- [ 188.147543][ T1360] lock((netdev_chain).rwsem); [ 188.147700][ T1360] lock((netdev_chain).rwsem); [ 188.147868][ T1360] [ 188.147868][ T1360] *** DEADLOCK *** [ 188.147868][ T1360] [ 188.148107][ T1360] May be due to missing lock nesting notation [ 188.148107][ T1360] [ 188.148359][ T1360] 2 locks held by ip/1360: [ 188.148523][ T1360] #0: ffffffff9ebe7a48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_dellink+0x228/0xa40 [ 188.148832][ T1360] #1: ffffffff9ebd6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 188.149195][ T1360] [ 188.149195][ T1360] stack backtrace: [ 188.149392][ T1360] CPU: 2 UID: 0 PID: 1360 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 188.149634][ T1360] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 188.149832][ T1360] Call Trace: [ 188.149963][ T1360] [ 188.150070][ T1360] dump_stack_lvl+0x82/0xd0 [ 188.150250][ T1360] print_deadlock_bug+0x40a/0x650 [ 188.150418][ T1360] validate_chain+0x5bf/0xae0 [ 188.150594][ T1360] ? __pfx_validate_chain+0x10/0x10 [ 188.150768][ T1360] ? hlock_class+0x4e/0x130 [ 188.150940][ T1360] ? mark_lock+0x38/0x3e0 [ 188.151077][ T1360] __lock_acquire+0xb9a/0x1680 [ 188.151258][ T1360] lock_acquire.part.0+0xeb/0x330 [ 188.151434][ T1360] ? blocking_notifier_call_chain+0x50/0x90 [ 188.151661][ T1360] ? netconsole_process_cleanups_core+0x2e/0x3d0 [ 188.151879][ T1360] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 188.152055][ T1360] ? trace_lock_acquire+0x14c/0x1f0 [ 188.152240][ T1360] ? lock_acquire+0x32/0xc0 [ 188.152436][ T1360] ? blocking_notifier_call_chain+0x50/0x90 [ 188.152730][ T1360] down_read+0x9f/0x340 [ 188.152928][ T1360] ? blocking_notifier_call_chain+0x50/0x90 [ 188.153231][ T1360] ? __pfx_down_read+0x10/0x10 [ 188.153413][ T1360] ? __lock_release+0x103/0x460 [ 188.153589][ T1360] ? netconsole_netdev_event+0x2c1/0x620 [ 188.153765][ T1360] ? __pfx___lock_release+0x10/0x10 [ 188.153940][ T1360] blocking_notifier_call_chain+0x50/0x90 [ 188.154118][ T1360] __netdev_upper_dev_unlink+0xd9/0x220 [ 188.154307][ T1360] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 188.154531][ T1360] ? __mutex_unlock_slowpath+0x14a/0x3d0 [ 188.154707][ T1360] ? __pfx___mutex_unlock_slowpath+0x10/0x10 [ 188.154916][ T1360] ? rtnl_is_locked+0x15/0x20 [ 188.155080][ T1360] netdev_upper_dev_unlink+0x71/0xa0 [ 188.155245][ T1360] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 188.155445][ T1360] ? mutex_is_locked+0x1c/0x60 [ 188.155614][ T1360] ? rtnl_is_locked+0x15/0x20 [ 188.155776][ T1360] ? netdev_master_upper_dev_get+0x13/0x120 [ 188.155971][ T1360] vrf_device_event+0x78/0xe0 [vrf] [ 188.156143][ T1360] notifier_call_chain+0xcd/0x150 [ 188.156309][ T1360] blocking_notifier_call_chain+0x66/0x90 [ 188.156467][ T1360] unregister_netdevice_many_notify+0xa7b/0x1580 [ 188.156660][ T1360] ? __lock_release+0x103/0x460 [ 188.156819][ T1360] ? __pfx___lock_release+0x10/0x10 [ 188.156996][ T1360] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 188.157213][ T1360] ? hlock_class+0x4e/0x130 [ 188.157382][ T1360] ? mark_held_locks+0x9e/0xe0 [ 188.158070][ T1360] ? __pfx_vlan_info_rcu_free+0x10/0x10 [ 188.158262][ T1360] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 188.158442][ T1360] rtnl_dellink+0x348/0xa40 [ 188.158595][ T1360] ? __pfx_rtnl_dellink+0x10/0x10 [ 188.158755][ T1360] ? find_held_lock+0x2c/0x110 [ 188.158902][ T1360] ? __lock_release+0x103/0x460 [ 188.159046][ T1360] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 188.159198][ T1360] ? __pfx___lock_release+0x10/0x10 [ 188.159342][ T1360] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 188.159490][ T1360] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 188.159641][ T1360] ? __pfx_rtnl_dellink+0x10/0x10 [ 188.159815][ T1360] rtnetlink_rcv_msg+0x712/0xc10 [ 188.159958][ T1360] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 188.160168][ T1360] ? hlock_class+0x4e/0x130 [ 188.160380][ T1360] ? mark_lock+0x38/0x3e0 [ 188.160552][ T1360] ? __lock_acquire+0xb9a/0x1680 [ 188.160739][ T1360] netlink_rcv_skb+0x130/0x360 [ 188.160886][ T1360] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 188.161038][ T1360] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 188.161198][ T1360] ? netlink_deliver_tap+0x13e/0x340 [ 188.161372][ T1360] ? netlink_deliver_tap+0xc3/0x340 [ 188.161518][ T1360] netlink_unicast+0x44b/0x710 [ 188.161667][ T1360] ? __pfx_netlink_unicast+0x10/0x10 [ 188.161818][ T1360] ? find_held_lock+0x2c/0x110 [ 188.161966][ T1360] netlink_sendmsg+0x723/0xbe0 [ 188.162120][ T1360] ? __pfx_netlink_sendmsg+0x10/0x10 [ 188.162278][ T1360] ____sys_sendmsg+0x7ac/0xa10 [ 188.162427][ T1360] ? __pfx_____sys_sendmsg+0x10/0x10 [ 188.162572][ T1360] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 188.162758][ T1360] ___sys_sendmsg+0xee/0x170 [ 188.162904][ T1360] ? __pfx____sys_sendmsg+0x10/0x10 [ 188.163056][ T1360] ? kasan_save_stack+0x34/0x50 [ 188.163219][ T1360] ? kasan_save_stack+0x24/0x50 [ 188.163367][ T1360] ? __kasan_record_aux_stack+0x8e/0xa0 [ 188.163519][ T1360] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 188.163702][ T1360] ? __x64_sys_close+0x7c/0xd0 [ 188.163851][ T1360] ? do_syscall_64+0xc1/0x1d0 [ 188.163998][ T1360] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 188.164190][ T1360] ? __lock_acquire+0xb9a/0x1680 [ 188.164345][ T1360] ? find_held_lock+0x2c/0x110 [ 188.164496][ T1360] ? __lock_release+0x103/0x460 [ 188.164641][ T1360] ? __virt_addr_valid+0x22b/0x430 [ 188.164792][ T1360] ? __pfx___lock_release+0x10/0x10 [ 188.164939][ T1360] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 188.165086][ T1360] __sys_sendmsg+0x109/0x1a0 [ 188.165238][ T1360] ? __pfx___sys_sendmsg+0x10/0x10 [ 188.165392][ T1360] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 188.165581][ T1360] do_syscall_64+0xc1/0x1d0 [ 188.165729][ T1360] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 188.165912][ T1360] RIP: 0033:0x7f8f58e989a7 [ 188.166068][ T1360] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 188.166594][ T1360] RSP: 002b:00007ffd535eaeb8 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 188.166818][ T1360] RAX: ffffffffffffffda RBX: 00007ffd535eb5e0 RCX: 00007f8f58e989a7 [ 188.167036][ T1360] RDX: 0000000000000000 RSI: 00007ffd535eaf20 RDI: 0000000000000005 [ 188.167275][ T1360] RBP: 0000000000000002 R08: 0000000000000003 R09: 0000000000000078 [ 188.167500][ T1360] R10: 00007f8f58d56ef8 R11: 0000000000000246 R12: 0000000000000002 [ 188.167783][ T1360] R13: 0000000067794f3c R14: 0000000000498600 R15: 0000000000000000 [ 188.168119][ T1360] [ 188.187020][ T1360] ip (1360) used greatest stack depth: 23680 bytes left [ 189.386073][ T1392] veth1: entered promiscuous mode [ 189.525112][ T1396] veth1: left promiscuous mode [ 191.382035][ T1427] br0: port 1(veth1) entered blocking state [ 191.383577][ T1427] br0: port 1(veth1) entered disabled state [ 191.384020][ T1427] veth1: entered allmulticast mode [ 191.385814][ T1427] veth1: entered promiscuous mode [ 191.386725][ T1427] br0: port 1(veth1) entered blocking state [ 191.386927][ T1427] br0: port 1(veth1) entered forwarding state [ 204.405834][ T1472] veth1.100: entered promiscuous mode [ 210.147342][ T1487] veth1.100: left promiscuous mode [ 213.246555][ T1514] veth1.100: entered allmulticast mode [ 218.968637][ T1529] veth1.100: left allmulticast mode [ 231.476928][ T1694] veth1: left allmulticast mode [ 231.477127][ T1694] veth1: left promiscuous mode [ 231.477410][ T1694] br0: port 1(veth1) entered disabled state [ 232.834577][ T1727] veth1: entered promiscuous mode [ 232.962407][ T1731] veth1: left promiscuous mode [ 234.632572][ T1762] br0: port 1(veth1) entered blocking state [ 234.632804][ T1762] br0: port 1(veth1) entered disabled state [ 234.633029][ T1762] veth1: entered allmulticast mode [ 234.634537][ T1762] veth1: entered promiscuous mode [ 234.636144][ T1762] br0: port 1(veth1) entered blocking state [ 234.636351][ T1762] br0: port 1(veth1) entered forwarding state [ 247.615262][ T1807] veth1.100: entered promiscuous mode [ 253.372965][ T1822] veth1.100: left promiscuous mode [ 256.379825][ T1849] veth1.100: entered allmulticast mode [ 262.164431][ T1864] veth1.100: left allmulticast mode [ 274.430748][ T2029] veth1: left allmulticast mode [ 274.430969][ T2029] veth1: left promiscuous mode [ 274.431249][ T2029] br0: port 1(veth1) entered disabled state [ 276.509457][ T2069] br0: port 1(veth1) entered blocking state [ 276.509708][ T2069] br0: port 1(veth1) entered disabled state [ 276.509935][ T2069] veth1: entered allmulticast mode [ 276.511620][ T2069] veth1: entered promiscuous mode [ 276.571139][ T66] br0: port 1(veth1) entered blocking state [ 276.571399][ T66] br0: port 1(veth1) entered forwarding state [ 276.931514][ T2076] br0: port 1(veth1) entered disabled state [ 276.932642][ T2076] br0: port 1(veth1) entered blocking state [ 276.932929][ T2076] br0: port 1(veth1) entered forwarding state [ 277.525785][ T2087] br0: entered promiscuous mode [ 290.353972][ T2127] br0.100: entered promiscuous mode [ 296.149480][ T2142] br0.100: left promiscuous mode [ 299.259669][ T2169] br0.100: entered allmulticast mode [ 299.259875][ T2169] br0: entered allmulticast mode [ 304.996172][ T2184] br0.100: left allmulticast mode [ 304.996769][ T2184] br0: left allmulticast mode [ 309.594663][ T2252] br0: left promiscuous mode [ 309.770599][ T2256] br0: port 1(veth1) entered disabled state [ 310.113927][ T2261] veth1: left allmulticast mode [ 310.114173][ T2261] veth1: left promiscuous mode [ 310.114478][ T2261] br0: port 1(veth1) entered disabled state [ 311.782754][ T2293] br0: port 1(veth1) entered blocking state [ 311.783137][ T2293] br0: port 1(veth1) entered disabled state [ 311.783523][ T2293] veth1: entered allmulticast mode [ 311.786999][ T2293] veth1: entered promiscuous mode [ 311.788452][ T2293] br0: port 1(veth1) entered blocking state [ 311.788810][ T2293] br0: port 1(veth1) entered forwarding state [ 312.233048][ T2300] br0: port 1(veth1) entered disabled state [ 312.233918][ T2300] br0: port 1(veth1) entered blocking state [ 312.234162][ T2300] br0: port 1(veth1) entered forwarding state [ 312.831114][ T2311] br0: entered promiscuous mode [ 325.713218][ T2353] br0.100: entered promiscuous mode [ 331.491512][ T2368] br0.100: left promiscuous mode [ 334.560908][ T2395] br0.100: entered allmulticast mode [ 334.561100][ T2395] br0: entered allmulticast mode [ 340.386827][ T2410] br0.100: left allmulticast mode [ 340.387051][ T2410] br0: left allmulticast mode [ 344.967322][ T2480] br0: left promiscuous mode [ 345.163483][ T2484] br0: port 1(veth1) entered disabled state [ 345.513471][ T2489] veth1: left allmulticast mode [ 345.513656][ T2489] veth1: left promiscuous mode [ 345.513925][ T2489] br0: port 1(veth1) entered disabled state