[ 11.482361][ T258] ip (258) used greatest stack depth: 23792 bytes left [ 18.076768][ T300] veth1: entered promiscuous mode [ 18.274653][ T305] veth1: left promiscuous mode [ 20.012400][ T328] veth1: entered promiscuous mode [ 42.810083][ T410] veth1: entered allmulticast mode [ 48.874084][ T425] veth1: left allmulticast mode [ 63.340461][ T589] veth1: left promiscuous mode [ 63.678792][ T594] ip (594) used greatest stack depth: 23328 bytes left [ 66.091986][ T628] br0: port 1(veth1) entered blocking state [ 66.092355][ T628] br0: port 1(veth1) entered disabled state [ 66.092624][ T628] veth1: entered allmulticast mode [ 66.094970][ T628] veth1: entered promiscuous mode [ 66.202322][ T39] br0: port 1(veth1) entered blocking state [ 66.202979][ T39] br0: port 1(veth1) entered forwarding state [ 66.638716][ T635] br0: port 1(veth1) entered disabled state [ 66.643041][ T635] br0: port 1(veth1) entered blocking state [ 66.643582][ T635] br0: port 1(veth1) entered forwarding state [ 67.136034][ T642] br0: entered promiscuous mode [ 89.685271][ T724] br0: entered allmulticast mode [ 95.643080][ T739] br0: left allmulticast mode [ 100.861194][ T807] br0: left promiscuous mode [ 101.137027][ T812] br0: port 1(veth1) entered disabled state [ 101.631335][ T817] veth1: left allmulticast mode [ 101.631608][ T817] veth1: left promiscuous mode [ 101.631929][ T817] br0: port 1(veth1) entered disabled state [ 103.368133][ T846] br0: port 1(veth1) entered blocking state [ 103.368461][ T846] br0: port 1(veth1) entered disabled state [ 103.368789][ T846] veth1: entered allmulticast mode [ 103.370961][ T846] veth1: entered promiscuous mode [ 103.372053][ T846] br0: port 1(veth1) entered blocking state [ 103.372538][ T846] br0: port 1(veth1) entered forwarding state [ 103.882052][ T853] br0: port 1(veth1) entered disabled state [ 103.883655][ T853] br0: port 1(veth1) entered blocking state [ 103.883941][ T853] br0: port 1(veth1) entered forwarding state [ 104.362017][ T860] br0: entered promiscuous mode [ 126.972244][ T942] br0: entered allmulticast mode [ 132.978736][ T957] br0: left allmulticast mode [ 138.273149][ T1025] br0: left promiscuous mode [ 138.533749][ T1030] br0: port 1(veth1) entered disabled state [ 138.989453][ T1035] veth1: left allmulticast mode [ 138.989693][ T1035] veth1: left promiscuous mode [ 138.990012][ T1035] br0: port 1(veth1) entered disabled state [ 140.145558][ T1061] veth1: entered promiscuous mode [ 140.324623][ T1065] veth1: left promiscuous mode [ 141.023875][ T1074] 8021q: 802.1Q VLAN Support v1.8 [ 142.543997][ T1096] veth1: entered promiscuous mode [ 155.823321][ T1136] veth1.100: entered promiscuous mode [ 161.851133][ T1151] veth1.100: left promiscuous mode [ 165.171212][ T1178] veth1.100: entered allmulticast mode [ 165.171448][ T1178] veth1: entered allmulticast mode [ 171.084098][ T1193] veth1.100: left allmulticast mode [ 171.084343][ T1193] veth1: left allmulticast mode [ 185.104742][ T1357] veth1: left promiscuous mode [ 185.220473][ T1358] [ 185.220633][ T1358] ============================================ [ 185.220820][ T1358] WARNING: possible recursive locking detected [ 185.221008][ T1358] 6.13.0-rc5-virtme #1 Not tainted [ 185.221159][ T1358] -------------------------------------------- [ 185.221348][ T1358] ip/1358 is trying to acquire lock: [ 185.221496][ T1358] ffffffff871d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 185.221805][ T1358] [ 185.221805][ T1358] but task is already holding lock: [ 185.222025][ T1358] ffffffff871d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 185.222327][ T1358] [ 185.222327][ T1358] other info that might help us debug this: [ 185.222556][ T1358] Possible unsafe locking scenario: [ 185.222556][ T1358] [ 185.222779][ T1358] CPU0 [ 185.222896][ T1358] ---- [ 185.223011][ T1358] lock((netdev_chain).rwsem); [ 185.223160][ T1358] lock((netdev_chain).rwsem); [ 185.223315][ T1358] [ 185.223315][ T1358] *** DEADLOCK *** [ 185.223315][ T1358] [ 185.223529][ T1358] May be due to missing lock nesting notation [ 185.223529][ T1358] [ 185.223753][ T1358] 2 locks held by ip/1358: [ 185.223896][ T1358] #0: ffffffff871e7a48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_dellink+0x228/0xa40 [ 185.224170][ T1358] #1: ffffffff871d6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 185.224464][ T1358] [ 185.224464][ T1358] stack backtrace: [ 185.224646][ T1358] CPU: 0 UID: 0 PID: 1358 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 185.224871][ T1358] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 185.225055][ T1358] Call Trace: [ 185.225169][ T1358] [ 185.225248][ T1358] dump_stack_lvl+0x82/0xd0 [ 185.225403][ T1358] print_deadlock_bug+0x40a/0x650 [ 185.225562][ T1358] validate_chain+0x5bf/0xae0 [ 185.225729][ T1358] ? __pfx_validate_chain+0x10/0x10 [ 185.225880][ T1358] ? hlock_class+0x4e/0x130 [ 185.226027][ T1358] ? mark_lock+0x38/0x3e0 [ 185.226138][ T1358] __lock_acquire+0xb9a/0x1680 [ 185.226288][ T1358] lock_acquire.part.0+0xeb/0x330 [ 185.226436][ T1358] ? blocking_notifier_call_chain+0x50/0x90 [ 185.226619][ T1358] ? netconsole_process_cleanups_core+0x2e/0x3d0 [ 185.226805][ T1358] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 185.226960][ T1358] ? trace_lock_acquire+0x14c/0x1f0 [ 185.227105][ T1358] ? lock_acquire+0x32/0xc0 [ 185.227257][ T1358] ? blocking_notifier_call_chain+0x50/0x90 [ 185.227444][ T1358] down_read+0x9f/0x340 [ 185.227559][ T1358] ? blocking_notifier_call_chain+0x50/0x90 [ 185.227742][ T1358] ? __pfx_down_read+0x10/0x10 [ 185.227890][ T1358] ? __lock_release+0x103/0x460 [ 185.228040][ T1358] ? netconsole_netdev_event+0x2c1/0x620 [ 185.228189][ T1358] ? __pfx___lock_release+0x10/0x10 [ 185.228335][ T1358] blocking_notifier_call_chain+0x50/0x90 [ 185.228486][ T1358] __netdev_upper_dev_unlink+0xd9/0x220 [ 185.228636][ T1358] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 185.228819][ T1358] ? __mutex_unlock_slowpath+0x14a/0x3d0 [ 185.228973][ T1358] ? __pfx___mutex_unlock_slowpath+0x10/0x10 [ 185.229163][ T1358] ? rtnl_is_locked+0x15/0x20 [ 185.229317][ T1358] netdev_upper_dev_unlink+0x71/0xa0 [ 185.229463][ T1358] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 185.229645][ T1358] ? mutex_is_locked+0x1c/0x60 [ 185.229796][ T1358] ? rtnl_is_locked+0x15/0x20 [ 185.229940][ T1358] ? netdev_master_upper_dev_get+0x13/0x120 [ 185.230135][ T1358] vrf_device_event+0x78/0xe0 [vrf] [ 185.230288][ T1358] notifier_call_chain+0xcd/0x150 [ 185.230433][ T1358] blocking_notifier_call_chain+0x66/0x90 [ 185.230578][ T1358] unregister_netdevice_many_notify+0xa7b/0x1580 [ 185.230762][ T1358] ? __lock_release+0x103/0x460 [ 185.230913][ T1358] ? __pfx___lock_release+0x10/0x10 [ 185.231064][ T1358] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 185.231259][ T1358] ? hlock_class+0x4e/0x130 [ 185.231412][ T1358] ? mark_held_locks+0x9e/0xe0 [ 185.231561][ T1358] ? __pfx_vlan_info_rcu_free+0x10/0x10 [ 185.231710][ T1358] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 185.231896][ T1358] rtnl_dellink+0x348/0xa40 [ 185.232049][ T1358] ? __pfx_rtnl_dellink+0x10/0x10 [ 185.232208][ T1358] ? find_held_lock+0x2c/0x110 [ 185.232367][ T1358] ? __lock_release+0x103/0x460 [ 185.232514][ T1358] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 185.232662][ T1358] ? __pfx___lock_release+0x10/0x10 [ 185.232806][ T1358] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 185.232962][ T1358] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 185.233107][ T1358] ? __pfx_rtnl_dellink+0x10/0x10 [ 185.233257][ T1358] rtnetlink_rcv_msg+0x712/0xc10 [ 185.233408][ T1358] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 185.233553][ T1358] ? hlock_class+0x4e/0x130 [ 185.233697][ T1358] ? mark_lock+0x38/0x3e0 [ 185.233811][ T1358] ? __lock_acquire+0xb9a/0x1680 [ 185.233960][ T1358] netlink_rcv_skb+0x130/0x360 [ 185.234107][ T1358] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 185.234254][ T1358] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 185.234411][ T1358] ? netlink_deliver_tap+0x13e/0x340 [ 185.234561][ T1358] ? netlink_deliver_tap+0xc3/0x340 [ 185.234707][ T1358] netlink_unicast+0x44b/0x710 [ 185.234851][ T1358] ? __pfx_netlink_unicast+0x10/0x10 [ 185.234998][ T1358] ? find_held_lock+0x2c/0x110 [ 185.235146][ T1358] netlink_sendmsg+0x723/0xbe0 [ 185.235291][ T1358] ? __pfx_netlink_sendmsg+0x10/0x10 [ 185.235445][ T1358] ____sys_sendmsg+0x7ac/0xa10 [ 185.235599][ T1358] ? __pfx_____sys_sendmsg+0x10/0x10 [ 185.235745][ T1358] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 185.235927][ T1358] ___sys_sendmsg+0xee/0x170 [ 185.236073][ T1358] ? __pfx____sys_sendmsg+0x10/0x10 [ 185.236221][ T1358] ? kasan_save_stack+0x34/0x50 [ 185.236368][ T1358] ? kasan_save_stack+0x24/0x50 [ 185.236512][ T1358] ? __kasan_record_aux_stack+0x8e/0xa0 [ 185.236663][ T1358] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 185.236851][ T1358] ? __x64_sys_close+0x7c/0xd0 [ 185.236997][ T1358] ? do_syscall_64+0xc1/0x1d0 [ 185.237144][ T1358] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 185.237327][ T1358] ? __lock_acquire+0xb9a/0x1680 [ 185.237477][ T1358] ? find_held_lock+0x2c/0x110 [ 185.237623][ T1358] ? __lock_release+0x103/0x460 [ 185.237771][ T1358] ? __virt_addr_valid+0x22b/0x430 [ 185.237923][ T1358] ? __pfx___lock_release+0x10/0x10 [ 185.238068][ T1358] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 185.238216][ T1358] __sys_sendmsg+0x109/0x1a0 [ 185.238362][ T1358] ? __pfx___sys_sendmsg+0x10/0x10 [ 185.238509][ T1358] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 185.238698][ T1358] do_syscall_64+0xc1/0x1d0 [ 185.238848][ T1358] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 185.239028][ T1358] RIP: 0033:0x7fa1373ed9a7 [ 185.239185][ T1358] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 185.239697][ T1358] RSP: 002b:00007ffe7abdad28 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 185.239924][ T1358] RAX: ffffffffffffffda RBX: 00007ffe7abdb450 RCX: 00007fa1373ed9a7 [ 185.240144][ T1358] RDX: 0000000000000000 RSI: 00007ffe7abdad90 RDI: 0000000000000005 [ 185.240364][ T1358] RBP: 0000000000000002 R08: 0000000000000003 R09: 0000000000000078 [ 185.240586][ T1358] R10: 00007fa1372abef8 R11: 0000000000000246 R12: 0000000000000002 [ 185.240809][ T1358] R13: 0000000067795567 R14: 0000000000498600 R15: 0000000000000000 [ 185.241033][ T1358] [ 186.417653][ T1390] veth1: entered promiscuous mode [ 186.553872][ T1394] veth1: left promiscuous mode [ 188.285848][ T1425] br0: port 1(veth1) entered blocking state [ 188.286105][ T1425] br0: port 1(veth1) entered disabled state [ 188.286326][ T1425] veth1: entered allmulticast mode [ 188.288091][ T1425] veth1: entered promiscuous mode [ 188.289679][ T1425] br0: port 1(veth1) entered blocking state [ 188.289922][ T1425] br0: port 1(veth1) entered forwarding state [ 201.207065][ T1470] veth1.100: entered promiscuous mode [ 206.946468][ T1485] veth1.100: left promiscuous mode [ 209.937797][ T1512] veth1.100: entered allmulticast mode [ 215.629412][ T1527] veth1.100: left allmulticast mode [ 227.691145][ T1692] veth1: left allmulticast mode [ 227.691486][ T1692] veth1: left promiscuous mode [ 227.691922][ T1692] br0: port 1(veth1) entered disabled state [ 229.041801][ T1725] veth1: entered promiscuous mode [ 229.195846][ T1729] veth1: left promiscuous mode [ 230.942812][ T1760] br0: port 1(veth1) entered blocking state [ 230.943108][ T1760] br0: port 1(veth1) entered disabled state [ 230.943363][ T1760] veth1: entered allmulticast mode [ 230.944926][ T1760] veth1: entered promiscuous mode [ 230.945862][ T1760] br0: port 1(veth1) entered blocking state [ 230.946073][ T1760] br0: port 1(veth1) entered forwarding state [ 244.020388][ T1805] veth1.100: entered promiscuous mode [ 249.803275][ T1820] veth1.100: left promiscuous mode [ 252.920503][ T1847] veth1.100: entered allmulticast mode [ 258.610752][ T1862] veth1.100: left allmulticast mode [ 270.450052][ T2027] veth1: left allmulticast mode [ 270.450234][ T2027] veth1: left promiscuous mode [ 270.450510][ T2027] br0: port 1(veth1) entered disabled state [ 272.235513][ T2067] br0: port 1(veth1) entered blocking state [ 272.235785][ T2067] br0: port 1(veth1) entered disabled state [ 272.236025][ T2067] veth1: entered allmulticast mode [ 272.237540][ T2067] veth1: entered promiscuous mode [ 272.286986][ T202] br0: port 1(veth1) entered blocking state [ 272.287243][ T202] br0: port 1(veth1) entered forwarding state [ 272.593017][ T2074] br0: port 1(veth1) entered disabled state [ 272.594110][ T2074] br0: port 1(veth1) entered blocking state [ 272.594349][ T2074] br0: port 1(veth1) entered forwarding state [ 273.136278][ T2085] br0: entered promiscuous mode [ 285.724233][ T2125] br0.100: entered promiscuous mode [ 291.395538][ T2140] br0.100: left promiscuous mode [ 294.283985][ T2167] br0.100: entered allmulticast mode [ 294.284196][ T2167] br0: entered allmulticast mode [ 299.979221][ T2182] br0.100: left allmulticast mode [ 299.979425][ T2182] br0: left allmulticast mode [ 304.239174][ T2250] br0: left promiscuous mode [ 304.422002][ T2254] br0: port 1(veth1) entered disabled state [ 304.767523][ T2259] veth1: left allmulticast mode [ 304.767716][ T2259] veth1: left promiscuous mode [ 304.767994][ T2259] br0: port 1(veth1) entered disabled state [ 306.244415][ T2291] br0: port 1(veth1) entered blocking state [ 306.244647][ T2291] br0: port 1(veth1) entered disabled state [ 306.244867][ T2291] veth1: entered allmulticast mode [ 306.246409][ T2291] veth1: entered promiscuous mode [ 306.247534][ T2291] br0: port 1(veth1) entered blocking state [ 306.247736][ T2291] br0: port 1(veth1) entered forwarding state [ 306.600522][ T2298] br0: port 1(veth1) entered disabled state [ 306.608900][ T2298] br0: port 1(veth1) entered blocking state [ 306.609214][ T2298] br0: port 1(veth1) entered forwarding state [ 307.162261][ T2309] br0: entered promiscuous mode [ 319.971562][ T2352] br0.100: entered promiscuous mode [ 325.710869][ T2367] br0.100: left promiscuous mode [ 328.728582][ T2394] br0.100: entered allmulticast mode [ 328.728759][ T2394] br0: entered allmulticast mode [ 334.451887][ T2409] br0.100: left allmulticast mode [ 334.452077][ T2409] br0: left allmulticast mode [ 338.820800][ T2479] br0: left promiscuous mode [ 339.007302][ T2483] br0: port 1(veth1) entered disabled state [ 339.316821][ T2488] veth1: left allmulticast mode [ 339.317004][ T2488] veth1: left promiscuous mode [ 339.317256][ T2488] br0: port 1(veth1) entered disabled state