[ 62.846509][ T1377] 8021q: 802.1Q VLAN Support v1.8 [ 66.574474][ T1422] br1: port 1(vx10) entered blocking state [ 66.574816][ T1422] br1: port 1(vx10) entered disabled state [ 66.576711][ T1422] vx10: entered allmulticast mode [ 66.579055][ T1422] vx10: entered promiscuous mode [ 66.580187][ T1422] br1: port 1(vx10) entered blocking state [ 66.580601][ T1422] br1: port 1(vx10) entered forwarding state [ 67.007288][ T1427] br1: port 2(vx20) entered blocking state [ 67.007631][ T1427] br1: port 2(vx20) entered disabled state [ 67.007946][ T1427] vx20: entered allmulticast mode [ 67.010104][ T1427] vx20: entered promiscuous mode [ 67.011112][ T1427] br1: port 2(vx20) entered blocking state [ 67.011609][ T1427] br1: port 2(vx20) entered forwarding state [ 67.181011][ T1429] br1: port 3(veth1) entered blocking state [ 67.181308][ T1429] br1: port 3(veth1) entered disabled state [ 67.181586][ T1429] veth1: entered allmulticast mode [ 67.184248][ T1429] veth1: entered promiscuous mode [ 67.263803][ T39] br1: port 3(veth1) entered blocking state [ 67.264540][ T39] br1: port 3(veth1) entered forwarding state [ 67.507410][ T1433] br1: port 4(veth2) entered blocking state [ 67.507688][ T1433] br1: port 4(veth2) entered disabled state [ 67.507965][ T1433] veth2: entered allmulticast mode [ 67.510840][ T1433] veth2: entered promiscuous mode [ 67.598423][ T39] br1: port 4(veth2) entered blocking state [ 67.598764][ T39] br1: port 4(veth2) entered forwarding state [ 71.199531][ T1485] br2: port 1(w1) entered blocking state [ 71.199841][ T1485] br2: port 1(w1) entered disabled state [ 71.200114][ T1485] w1: entered allmulticast mode [ 71.202104][ T1485] w1: entered promiscuous mode [ 71.940418][ T1493] br2: port 2(vx10) entered blocking state [ 71.940778][ T1493] br2: port 2(vx10) entered disabled state [ 71.941313][ T1493] vx10: entered allmulticast mode [ 71.943351][ T1493] vx10: entered promiscuous mode [ 71.943942][ T1493] br2: port 2(vx10) entered blocking state [ 71.944250][ T1493] br2: port 2(vx10) entered forwarding state [ 72.625655][ T1500] br2: port 3(vx20) entered blocking state [ 72.625988][ T1500] br2: port 3(vx20) entered disabled state [ 72.626947][ T1500] vx20: entered allmulticast mode [ 72.628965][ T1500] vx20: entered promiscuous mode [ 72.629558][ T1500] br2: port 3(vx20) entered blocking state [ 72.629847][ T1500] br2: port 3(vx20) entered forwarding state [ 73.334863][ T39] br2: port 1(w1) entered blocking state [ 73.335456][ T39] br2: port 1(w1) entered forwarding state [ 75.690863][ T1540] br2: port 1(w1) entered blocking state [ 75.691116][ T1540] br2: port 1(w1) entered disabled state [ 75.691363][ T1540] w1: entered allmulticast mode [ 75.694155][ T1540] w1: entered promiscuous mode [ 76.328891][ T1548] br2: port 2(vx10) entered blocking state [ 76.329320][ T1548] br2: port 2(vx10) entered disabled state [ 76.329639][ T1548] vx10: entered allmulticast mode [ 76.331586][ T1548] vx10: entered promiscuous mode [ 76.332241][ T1548] br2: port 2(vx10) entered blocking state [ 76.332527][ T1548] br2: port 2(vx10) entered forwarding state [ 76.919996][ T1555] br2: port 3(vx20) entered blocking state [ 76.920511][ T1555] br2: port 3(vx20) entered disabled state [ 76.920811][ T1555] vx20: entered allmulticast mode [ 76.922816][ T1555] vx20: entered promiscuous mode [ 76.923699][ T1555] br2: port 3(vx20) entered blocking state [ 76.923952][ T1555] br2: port 3(vx20) entered forwarding state [ 77.606693][ T39] br2: port 1(w1) entered blocking state [ 77.606979][ T39] br2: port 1(w1) entered forwarding state [ 125.487021][ T2288] veth3: entered promiscuous mode [ 172.910025][ T3215] veth3: left promiscuous mode [ 173.345191][ T3221] veth3: entered promiscuous mode [ 220.668201][ T4148] veth3: left promiscuous mode [ 221.578910][ T4166] vx20: left allmulticast mode [ 221.579324][ T4166] vx20: left promiscuous mode [ 221.579870][ T4166] br1: port 2(vx20) entered disabled state [ 221.669962][ T4167] vx10: left allmulticast mode [ 221.671171][ T4167] vx10: left promiscuous mode [ 221.671504][ T4167] br1: port 1(vx10) entered disabled state [ 227.074179][ T4172] br1: port 1(vx10) entered blocking state [ 227.074488][ T4172] br1: port 1(vx10) entered disabled state [ 227.074772][ T4172] vx10: entered allmulticast mode [ 227.076677][ T4172] vx10: entered promiscuous mode [ 227.077221][ T4172] br1: port 1(vx10) entered blocking state [ 227.077485][ T4172] br1: port 1(vx10) entered forwarding state [ 227.235508][ T4174] br1: port 2(vx20) entered blocking state [ 227.235854][ T4174] br1: port 2(vx20) entered disabled state [ 227.236156][ T4174] vx20: entered allmulticast mode [ 227.238305][ T4174] vx20: entered promiscuous mode [ 227.238801][ T4174] br1: port 2(vx20) entered blocking state [ 227.239039][ T4174] br1: port 2(vx20) entered forwarding state [ 273.824468][ T4852] veth3: entered promiscuous mode [ 323.092594][ T5779] veth3: left promiscuous mode [ 323.556313][ T5785] veth3: entered promiscuous mode [ 370.961657][ T6712] veth3: left promiscuous mode [ 372.180085][ T6735] vx20: left allmulticast mode [ 372.180337][ T6735] vx20: left promiscuous mode [ 372.180657][ T6735] br1: port 2(vx20) entered disabled state [ 372.247946][ T6736] vx10: left allmulticast mode [ 372.248233][ T6736] vx10: left promiscuous mode [ 372.248594][ T6736] br1: port 1(vx10) entered disabled state [ 377.633354][ T6741] br1: port 1(vx10) entered blocking state [ 377.633632][ T6741] br1: port 1(vx10) entered disabled state [ 377.633901][ T6741] vx10: entered allmulticast mode [ 377.636290][ T6741] vx10: entered promiscuous mode [ 377.636887][ T6741] br1: port 1(vx10) entered blocking state [ 377.637176][ T6741] br1: port 1(vx10) entered forwarding state [ 377.790981][ T6743] br1: port 2(vx20) entered blocking state [ 377.791288][ T6743] br1: port 2(vx20) entered disabled state [ 377.791589][ T6743] vx20: entered allmulticast mode [ 377.793800][ T6743] vx20: entered promiscuous mode [ 377.794328][ T6743] br1: port 2(vx20) entered blocking state [ 377.794585][ T6743] br1: port 2(vx20) entered forwarding state [ 683.625463][T10019] vx20: left allmulticast mode [ 683.625704][T10019] vx20: left promiscuous mode [ 683.626019][T10019] br1: port 2(vx20) entered disabled state [ 683.701524][T10020] vx10: left allmulticast mode [ 683.701765][T10020] vx10: left promiscuous mode [ 683.702086][T10020] br1: port 1(vx10) entered disabled state [ 689.083305][T10025] br1: port 1(vx10) entered blocking state [ 689.083597][T10025] br1: port 1(vx10) entered disabled state [ 689.083879][T10025] vx10: entered allmulticast mode [ 689.086759][T10025] vx10: entered promiscuous mode [ 689.087290][T10025] br1: port 1(vx10) entered blocking state [ 689.087535][T10025] br1: port 1(vx10) entered forwarding state [ 689.274286][T10027] br1: port 2(vx20) entered blocking state [ 689.274810][T10027] br1: port 2(vx20) entered disabled state [ 689.276346][T10027] vx20: entered allmulticast mode [ 689.278361][T10027] vx20: entered promiscuous mode [ 689.278894][T10027] br1: port 2(vx20) entered blocking state [ 689.279201][T10027] br1: port 2(vx20) entered forwarding state [ 793.388480][ T11] vx20: left allmulticast mode [ 793.388788][ T11] vx20: left promiscuous mode [ 793.389193][ T11] br2: port 3(vx20) entered disabled state [ 793.392990][ T11] vx10: left allmulticast mode [ 793.393261][ T11] vx10: left promiscuous mode [ 793.393576][ T11] br2: port 2(vx10) entered disabled state [ 793.396011][ T11] w1: left allmulticast mode [ 793.396262][ T11] w1: left promiscuous mode [ 793.396571][ T11] br2: port 1(w1) entered disabled state [ 793.992654][ T11] vx20: left allmulticast mode [ 793.992962][ T11] vx20: left promiscuous mode [ 793.994495][ T11] br2: port 3(vx20) entered disabled state [ 793.996808][ T11] vx10: left allmulticast mode [ 793.997076][ T11] vx10: left promiscuous mode [ 793.998833][ T11] br2: port 2(vx10) entered disabled state [ 794.002533][ T11] w1: left allmulticast mode [ 794.002782][ T11] w1: left promiscuous mode [ 794.003084][ T11] br2: port 1(w1) entered disabled state [ 796.213736][T11931] br1: port 4(veth2) entered disabled state [ 796.315805][T11932] veth2: left allmulticast mode [ 796.316178][T11932] veth2: left promiscuous mode [ 796.316679][T11932] br1: port 4(veth2) entered disabled state [ 796.559661][T11935] br1: port 3(veth1) entered disabled state [ 796.628403][T11936] veth1: left allmulticast mode [ 796.628636][T11936] veth1: left promiscuous mode [ 796.628955][T11936] br1: port 3(veth1) entered disabled state [ 796.798344][T11938] vx20: left allmulticast mode [ 796.798603][T11938] vx20: left promiscuous mode [ 796.798940][T11938] br1: port 2(vx20) entered disabled state [ 797.127376][T11942] vx10: left allmulticast mode [ 797.127605][T11942] vx10: left promiscuous mode [ 797.127917][T11942] br1: port 1(vx10) entered disabled state [ 797.975002][T11951] [ 797.975214][T11951] ============================================ [ 797.975399][T11951] WARNING: possible recursive locking detected [ 797.975604][T11951] 6.13.0-rc5-virtme #1 Not tainted [ 797.975755][T11951] -------------------------------------------- [ 797.975933][T11951] ip/11951 is trying to acquire lock: [ 797.976079][T11951] ffffffffaabd6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 797.976384][T11951] [ 797.976384][T11951] but task is already holding lock: [ 797.976601][T11951] ffffffffaabd6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 797.976894][T11951] [ 797.976894][T11951] other info that might help us debug this: [ 797.977106][T11951] Possible unsafe locking scenario: [ 797.977106][T11951] [ 797.977336][T11951] CPU0 [ 797.977450][T11951] ---- [ 797.977565][T11951] lock((netdev_chain).rwsem); [ 797.977712][T11951] lock((netdev_chain).rwsem); [ 797.977860][T11951] [ 797.977860][T11951] *** DEADLOCK *** [ 797.977860][T11951] [ 797.978076][T11951] May be due to missing lock nesting notation [ 797.978076][T11951] [ 797.978288][T11951] 2 locks held by ip/11951: [ 797.978436][T11951] #0: ffffffffaabe7a48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_dellink+0x228/0xa40 [ 797.978717][T11951] #1: ffffffffaabd6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 797.979018][T11951] [ 797.979018][T11951] stack backtrace: [ 797.979201][T11951] CPU: 2 UID: 0 PID: 11951 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 797.979420][T11951] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 797.979614][T11951] Call Trace: [ 797.979726][T11951] [ 797.979804][T11951] dump_stack_lvl+0x82/0xd0 [ 797.979957][T11951] print_deadlock_bug+0x40a/0x650 [ 797.980110][T11951] validate_chain+0x5bf/0xae0 [ 797.980265][T11951] ? __pfx_validate_chain+0x10/0x10 [ 797.980416][T11951] ? hlock_class+0x4e/0x130 [ 797.980563][T11951] ? mark_lock+0x38/0x3e0 [ 797.980678][T11951] __lock_acquire+0xb9a/0x1680 [ 797.980828][T11951] lock_acquire.part.0+0xeb/0x330 [ 797.980973][T11951] ? blocking_notifier_call_chain+0x50/0x90 [ 797.981157][T11951] ? netconsole_process_cleanups_core+0x2e/0x3d0 [ 797.981354][T11951] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 797.981501][T11951] ? trace_lock_acquire+0x14c/0x1f0 [ 797.981654][T11951] ? lock_acquire+0x32/0xc0 [ 797.981806][T11951] ? blocking_notifier_call_chain+0x50/0x90 [ 797.982002][T11951] down_read+0x9f/0x340 [ 797.982117][T11951] ? blocking_notifier_call_chain+0x50/0x90 [ 797.982302][T11951] ? __pfx_down_read+0x10/0x10 [ 797.982458][T11951] ? __lock_release+0x103/0x460 [ 797.982607][T11951] ? netconsole_netdev_event+0x2c1/0x620 [ 797.982756][T11951] ? __pfx___lock_release+0x10/0x10 [ 797.982909][T11951] blocking_notifier_call_chain+0x50/0x90 [ 797.983061][T11951] __netdev_upper_dev_unlink+0xd9/0x220 [ 797.983215][T11951] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 797.983401][T11951] ? __mutex_unlock_slowpath+0x14a/0x3d0 [ 797.983557][T11951] ? __pfx___mutex_unlock_slowpath+0x10/0x10 [ 797.983740][T11951] ? rtnl_is_locked+0x15/0x20 [ 797.983889][T11951] netdev_upper_dev_unlink+0x71/0xa0 [ 797.984033][T11951] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 797.984216][T11951] ? netconsole_netdev_event+0x2c1/0x620 [ 797.984361][T11951] ? mutex_is_locked+0x1c/0x60 [ 797.984510][T11951] ? rtnl_is_locked+0x15/0x20 [ 797.984663][T11951] ? netdev_master_upper_dev_get+0x13/0x120 [ 797.984842][T11951] vrf_device_event+0x78/0xe0 [vrf] [ 797.984995][T11951] notifier_call_chain+0xcd/0x150 [ 797.985154][T11951] blocking_notifier_call_chain+0x66/0x90 [ 797.985300][T11951] unregister_netdevice_many_notify+0xa7b/0x1580 [ 797.985481][T11951] ? hlock_class+0x4e/0x130 [ 797.985640][T11951] ? mark_lock+0x38/0x3e0 [ 797.985758][T11951] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 797.985940][T11951] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 797.986123][T11951] ? kfree+0xf3/0x330 [ 797.986244][T11951] ? vlan_vid_del+0x310/0x5e0 [ 797.986413][T11951] ? vlan_vid_del+0x310/0x5e0 [ 797.986559][T11951] rtnl_dellink+0x348/0xa40 [ 797.986707][T11951] ? __pfx_rtnl_dellink+0x10/0x10 [ 797.986870][T11951] ? find_held_lock+0x2c/0x110 [ 797.987026][T11951] ? __lock_release+0x103/0x460 [ 797.987172][T11951] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 797.987324][T11951] ? __pfx___lock_release+0x10/0x10 [ 797.987492][T11951] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 797.987641][T11951] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 797.987793][T11951] ? __pfx_rtnl_dellink+0x10/0x10 [ 797.987940][T11951] rtnetlink_rcv_msg+0x712/0xc10 [ 797.988092][T11951] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 797.988263][T11951] ? hlock_class+0x4e/0x130 [ 797.988406][T11951] ? mark_lock+0x38/0x3e0 [ 797.988518][T11951] ? __lock_acquire+0xb9a/0x1680 [ 797.988679][T11951] netlink_rcv_skb+0x130/0x360 [ 797.988824][T11951] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 797.988969][T11951] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 797.989134][T11951] ? netlink_deliver_tap+0x13e/0x340 [ 797.989284][T11951] ? netlink_deliver_tap+0xc3/0x340 [ 797.989431][T11951] netlink_unicast+0x44b/0x710 [ 797.989585][T11951] ? __pfx_netlink_unicast+0x10/0x10 [ 797.989728][T11951] ? find_held_lock+0x2c/0x110 [ 797.989875][T11951] netlink_sendmsg+0x723/0xbe0 [ 797.990021][T11951] ? __pfx_netlink_sendmsg+0x10/0x10 [ 797.990174][T11951] ____sys_sendmsg+0x7ac/0xa10 [ 797.990320][T11951] ? __pfx_____sys_sendmsg+0x10/0x10 [ 797.990467][T11951] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 797.990654][T11951] ___sys_sendmsg+0xee/0x170 [ 797.990799][T11951] ? __pfx____sys_sendmsg+0x10/0x10 [ 797.990945][T11951] ? kasan_save_stack+0x34/0x50 [ 797.991093][T11951] ? kasan_save_stack+0x24/0x50 [ 797.991244][T11951] ? __kasan_record_aux_stack+0x8e/0xa0 [ 797.991397][T11951] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 797.991583][T11951] ? __x64_sys_close+0x7c/0xd0 [ 797.991729][T11951] ? do_syscall_64+0xc1/0x1d0 [ 797.991875][T11951] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 797.992087][T11951] ? __lock_acquire+0xb9a/0x1680 [ 797.992240][T11951] ? find_held_lock+0x2c/0x110 [ 797.992386][T11951] ? __lock_release+0x103/0x460 [ 797.992543][T11951] ? __virt_addr_valid+0x22b/0x430 [ 797.992696][T11951] ? __pfx___lock_release+0x10/0x10 [ 797.992842][T11951] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 797.992993][T11951] __sys_sendmsg+0x109/0x1a0 [ 797.993145][T11951] ? __pfx___sys_sendmsg+0x10/0x10 [ 797.993297][T11951] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 797.993500][T11951] do_syscall_64+0xc1/0x1d0 [ 797.993651][T11951] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 797.993837][T11951] RIP: 0033:0x7f096f3ac9a7 [ 797.993994][T11951] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 797.994523][T11951] RSP: 002b:00007fffc1cca248 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 797.994756][T11951] RAX: ffffffffffffffda RBX: 00007fffc1cca970 RCX: 00007f096f3ac9a7 [ 797.994980][T11951] RDX: 0000000000000000 RSI: 00007fffc1cca2b0 RDI: 0000000000000005 [ 797.995203][T11951] RBP: 0000000000000002 R08: 0000000000000003 R09: 0000000000000078 [ 797.995428][T11951] R10: 00007f096f26aef8 R11: 0000000000000246 R12: 0000000000000002 [ 797.995673][T11951] R13: 0000000067792ef3 R14: 0000000000498600 R15: 0000000000000000 [ 797.995898][T11951]