[ 129.732778][ T1462] IPVS: Registered protocols (TCP) [ 129.734001][ T1462] IPVS: Connection hash table configured (size=4096, memory=32Kbytes) [ 129.736004][ T1462] IPVS: ipvs loaded. [ 131.835456][ T1483] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. [ 132.031593][ T1484] br0: port 1(veth01) entered blocking state [ 132.032062][ T1484] br0: port 1(veth01) entered disabled state [ 132.032522][ T1484] veth01: entered allmulticast mode [ 132.034500][ T1484] veth01: entered promiscuous mode [ 132.209487][ T1485] br0: port 2(veth02) entered blocking state [ 132.209828][ T1485] br0: port 2(veth02) entered disabled state [ 132.210094][ T1485] veth02: entered allmulticast mode [ 132.212216][ T1485] veth02: entered promiscuous mode [ 132.725216][ T40] br0: port 1(veth01) entered blocking state [ 132.725710][ T40] br0: port 1(veth01) entered forwarding state [ 133.771371][ T37] br0: port 2(veth02) entered blocking state [ 133.771645][ T37] br0: port 2(veth02) entered forwarding state [ 135.703346][ T1501] IPVS: [rr] scheduler registered. [ 135.719762][ T10] IPVS: starting estimator thread 0... [ 135.783367][ T1502] IPVS: using max 44 ests per chain, 105600 per kthread [ 137.536706][ T11] veth02: left allmulticast mode [ 137.537063][ T11] veth02: left promiscuous mode [ 137.537434][ T11] br0: port 2(veth02) entered disabled state [ 137.540509][ T11] veth01: left allmulticast mode [ 137.540694][ T11] veth01: left promiscuous mode [ 137.540982][ T11] br0: port 1(veth01) entered disabled state [ 138.079690][ T11] IPVS: stop unused estimator thread 0... [ 141.290798][ T1561] br0: port 1(veth01) entered blocking state [ 141.291118][ T1561] br0: port 1(veth01) entered disabled state [ 141.292432][ T1561] veth01: entered allmulticast mode [ 141.294384][ T1561] veth01: entered promiscuous mode [ 141.469967][ T1562] br0: port 2(veth02) entered blocking state [ 141.470338][ T1562] br0: port 2(veth02) entered disabled state [ 141.470598][ T1562] veth02: entered allmulticast mode [ 141.473546][ T1562] veth02: entered promiscuous mode [ 142.015073][ T40] br0: port 1(veth01) entered blocking state [ 142.015442][ T40] br0: port 1(veth01) entered forwarding state [ 143.115621][ T138] br0: port 2(veth02) entered blocking state [ 143.115896][ T138] br0: port 2(veth02) entered forwarding state [ 144.969704][ T56] IPVS: starting estimator thread 0... [ 145.033315][ T1578] IPVS: using max 43 ests per chain, 103200 per kthread [ 145.498755][ T1581] br0: port 2(veth02) entered disabled state [ 145.648075][ T1581] veth02 (unregistering): left allmulticast mode [ 145.648532][ T1581] veth02 (unregistering): left promiscuous mode [ 145.648775][ T1581] br0: port 2(veth02) entered disabled state [ 145.650234][ T1581] [ 145.650349][ T1581] ============================================ [ 145.650563][ T1581] WARNING: possible recursive locking detected [ 145.650779][ T1581] 6.13.0-rc5-virtme #1 Not tainted [ 145.650931][ T1581] -------------------------------------------- [ 145.651119][ T1581] ip/1581 is trying to acquire lock: [ 145.651276][ T1581] ffffffff9a5dfc30 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 145.651595][ T1581] [ 145.651595][ T1581] but task is already holding lock: [ 145.651832][ T1581] ffffffff9a5dfc30 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 145.652154][ T1581] [ 145.652154][ T1581] other info that might help us debug this: [ 145.652381][ T1581] Possible unsafe locking scenario: [ 145.652381][ T1581] [ 145.652605][ T1581] CPU0 [ 145.652719][ T1581] ---- [ 145.652836][ T1581] lock((netdev_chain).rwsem); [ 145.652990][ T1581] lock((netdev_chain).rwsem); [ 145.653149][ T1581] [ 145.653149][ T1581] *** DEADLOCK *** [ 145.653149][ T1581] [ 145.653376][ T1581] May be due to missing lock nesting notation [ 145.653376][ T1581] [ 145.653603][ T1581] 2 locks held by ip/1581: [ 145.653756][ T1581] #0: ffffffff9a5f1088 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_dellink+0x228/0xa40 [ 145.654038][ T1581] #1: ffffffff9a5dfc30 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 145.654376][ T1581] [ 145.654376][ T1581] stack backtrace: [ 145.654588][ T1581] CPU: 3 UID: 0 PID: 1581 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 145.654831][ T1581] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 145.655023][ T1581] Call Trace: [ 145.655142][ T1581] [ 145.655229][ T1581] dump_stack_lvl+0x82/0xd0 [ 145.655390][ T1581] print_deadlock_bug+0x40a/0x650 [ 145.655549][ T1581] validate_chain+0x5bf/0xae0 [ 145.655707][ T1581] ? __pfx_validate_chain+0x10/0x10 [ 145.655863][ T1581] ? hlock_class+0x4e/0x130 [ 145.656020][ T1581] ? mark_lock+0x38/0x3e0 [ 145.656139][ T1581] __lock_acquire+0xb9a/0x1680 [ 145.656299][ T1581] lock_acquire.part.0+0xeb/0x330 [ 145.656458][ T1581] ? blocking_notifier_call_chain+0x50/0x90 [ 145.656652][ T1581] ? find_held_lock+0x2c/0x110 [ 145.656808][ T1581] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 145.656964][ T1581] ? trace_lock_acquire+0x14c/0x1f0 [ 145.657121][ T1581] ? lock_acquire+0x32/0xc0 [ 145.657281][ T1581] ? blocking_notifier_call_chain+0x50/0x90 [ 145.657474][ T1581] down_read+0x9f/0x340 [ 145.657595][ T1581] ? blocking_notifier_call_chain+0x50/0x90 [ 145.657787][ T1581] ? __pfx_down_read+0x10/0x10 [ 145.657945][ T1581] ? lockdep_hardirqs_on_prepare+0x12b/0x410 [ 145.658140][ T1581] blocking_notifier_call_chain+0x50/0x90 [ 145.658298][ T1581] __netdev_upper_dev_unlink+0xd9/0x220 [ 145.658453][ T1581] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 145.658647][ T1581] ? find_held_lock+0x2c/0x110 [ 145.658810][ T1581] ? del_nbp+0x377/0xbe0 [bridge] [ 145.659015][ T1581] ? hlock_class+0x4e/0x130 [ 145.659173][ T1581] netdev_upper_dev_unlink+0x71/0xa0 [ 145.659328][ T1581] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 145.659519][ T1581] ? mutex_spin_on_owner+0x282/0x2b0 [ 145.659674][ T1581] ? rtnl_is_locked+0x15/0x20 [ 145.659831][ T1581] del_nbp+0x602/0xbe0 [bridge] [ 145.660028][ T1581] br_del_if+0xa3/0x1f0 [bridge] [ 145.660219][ T1581] br_device_event+0x53d/0x800 [bridge] [ 145.660407][ T1581] ? __pfx_br_device_event+0x10/0x10 [bridge] [ 145.660641][ T1581] ? ip_vs_dst_event+0x3d/0x770 [ip_vs] [ 145.660827][ T1581] ? nft_offload_netdev_event+0x158/0x3b0 [nf_tables] [ 145.661071][ T1581] notifier_call_chain+0xcd/0x150 [ 145.661245][ T1581] blocking_notifier_call_chain+0x66/0x90 [ 145.661423][ T1581] unregister_netdevice_many_notify+0xa7b/0x1580 [ 145.661638][ T1581] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 145.661861][ T1581] ? rtnl_dellink+0x228/0xa40 [ 145.662033][ T1581] ? sock_def_readable+0x11e/0x300 [ 145.662207][ T1581] ? rtnl_is_locked+0x15/0x20 [ 145.662376][ T1581] ? unregister_netdevice_queue+0x70/0x410 [ 145.662591][ T1581] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 145.662804][ T1581] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 145.663017][ T1581] rtnl_dellink+0x348/0xa40 [ 145.663187][ T1581] ? __pfx_rtnl_dellink+0x10/0x10 [ 145.663372][ T1581] ? find_held_lock+0x2c/0x110 [ 145.663544][ T1581] ? __lock_release+0x103/0x460 [ 145.663713][ T1581] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 145.663885][ T1581] ? __pfx___lock_release+0x10/0x10 [ 145.664060][ T1581] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 145.664233][ T1581] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 145.664404][ T1581] ? __pfx_rtnl_dellink+0x10/0x10 [ 145.664573][ T1581] rtnetlink_rcv_msg+0x712/0xc10 [ 145.664743][ T1581] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 145.664914][ T1581] ? hlock_class+0x4e/0x130 [ 145.665082][ T1581] ? mark_lock+0x38/0x3e0 [ 145.665217][ T1581] ? __lock_acquire+0xb9a/0x1680 [ 145.665388][ T1581] netlink_rcv_skb+0x130/0x360 [ 145.665560][ T1581] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 145.665732][ T1581] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 145.665906][ T1581] ? netlink_deliver_tap+0x13e/0x340 [ 145.666079][ T1581] ? netlink_deliver_tap+0xc3/0x340 [ 145.666253][ T1581] netlink_unicast+0x44b/0x710 [ 145.666427][ T1581] ? __pfx_netlink_unicast+0x10/0x10 [ 145.666602][ T1581] netlink_sendmsg+0x723/0xbe0 [ 145.666774][ T1581] ? __pfx_netlink_sendmsg+0x10/0x10 [ 145.666945][ T1581] ? __kasan_kmalloc+0x7f/0x90 [ 145.667118][ T1581] ____sys_sendmsg+0x7ac/0xa10 [ 145.667290][ T1581] ? __pfx_____sys_sendmsg+0x10/0x10 [ 145.667458][ T1581] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 145.667679][ T1581] ___sys_sendmsg+0xee/0x170 [ 145.667857][ T1581] ? __pfx____sys_sendmsg+0x10/0x10 [ 145.668031][ T1581] ? kasan_save_stack+0x34/0x50 [ 145.668204][ T1581] ? kasan_save_stack+0x24/0x50 [ 145.668373][ T1581] ? __kasan_record_aux_stack+0x8e/0xa0 [ 145.668544][ T1581] ? __call_rcu_common.constprop.0+0xa1/0x4b0 [ 145.668757][ T1581] ? __x64_sys_close+0x7c/0xd0 [ 145.668934][ T1581] ? do_syscall_64+0xc1/0x1d0 [ 145.669104][ T1581] ? entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 145.669317][ T1581] ? __lock_acquire+0xb9a/0x1680 [ 145.669487][ T1581] ? find_held_lock+0x2c/0x110 [ 145.669658][ T1581] ? __lock_release+0x103/0x460 [ 145.669828][ T1581] ? __virt_addr_valid+0x22b/0x430 [ 145.669999][ T1581] ? __pfx___lock_release+0x10/0x10 [ 145.670173][ T1581] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 145.670348][ T1581] __sys_sendmsg+0x109/0x1a0 [ 145.670525][ T1581] ? __pfx___sys_sendmsg+0x10/0x10 [ 145.670694][ T1581] ? kfree+0x2d/0x330 [ 145.670828][ T1581] do_syscall_64+0xc1/0x1d0 [ 145.671000][ T1581] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 145.671210][ T1581] RIP: 0033:0x7faaab1cb9a7 [ 145.671388][ T1581] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 145.672003][ T1581] RSP: 002b:00007ffcb1011458 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 145.672259][ T1581] RAX: ffffffffffffffda RBX: 00007ffcb1011b80 RCX: 00007faaab1cb9a7 [ 145.672518][ T1581] RDX: 0000000000000000 RSI: 00007ffcb10114c0 RDI: 0000000000000005 [ 145.672766][ T1581] RBP: 0000000000000001 R08: 0000000000000003 R09: 0000000000000078 [ 145.673021][ T1581] R10: 00007faaab089ef8 R11: 0000000000000246 R12: 0000000000000001 [ 145.673271][ T1581] R13: 0000000067792c48 R14: 0000000000498600 R15: 0000000000000000 [ 145.673524][ T1581] [ 145.708243][ T1581] ip (1581) used greatest stack depth: 23544 bytes left [ 146.469310][ T11] veth01: left allmulticast mode [ 146.469486][ T11] veth01: left promiscuous mode [ 146.469770][ T11] br0: port 1(veth01) entered disabled state [ 146.868791][ T11] IPVS: stop unused estimator thread 0... [ 149.168795][ T1633] br0: port 1(veth01) entered blocking state [ 149.169017][ T1633] br0: port 1(veth01) entered disabled state [ 149.169242][ T1633] veth01: entered allmulticast mode [ 149.170726][ T1633] veth01: entered promiscuous mode [ 149.321825][ T1634] br0: port 2(veth02) entered blocking state [ 149.322066][ T1634] br0: port 2(veth02) entered disabled state [ 149.322294][ T1634] veth02: entered allmulticast mode [ 149.323743][ T1634] veth02: entered promiscuous mode [ 149.692024][ T37] br0: port 1(veth01) entered blocking state [ 149.692288][ T37] br0: port 1(veth01) entered forwarding state [ 150.530372][ T40] br0: port 2(veth02) entered blocking state [ 150.530644][ T40] br0: port 2(veth02) entered forwarding state [ 152.040086][ T1648] ipip: IPv4 and MPLS over IPv4 tunneling driver [ 152.598204][ T51] IPVS: starting estimator thread 0... [ 152.662334][ T1657] IPVS: using max 92 ests per chain, 220800 per kthread [ 154.358443][ T11] veth02: left allmulticast mode [ 154.358699][ T11] veth02: left promiscuous mode [ 154.359090][ T11] br0: port 2(veth02) entered disabled state [ 154.360198][ T11] veth01: left allmulticast mode [ 154.360472][ T11] veth01: left promiscuous mode [ 154.360819][ T11] br0: port 1(veth01) entered disabled state [ 154.845834][ T11] IPVS: stop unused estimator thread 0...