[ 10.936161][ T260] ip (260) used greatest stack depth: 23552 bytes left [ 14.314487][ T314] gre: GRE over IPv4 demultiplexor driver [ 14.327576][ T314] ip_gre: GRE over IPv4 tunneling driver [ 14.973214][ T324] GACT probability NOT on [ 15.187802][ T326] ip6_gre: GRE over IPv6 tunneling driver [ 15.319129][ T69] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 15.341520][ T11] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 15.433516][ T9] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 15.652849][ T9] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 16.069646][ T11] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 16.329153][ T340] br1: port 1(veth1) entered blocking state [ 16.329574][ T340] br1: port 1(veth1) entered disabled state [ 16.329925][ T340] veth1: entered allmulticast mode [ 16.331901][ T340] veth1: entered promiscuous mode [ 16.416492][ T40] br1: port 1(veth1) entered blocking state [ 16.416926][ T40] br1: port 1(veth1) entered forwarding state [ 16.493412][ T342] br1: port 2(veth2) entered blocking state [ 16.493748][ T342] br1: port 2(veth2) entered disabled state [ 16.494017][ T342] veth2: entered allmulticast mode [ 16.495872][ T342] veth2: entered promiscuous mode [ 16.578386][ T37] br1: port 2(veth2) entered blocking state [ 16.578660][ T37] br1: port 2(veth2) entered forwarding state [ 17.075549][ T55] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 17.093797][ T11] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 17.094544][ T11] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 17.668840][ T11] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 18.053503][ T55] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 21.060501][ C1] ip6_tnl_xmit_ctl: 1 callbacks suppressed [ 21.060931][ C1] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 23.509663][ T378] Mirror/redirect action on [ 29.124636][ C2] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 45.508625][ C1] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 60.785908][ T583] br1: port 1(veth1) entered disabled state [ 60.870549][ T584] br1: port 2(veth2) entered disabled state [ 60.948633][ T585] veth2: left allmulticast mode [ 60.948884][ T585] veth2: left promiscuous mode [ 60.949219][ T585] br1: port 2(veth2) entered disabled state [ 60.952229][ T585] veth1: left allmulticast mode [ 60.952594][ T585] veth1: left promiscuous mode [ 60.952902][ T585] br1: port 1(veth1) entered disabled state [ 61.216949][ T587] [ 61.217144][ T587] ============================================ [ 61.217364][ T587] WARNING: possible recursive locking detected [ 61.217608][ T587] 6.13.0-rc5-virtme #1 Not tainted [ 61.217780][ T587] -------------------------------------------- [ 61.218002][ T587] ip/587 is trying to acquire lock: [ 61.218182][ T587] ffffffff9cbd6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 61.218547][ T587] [ 61.218547][ T587] but task is already holding lock: [ 61.218799][ T587] ffffffff9cbd6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 61.219148][ T587] [ 61.219148][ T587] other info that might help us debug this: [ 61.219419][ T587] Possible unsafe locking scenario: [ 61.219419][ T587] [ 61.219669][ T587] CPU0 [ 61.219797][ T587] ---- [ 61.219928][ T587] lock((netdev_chain).rwsem); [ 61.220100][ T587] lock((netdev_chain).rwsem); [ 61.220273][ T587] [ 61.220273][ T587] *** DEADLOCK *** [ 61.220273][ T587] [ 61.220522][ T587] May be due to missing lock nesting notation [ 61.220522][ T587] [ 61.220779][ T587] 2 locks held by ip/587: [ 61.220915][ T587] #0: ffffffff9cbe7a48 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_dellink+0x228/0xa40 [ 61.221221][ T587] #1: ffffffff9cbd6630 ((netdev_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x50/0x90 [ 61.221574][ T587] [ 61.221574][ T587] stack backtrace: [ 61.221786][ T587] CPU: 2 UID: 0 PID: 587 Comm: ip Not tainted 6.13.0-rc5-virtme #1 [ 61.222043][ T587] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 61.222253][ T587] Call Trace: [ 61.222387][ T587] [ 61.222479][ T587] dump_stack_lvl+0x82/0xd0 [ 61.222654][ T587] print_deadlock_bug+0x40a/0x650 [ 61.222825][ T587] validate_chain+0x5bf/0xae0 [ 61.222996][ T587] ? __pfx_validate_chain+0x10/0x10 [ 61.223178][ T587] ? hlock_class+0x4e/0x130 [ 61.223352][ T587] ? mark_lock+0x38/0x3e0 [ 61.223483][ T587] __lock_acquire+0xb9a/0x1680 [ 61.223661][ T587] lock_acquire.part.0+0xeb/0x330 [ 61.223834][ T587] ? blocking_notifier_call_chain+0x50/0x90 [ 61.224050][ T587] ? netconsole_process_cleanups_core+0x2e/0x3d0 [ 61.224264][ T587] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 61.224444][ T587] ? trace_lock_acquire+0x14c/0x1f0 [ 61.224617][ T587] ? lock_acquire+0x32/0xc0 [ 61.224786][ T587] ? blocking_notifier_call_chain+0x50/0x90 [ 61.225010][ T587] down_read+0x9f/0x340 [ 61.225143][ T587] ? blocking_notifier_call_chain+0x50/0x90 [ 61.225356][ T587] ? __pfx_down_read+0x10/0x10 [ 61.225527][ T587] ? __lock_release+0x103/0x460 [ 61.225699][ T587] ? netconsole_netdev_event+0x2c1/0x620 [ 61.225871][ T587] ? __pfx___lock_release+0x10/0x10 [ 61.226045][ T587] blocking_notifier_call_chain+0x50/0x90 [ 61.226224][ T587] __netdev_upper_dev_unlink+0xd9/0x220 [ 61.226398][ T587] ? __pfx___netdev_upper_dev_unlink+0x10/0x10 [ 61.226610][ T587] ? __mutex_unlock_slowpath+0x14a/0x3d0 [ 61.226782][ T587] ? __pfx___mutex_unlock_slowpath+0x10/0x10 [ 61.227005][ T587] ? rtnl_is_locked+0x15/0x20 [ 61.227182][ T587] netdev_upper_dev_unlink+0x71/0xa0 [ 61.227352][ T587] ? __pfx_netdev_upper_dev_unlink+0x10/0x10 [ 61.227574][ T587] ? netconsole_netdev_event+0x2c1/0x620 [ 61.227744][ T587] ? mutex_is_locked+0x1c/0x60 [ 61.227939][ T587] ? rtnl_is_locked+0x15/0x20 [ 61.228109][ T587] ? netdev_master_upper_dev_get+0x13/0x120 [ 61.228331][ T587] vrf_device_event+0x78/0xe0 [vrf] [ 61.228509][ T587] notifier_call_chain+0xcd/0x150 [ 61.228684][ T587] blocking_notifier_call_chain+0x66/0x90 [ 61.228860][ T587] unregister_netdevice_many_notify+0xa7b/0x1580 [ 61.229086][ T587] ? __pfx_unregister_netdevice_many_notify+0x10/0x10 [ 61.229302][ T587] ? rtnl_dellink+0x228/0xa40 [ 61.229479][ T587] ? sock_def_readable+0x11e/0x300 [ 61.229657][ T587] ? __pfx___mutex_lock+0x10/0x10 [ 61.229830][ T587] ? rtnl_is_locked+0x15/0x20 [ 61.230005][ T587] ? unregister_netdevice_queue+0x70/0x410 [ 61.230220][ T587] ? __pfx_unregister_netdevice_queue+0x10/0x10 [ 61.230437][ T587] ? __nla_validate_parse+0x48/0x3d0 [ 61.230612][ T587] rtnl_dellink+0x348/0xa40 [ 61.230793][ T587] ? __pfx_rtnl_dellink+0x10/0x10 [ 61.230984][ T587] ? find_held_lock+0x2c/0x110 [ 61.231159][ T587] ? __lock_release+0x103/0x460 [ 61.231329][ T587] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 61.231503][ T587] ? __pfx___lock_release+0x10/0x10 [ 61.231676][ T587] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 61.231852][ T587] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 61.232025][ T587] ? __pfx_rtnl_dellink+0x10/0x10 [ 61.232191][ T587] rtnetlink_rcv_msg+0x712/0xc10 [ 61.232357][ T587] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 61.232530][ T587] ? hlock_class+0x4e/0x130 [ 61.232700][ T587] ? mark_lock+0x38/0x3e0 [ 61.232831][ T587] ? __lock_acquire+0xb9a/0x1680 [ 61.233003][ T587] netlink_rcv_skb+0x130/0x360 [ 61.233183][ T587] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 61.233374][ T587] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 61.233554][ T587] ? netlink_deliver_tap+0x13e/0x340 [ 61.233728][ T587] ? netlink_deliver_tap+0xc3/0x340 [ 61.233905][ T587] netlink_unicast+0x44b/0x710 [ 61.234080][ T587] ? __pfx_netlink_unicast+0x10/0x10 [ 61.234250][ T587] ? find_held_lock+0x2c/0x110 [ 61.234417][ T587] netlink_sendmsg+0x723/0xbe0 [ 61.234594][ T587] ? __pfx_netlink_sendmsg+0x10/0x10 [ 61.234773][ T587] ____sys_sendmsg+0x7ac/0xa10 [ 61.234945][ T587] ? __pfx_____sys_sendmsg+0x10/0x10 [ 61.235114][ T587] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 61.235333][ T587] ? hlock_class+0x4e/0x130 [ 61.235509][ T587] ? __pfx_validate_chain+0x10/0x10 [ 61.235682][ T587] ___sys_sendmsg+0xee/0x170 [ 61.235862][ T587] ? __pfx____sys_sendmsg+0x10/0x10 [ 61.236034][ T587] ? __lock_acquire+0xb9a/0x1680 [ 61.236210][ T587] ? find_held_lock+0x2c/0x110 [ 61.236378][ T587] ? __lock_release+0x103/0x460 [ 61.236556][ T587] ? __might_fault+0x11b/0x170 [ 61.236731][ T587] ? __pfx___lock_release+0x10/0x10 [ 61.236903][ T587] ? trace_lock_acquire+0x14c/0x1f0 [ 61.237082][ T587] ? lock_acquire+0x32/0xc0 [ 61.237255][ T587] ? lock_acquire+0x32/0xc0 [ 61.237450][ T587] ? trace_rseq_update+0xe7/0x150 [ 61.237630][ T587] __sys_sendmsg+0x109/0x1a0 [ 61.237803][ T587] ? __pfx___sys_sendmsg+0x10/0x10 [ 61.237978][ T587] do_syscall_64+0xc1/0x1d0 [ 61.238150][ T587] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 61.238365][ T587] RIP: 0033:0x7f1515cde9a7 [ 61.238551][ T587] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 61.239158][ T587] RSP: 002b:00007fff6250b0c8 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 61.239422][ T587] RAX: ffffffffffffffda RBX: 00007fff6250b7f0 RCX: 00007f1515cde9a7 [ 61.239686][ T587] RDX: 0000000000000000 RSI: 00007fff6250b130 RDI: 0000000000000005 [ 61.239942][ T587] RBP: 0000000000000002 R08: 0000000000000003 R09: 0000000000000078 [ 61.240202][ T587] R10: 00007f1515b9cef8 R11: 0000000000000246 R12: 0000000000000002 [ 61.240455][ T587] R13: 0000000067792e45 R14: 0000000000498600 R15: 0000000000000000 [ 61.240718][ T587]