[ 89.359431][ T1180] netdevsim netdevsim1337 eni1337np1: renamed from eth0 [ 89.576877][ T1182] devlink (1182) used greatest stack depth: 23904 bytes left [ 89.729007][ T1185] [ 89.729098][ T1185] ====================================================== [ 89.729258][ T1185] WARNING: possible circular locking dependency detected [ 89.729420][ T1185] 6.12.0-rc5-virtme #1 Not tainted [ 89.729549][ T1185] ------------------------------------------------------ [ 89.729707][ T1185] ip/1185 is trying to acquire lock: [ 89.729834][ T1185] ffffffff8a9d3948 (rtnl_mutex){+.+.}-{3:3}, at: rtnl_newlink+0x64b/0xa30 [ 89.730039][ T1185] [ 89.730039][ T1185] but task is already holding lock: [ 89.730227][ T1185] ffffffff8ab67b00 (&ops->srcu){.+.+}-{0:0}, at: rtnl_link_ops_get+0xe7/0x220 [ 89.730454][ T1185] [ 89.730454][ T1185] which lock already depends on the new lock. [ 89.730454][ T1185] [ 89.730709][ T1185] [ 89.730709][ T1185] the existing dependency chain (in reverse order) is: [ 89.730927][ T1185] [ 89.730927][ T1185] -> #1 (&ops->srcu){.+.+}-{0:0}: [ 89.731118][ T1185] __lock_acquire+0xb3f/0x1580 [ 89.731251][ T1185] lock_sync+0xd7/0x180 [ 89.731380][ T1185] __synchronize_srcu+0x9e/0x2b0 [ 89.731508][ T1185] __rtnl_link_unregister+0x14a/0x380 [ 89.731668][ T1185] rtnl_link_unregister+0x14c/0x1c0 [ 89.731796][ T1185] nsim_module_exit+0x10/0x1a [netdevsim] [ 89.731972][ T1185] __do_sys_delete_module+0x2bd/0x470 [ 89.732130][ T1185] do_syscall_64+0xc1/0x1d0 [ 89.732258][ T1185] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 89.732417][ T1185] [ 89.732417][ T1185] -> #0 (rtnl_mutex){+.+.}-{3:3}: [ 89.732614][ T1185] check_prev_add+0x182/0xce0 [ 89.732743][ T1185] validate_chain+0x71d/0x9b0 [ 89.732869][ T1185] __lock_acquire+0xb3f/0x1580 [ 89.732999][ T1185] lock_acquire.part.0+0xeb/0x330 [ 89.733125][ T1185] __mutex_lock+0x149/0xac0 [ 89.733254][ T1185] rtnl_newlink+0x64b/0xa30 [ 89.733381][ T1185] rtnetlink_rcv_msg+0x712/0xc10 [ 89.733508][ T1185] netlink_rcv_skb+0x130/0x360 [ 89.733636][ T1185] netlink_unicast+0x44b/0x710 [ 89.733762][ T1185] netlink_sendmsg+0x723/0xbe0 [ 89.733891][ T1185] ____sys_sendmsg+0x7ac/0xa10 [ 89.734019][ T1185] ___sys_sendmsg+0xee/0x170 [ 89.734153][ T1185] __sys_sendmsg+0xcd/0x170 [ 89.734280][ T1185] do_syscall_64+0xc1/0x1d0 [ 89.734408][ T1185] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 89.734566][ T1185] [ 89.734566][ T1185] other info that might help us debug this: [ 89.734566][ T1185] [ 89.734808][ T1185] Possible unsafe locking scenario: [ 89.734808][ T1185] [ 89.734997][ T1185] CPU0 CPU1 [ 89.735122][ T1185] ---- ---- [ 89.735249][ T1185] rlock(&ops->srcu); [ 89.735346][ T1185] lock(rtnl_mutex); [ 89.735503][ T1185] lock(&ops->srcu); [ 89.735661][ T1185] lock(rtnl_mutex); [ 89.735758][ T1185] [ 89.735758][ T1185] *** DEADLOCK *** [ 89.735758][ T1185] [ 89.735943][ T1185] 1 lock held by ip/1185: [ 89.736039][ T1185] #0: ffffffff8ab67b00 (&ops->srcu){.+.+}-{0:0}, at: rtnl_link_ops_get+0xe7/0x220 [ 89.736265][ T1185] [ 89.736265][ T1185] stack backtrace: [ 89.736419][ T1185] CPU: 0 UID: 0 PID: 1185 Comm: ip Not tainted 6.12.0-rc5-virtme #1 [ 89.736608][ T1185] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 89.736889][ T1185] Call Trace: [ 89.736993][ T1185] [ 89.737060][ T1185] dump_stack_lvl+0x82/0xd0 [ 89.737190][ T1185] print_circular_bug+0x2e2/0x4b0 [ 89.737318][ T1185] check_noncircular+0x2f9/0x3e0 [ 89.737447][ T1185] ? __pfx_check_noncircular+0x10/0x10 [ 89.737577][ T1185] ? get_reg+0x119/0x190 [ 89.737677][ T1185] ? alloc_chain_hlocks+0x4e0/0x720 [ 89.737808][ T1185] check_prev_add+0x182/0xce0 [ 89.737938][ T1185] validate_chain+0x71d/0x9b0 [ 89.738067][ T1185] ? __pfx_validate_chain+0x10/0x10 [ 89.738195][ T1185] ? hlock_class+0x4e/0x130 [ 89.738322][ T1185] ? mark_lock+0x38/0x3e0 [ 89.738419][ T1185] ? validate_chain+0x506/0x9b0 [ 89.738548][ T1185] __lock_acquire+0xb3f/0x1580 [ 89.738675][ T1185] ? check_prev_add+0xca0/0xce0 [ 89.738805][ T1185] lock_acquire.part.0+0xeb/0x330 [ 89.738935][ T1185] ? rtnl_newlink+0x64b/0xa30 [ 89.739066][ T1185] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 89.739193][ T1185] ? trace_lock_acquire+0x14d/0x1f0 [ 89.739321][ T1185] ? rtnl_newlink+0x64b/0xa30 [ 89.739448][ T1185] ? lock_acquire+0x32/0xc0 [ 89.739577][ T1185] ? rtnl_newlink+0x64b/0xa30 [ 89.739705][ T1185] __mutex_lock+0x149/0xac0 [ 89.739834][ T1185] ? rtnl_newlink+0x64b/0xa30 [ 89.739964][ T1185] ? __lock_release+0x21c/0x460 [ 89.740091][ T1185] ? rtnl_newlink+0x64b/0xa30 [ 89.740218][ T1185] ? __pfx___mutex_lock+0x10/0x10 [ 89.740345][ T1185] ? trace_lock_acquire+0x14d/0x1f0 [ 89.740475][ T1185] ? rtnl_newlink+0x64b/0xa30 [ 89.740603][ T1185] rtnl_newlink+0x64b/0xa30 [ 89.740730][ T1185] ? __pfx_rtnl_newlink+0x10/0x10 [ 89.740856][ T1185] ? find_held_lock+0x2c/0x110 [ 89.740984][ T1185] ? __pfx___lock_release+0x10/0x10 [ 89.741117][ T1185] ? rtnetlink_rcv_msg+0x6ef/0xc10 [ 89.741245][ T1185] ? __pfx_rtnl_newlink+0x10/0x10 [ 89.741374][ T1185] rtnetlink_rcv_msg+0x712/0xc10 [ 89.741502][ T1185] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 89.741629][ T1185] ? hlock_class+0x4e/0x130 [ 89.741757][ T1185] ? mark_lock+0x38/0x3e0 [ 89.741855][ T1185] ? __lock_acquire+0xb3f/0x1580 [ 89.741983][ T1185] netlink_rcv_skb+0x130/0x360 [ 89.742111][ T1185] ? __pfx_rtnetlink_rcv_msg+0x10/0x10 [ 89.742242][ T1185] ? __pfx_netlink_rcv_skb+0x10/0x10 [ 89.742373][ T1185] ? netlink_deliver_tap+0x13e/0x340 [ 89.742502][ T1185] ? netlink_deliver_tap+0xc3/0x340 [ 89.742631][ T1185] netlink_unicast+0x44b/0x710 [ 89.742758][ T1185] ? __pfx_netlink_unicast+0x10/0x10 [ 89.742886][ T1185] ? find_held_lock+0x2c/0x110 [ 89.743015][ T1185] netlink_sendmsg+0x723/0xbe0 [ 89.743145][ T1185] ? __pfx_netlink_sendmsg+0x10/0x10 [ 89.743275][ T1185] ____sys_sendmsg+0x7ac/0xa10 [ 89.743404][ T1185] ? __pfx_____sys_sendmsg+0x10/0x10 [ 89.743531][ T1185] ? __pfx_copy_msghdr_from_user+0x10/0x10 [ 89.743693][ T1185] ___sys_sendmsg+0xee/0x170 [ 89.743822][ T1185] ? __pfx____sys_sendmsg+0x10/0x10 [ 89.743952][ T1185] ? __lock_acquire+0xb3f/0x1580 [ 89.744079][ T1185] ? usage_skip+0x102/0x190 [ 89.744217][ T1185] ? reacquire_held_locks+0x22f/0x4f0 [ 89.744343][ T1185] ? do_user_addr_fault+0x8fd/0xe30 [ 89.744473][ T1185] ? fdget+0x52/0x1e0 [ 89.744572][ T1185] __sys_sendmsg+0xcd/0x170 [ 89.744700][ T1185] ? __pfx___sys_sendmsg+0x10/0x10 [ 89.744827][ T1185] ? __pfx___up_read+0x10/0x10 [ 89.744959][ T1185] do_syscall_64+0xc1/0x1d0 [ 89.745089][ T1185] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 89.745250][ T1185] RIP: 0033:0x7fb74edad7b7 [ 89.745382][ T1185] Code: 0a 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b9 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10 [ 89.745830][ T1185] RSP: 002b:00007ffdc8a34748 EFLAGS: 00000246 ORIG_RAX: 000000000000002e [ 89.746025][ T1185] RAX: ffffffffffffffda RBX: 00007ffdc8a34e80 RCX: 00007fb74edad7b7 [ 89.746220][ T1185] RDX: 0000000000000000 RSI: 00007ffdc8a347b0 RDI: 0000000000000005 [ 89.746411][ T1185] RBP: 0000000000000000 R08: 000000000000003c R09: 0000000000403418 [ 89.746601][ T1185] R10: 00007fb74ec66708 R11: 0000000000000246 R12: 00007ffdc8a34ea8 [ 89.746792][ T1185] R13: 000000006729e7d4 R14: 0000000000496600 R15: 0000000000000000 [ 89.746987][ T1185] [ 385.727586][ T2073] netdevsim: Exceeded number of supported nexthops [ 388.349879][ T2119] netdevsim: Failed to replace nexthop bucket [ 388.350085][ T2119] netdevsim: Failed to replace nexthop bucket [ 390.952424][ T2174] Failed to register nexthop notifier