[ 25.964128][ T255] netdevsim netdevsim1337 eni1337np1: renamed from eth0 [ 28.804667][ T298] devlink (298) used greatest stack depth: 24144 bytes left [ 323.071506][ T987] devlink (987) used greatest stack depth: 23984 bytes left [ 333.450813][ T1150] netdevsim: Exceeded number of supported nexthops [ 336.585469][ T1196] netdevsim: Failed to replace nexthop bucket [ 336.586067][ T1196] netdevsim: Failed to replace nexthop bucket [ 339.916903][ T1251] Failed to register nexthop notifier [ 340.929670][ T1267] [ 340.929765][ T1267] ====================================================== [ 340.929929][ T1267] WARNING: possible circular locking dependency detected [ 340.930090][ T1267] 6.12.0-rc5-virtme #1 Not tainted [ 340.930219][ T1267] ------------------------------------------------------ [ 340.930381][ T1267] modprobe/1267 is trying to acquire lock: [ 340.930543][ T1267] ffffffffc0560420 (&ops->srcu){.+.+}-{0:0}, at: __synchronize_srcu+0x21/0x2b0 [ 340.930784][ T1267] [ 340.930784][ T1267] but task is already holding lock: [ 340.930978][ T1267] ffffffffb7dd3a88 (rtnl_mutex){+.+.}-{3:3}, at: rtnl_link_unregister+0x10c/0x1c0 [ 340.931217][ T1267] [ 340.931217][ T1267] which lock already depends on the new lock. [ 340.931217][ T1267] [ 340.931469][ T1267] [ 340.931469][ T1267] the existing dependency chain (in reverse order) is: [ 340.931694][ T1267] [ 340.931694][ T1267] -> #1 (rtnl_mutex){+.+.}-{3:3}: [ 340.931888][ T1267] __lock_acquire+0xb3f/0x1580 [ 340.932027][ T1267] lock_acquire.part.0+0xeb/0x330 [ 340.932159][ T1267] __mutex_lock+0x149/0xac0 [ 340.932291][ T1267] rtnl_newlink+0x64b/0xa30 [ 340.932419][ T1267] rtnetlink_rcv_msg+0x712/0xc10 [ 340.932546][ T1267] netlink_rcv_skb+0x130/0x360 [ 340.932680][ T1267] netlink_unicast+0x44b/0x710 [ 340.932822][ T1267] netlink_sendmsg+0x723/0xbe0 [ 340.932952][ T1267] ____sys_sendmsg+0x7ac/0xa10 [ 340.933088][ T1267] ___sys_sendmsg+0xee/0x170 [ 340.933224][ T1267] __sys_sendmsg+0xcd/0x170 [ 340.933356][ T1267] do_syscall_64+0xc1/0x1d0 [ 340.933489][ T1267] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 340.933653][ T1267] [ 340.933653][ T1267] -> #0 (&ops->srcu){.+.+}-{0:0}: [ 340.933850][ T1267] check_prev_add+0x182/0xce0 [ 340.934006][ T1267] validate_chain+0x71d/0x9b0 [ 340.934135][ T1267] __lock_acquire+0xb3f/0x1580 [ 340.934268][ T1267] lock_sync+0xd7/0x180 [ 340.934402][ T1267] __synchronize_srcu+0x9e/0x2b0 [ 340.934531][ T1267] __rtnl_link_unregister+0x14a/0x380 [ 340.934694][ T1267] rtnl_link_unregister+0x14c/0x1c0 [ 340.934831][ T1267] nsim_module_exit+0x10/0x1a [netdevsim] [ 340.935010][ T1267] __do_sys_delete_module+0x2bd/0x470 [ 340.935203][ T1267] do_syscall_64+0xc1/0x1d0 [ 340.935334][ T1267] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 340.935496][ T1267] [ 340.935496][ T1267] other info that might help us debug this: [ 340.935496][ T1267] [ 340.935740][ T1267] Possible unsafe locking scenario: [ 340.935740][ T1267] [ 340.935933][ T1267] CPU0 CPU1 [ 340.936065][ T1267] ---- ---- [ 340.936193][ T1267] lock(rtnl_mutex); [ 340.936292][ T1267] lock(&ops->srcu); [ 340.936451][ T1267] lock(rtnl_mutex); [ 340.936610][ T1267] sync(&ops->srcu); [ 340.936710][ T1267] [ 340.936710][ T1267] *** DEADLOCK *** [ 340.936710][ T1267] [ 340.936972][ T1267] 2 locks held by modprobe/1267: [ 340.937179][ T1267] #0: ffffffffb7db8790 (pernet_ops_rwsem){++++}-{3:3}, at: rtnl_link_unregister+0xa6/0x1c0 [ 340.937597][ T1267] #1: ffffffffb7dd3a88 (rtnl_mutex){+.+.}-{3:3}, at: rtnl_link_unregister+0x10c/0x1c0 [ 340.937825][ T1267] [ 340.937825][ T1267] stack backtrace: [ 340.937997][ T1267] CPU: 3 UID: 0 PID: 1267 Comm: modprobe Not tainted 6.12.0-rc5-virtme #1 [ 340.938191][ T1267] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 340.938471][ T1267] Call Trace: [ 340.938580][ T1267] [ 340.938647][ T1267] dump_stack_lvl+0x82/0xd0 [ 340.938782][ T1267] print_circular_bug+0x2e2/0x4b0 [ 340.938912][ T1267] check_noncircular+0x2f9/0x3e0 [ 340.939039][ T1267] ? __pfx_check_noncircular+0x10/0x10 [ 340.939169][ T1267] ? __kernel_text_address+0x12/0x40 [ 340.939301][ T1267] ? unwind_get_return_address+0x5e/0xa0 [ 340.939435][ T1267] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 340.939595][ T1267] ? arch_stack_walk+0xa2/0xf0 [ 340.939794][ T1267] ? alloc_chain_hlocks+0x4e0/0x720 [ 340.939922][ T1267] check_prev_add+0x182/0xce0 [ 340.940049][ T1267] ? __pfx_stack_trace_save+0x10/0x10 [ 340.940178][ T1267] validate_chain+0x71d/0x9b0 [ 340.940377][ T1267] ? __pfx_validate_chain+0x10/0x10 [ 340.940509][ T1267] ? mark_lock+0x335/0x3e0 [ 340.940635][ T1267] ? __pfx_validate_chain+0x10/0x10 [ 340.940766][ T1267] __lock_acquire+0xb3f/0x1580 [ 340.940976][ T1267] lock_sync+0xd7/0x180 [ 340.941077][ T1267] ? __synchronize_srcu+0x21/0x2b0 [ 340.941204][ T1267] __synchronize_srcu+0x9e/0x2b0 [ 340.941331][ T1267] ? __pfx___synchronize_srcu+0x10/0x10 [ 340.941461][ T1267] ? hlock_class+0x4e/0x130 [ 340.941657][ T1267] ? mark_lock+0x38/0x3e0 [ 340.941754][ T1267] ? kvm_clock_get_cycles+0x18/0x30 [ 340.941883][ T1267] ? ktime_get_mono_fast_ns+0x84/0x360 [ 340.942014][ T1267] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 340.942240][ T1267] __rtnl_link_unregister+0x14a/0x380 [ 340.942370][ T1267] ? mark_lock+0x38/0x3e0 [ 340.942468][ T1267] ? __pfx___rtnl_link_unregister+0x10/0x10 [ 340.942627][ T1267] ? mark_held_locks+0x9e/0xe0 [ 340.942825][ T1267] rtnl_link_unregister+0x14c/0x1c0 [ 340.942953][ T1267] ? __pfx_rtnl_link_unregister+0x10/0x10 [ 340.943086][ T1267] ? __pfx_woken_wake_function+0x10/0x10 [ 340.943217][ T1267] nsim_module_exit+0x10/0x1a [netdevsim] [ 340.943358][ T1267] __do_sys_delete_module+0x2bd/0x470 [ 340.943563][ T1267] ? __pfx___do_sys_delete_module+0x10/0x10 [ 340.943719][ T1267] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 340.943885][ T1267] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 340.944051][ T1267] ? trace_rcu_segcb_stats+0x37/0x1e0 [ 340.944184][ T1267] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 340.944343][ T1267] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 340.944507][ T1267] do_syscall_64+0xc1/0x1d0 [ 340.944636][ T1267] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 340.944870][ T1267] RIP: 0033:0x7f3c4d5025ab [ 340.945010][ T1267] Code: 73 01 c3 48 8b 0d 55 98 1b 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 90 f3 0f 1e fa b8 b0 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 25 98 1b 00 f7 d8 64 89 01 48 [ 340.945546][ T1267] RSP: 002b:00007ffe8580ecf8 EFLAGS: 00000206 ORIG_RAX: 00000000000000b0 [ 340.945741][ T1267] RAX: ffffffffffffffda RBX: 00005648f5a13980 RCX: 00007f3c4d5025ab [ 340.945934][ T1267] RDX: 0000000000000000 RSI: 0000000000000800 RDI: 00005648f5a139e8 [ 340.946221][ T1267] RBP: 00005648f5a13980 R08: 0000000000000000 R09: 0000000000000000 [ 340.946421][ T1267] R10: 00007f3c4d661ac0 R11: 0000000000000206 R12: 00005648f5a139e8 [ 340.946612][ T1267] R13: 0000000000000000 R14: 00005648f5a139e8 R15: 00007ffe85811028 [ 340.946807][ T1267]