[ 31.568694][ T258] netdevsim netdevsim1337 eni1337np1: renamed from eth0 [ 31.951488][ T263] ip (263) used greatest stack depth: 24240 bytes left [ 34.707082][ T299] devlink (299) used greatest stack depth: 24048 bytes left [ 43.655151][ T428] devlink (428) used greatest stack depth: 23744 bytes left [ 340.453140][ T1151] netdevsim: Exceeded number of supported nexthops [ 343.553274][ T1198] netdevsim: Failed to replace nexthop bucket [ 343.554546][ T1198] netdevsim: Failed to replace nexthop bucket [ 346.846293][ T1253] Failed to register nexthop notifier [ 347.878966][ T1269] [ 347.879060][ T1269] ====================================================== [ 347.879222][ T1269] WARNING: possible circular locking dependency detected [ 347.879379][ T1269] 6.12.0-rc5-virtme #1 Not tainted [ 347.879504][ T1269] ------------------------------------------------------ [ 347.879660][ T1269] modprobe/1269 is trying to acquire lock: [ 347.879817][ T1269] ffffffffc039a420 (&ops->srcu){.+.+}-{0:0}, at: __synchronize_srcu+0x21/0x2b0 [ 347.880054][ T1269] [ 347.880054][ T1269] but task is already holding lock: [ 347.880248][ T1269] ffffffffa37d3948 (rtnl_mutex){+.+.}-{3:3}, at: rtnl_link_unregister+0x10c/0x1c0 [ 347.880475][ T1269] [ 347.880475][ T1269] which lock already depends on the new lock. [ 347.880475][ T1269] [ 347.880728][ T1269] [ 347.880728][ T1269] the existing dependency chain (in reverse order) is: [ 347.880945][ T1269] [ 347.880945][ T1269] -> #1 (rtnl_mutex){+.+.}-{3:3}: [ 347.881142][ T1269] __lock_acquire+0xb3f/0x1580 [ 347.881273][ T1269] lock_acquire.part.0+0xeb/0x330 [ 347.881399][ T1269] __mutex_lock+0x149/0xac0 [ 347.881539][ T1269] rtnl_newlink+0x64b/0xa30 [ 347.881668][ T1269] rtnetlink_rcv_msg+0x712/0xc10 [ 347.881793][ T1269] netlink_rcv_skb+0x130/0x360 [ 347.881923][ T1269] netlink_unicast+0x44b/0x710 [ 347.882051][ T1269] netlink_sendmsg+0x723/0xbe0 [ 347.882175][ T1269] ____sys_sendmsg+0x7ac/0xa10 [ 347.882304][ T1269] ___sys_sendmsg+0xee/0x170 [ 347.882435][ T1269] __sys_sendmsg+0xcd/0x170 [ 347.882590][ T1269] do_syscall_64+0xc1/0x1d0 [ 347.882720][ T1269] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 347.882881][ T1269] [ 347.882881][ T1269] -> #0 (&ops->srcu){.+.+}-{0:0}: [ 347.883068][ T1269] check_prev_add+0x182/0xce0 [ 347.883199][ T1269] validate_chain+0x71d/0x9b0 [ 347.883331][ T1269] __lock_acquire+0xb3f/0x1580 [ 347.883458][ T1269] lock_sync+0xd7/0x180 [ 347.883588][ T1269] __synchronize_srcu+0x9e/0x2b0 [ 347.883717][ T1269] __rtnl_link_unregister+0x14a/0x380 [ 347.883876][ T1269] rtnl_link_unregister+0x14c/0x1c0 [ 347.884007][ T1269] nsim_module_exit+0x10/0x1a [netdevsim] [ 347.884178][ T1269] __do_sys_delete_module+0x2bd/0x470 [ 347.884338][ T1269] do_syscall_64+0xc1/0x1d0 [ 347.884465][ T1269] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 347.884646][ T1269] [ 347.884646][ T1269] other info that might help us debug this: [ 347.884646][ T1269] [ 347.884890][ T1269] Possible unsafe locking scenario: [ 347.884890][ T1269] [ 347.885072][ T1269] CPU0 CPU1 [ 347.885193][ T1269] ---- ---- [ 347.885315][ T1269] lock(rtnl_mutex); [ 347.885416][ T1269] lock(&ops->srcu); [ 347.885571][ T1269] lock(rtnl_mutex); [ 347.885730][ T1269] sync(&ops->srcu); [ 347.885828][ T1269] [ 347.885828][ T1269] *** DEADLOCK *** [ 347.885828][ T1269] [ 347.886013][ T1269] 2 locks held by modprobe/1269: [ 347.886138][ T1269] #0: ffffffffa37b8650 (pernet_ops_rwsem){++++}-{3:3}, at: rtnl_link_unregister+0xa6/0x1c0 [ 347.886406][ T1269] #1: ffffffffa37d3948 (rtnl_mutex){+.+.}-{3:3}, at: rtnl_link_unregister+0x10c/0x1c0 [ 347.886658][ T1269] [ 347.886658][ T1269] stack backtrace: [ 347.886821][ T1269] CPU: 0 UID: 0 PID: 1269 Comm: modprobe Not tainted 6.12.0-rc5-virtme #1 [ 347.887008][ T1269] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 347.887293][ T1269] Call Trace: [ 347.887391][ T1269] [ 347.887458][ T1269] dump_stack_lvl+0x82/0xd0 [ 347.887594][ T1269] print_circular_bug+0x2e2/0x4b0 [ 347.887728][ T1269] check_noncircular+0x2f9/0x3e0 [ 347.887856][ T1269] ? __pfx_check_noncircular+0x10/0x10 [ 347.887983][ T1269] ? __kernel_text_address+0x12/0x40 [ 347.888111][ T1269] ? unwind_get_return_address+0x5e/0xa0 [ 347.888241][ T1269] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 347.888404][ T1269] ? arch_stack_walk+0xa2/0xf0 [ 347.888534][ T1269] ? alloc_chain_hlocks+0x4e0/0x720 [ 347.888671][ T1269] check_prev_add+0x182/0xce0 [ 347.888798][ T1269] ? __pfx_stack_trace_save+0x10/0x10 [ 347.888924][ T1269] validate_chain+0x71d/0x9b0 [ 347.889116][ T1269] ? __pfx_validate_chain+0x10/0x10 [ 347.889242][ T1269] ? mark_lock+0x335/0x3e0 [ 347.889373][ T1269] ? __pfx_validate_chain+0x10/0x10 [ 347.889505][ T1269] __lock_acquire+0xb3f/0x1580 [ 347.889639][ T1269] lock_sync+0xd7/0x180 [ 347.889734][ T1269] ? __synchronize_srcu+0x21/0x2b0 [ 347.889864][ T1269] __synchronize_srcu+0x9e/0x2b0 [ 347.889992][ T1269] ? __pfx___synchronize_srcu+0x10/0x10 [ 347.890138][ T1269] ? hlock_class+0x4e/0x130 [ 347.890271][ T1269] ? mark_lock+0x38/0x3e0 [ 347.890373][ T1269] ? kvm_clock_get_cycles+0x18/0x30 [ 347.890523][ T1269] ? ktime_get_mono_fast_ns+0x84/0x360 [ 347.890676][ T1269] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 347.890837][ T1269] __rtnl_link_unregister+0x14a/0x380 [ 347.890975][ T1269] ? mark_lock+0x38/0x3e0 [ 347.891071][ T1269] ? __pfx___rtnl_link_unregister+0x10/0x10 [ 347.891225][ T1269] ? mark_held_locks+0x9e/0xe0 [ 347.891357][ T1269] rtnl_link_unregister+0x14c/0x1c0 [ 347.891481][ T1269] ? __pfx_rtnl_link_unregister+0x10/0x10 [ 347.891611][ T1269] ? __pfx_woken_wake_function+0x10/0x10 [ 347.891741][ T1269] nsim_module_exit+0x10/0x1a [netdevsim] [ 347.891887][ T1269] __do_sys_delete_module+0x2bd/0x470 [ 347.892016][ T1269] ? __pfx___do_sys_delete_module+0x10/0x10 [ 347.892179][ T1269] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 347.892346][ T1269] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 347.892509][ T1269] ? trace_rcu_segcb_stats+0x37/0x1e0 [ 347.892651][ T1269] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 347.892806][ T1269] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 347.892970][ T1269] do_syscall_64+0xc1/0x1d0 [ 347.893098][ T1269] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 347.893263][ T1269] RIP: 0033:0x7f3d626a25ab [ 347.893397][ T1269] Code: 73 01 c3 48 8b 0d 55 98 1b 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 90 f3 0f 1e fa b8 b0 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 25 98 1b 00 f7 d8 64 89 01 48 [ 347.893861][ T1269] RSP: 002b:00007ffc069677d8 EFLAGS: 00000206 ORIG_RAX: 00000000000000b0 [ 347.894061][ T1269] RAX: ffffffffffffffda RBX: 0000555a3e609980 RCX: 00007f3d626a25ab [ 347.894261][ T1269] RDX: 0000000000000000 RSI: 0000000000000800 RDI: 0000555a3e6099e8 [ 347.894452][ T1269] RBP: 0000555a3e609980 R08: 0000000000000000 R09: 0000000000000000 [ 347.894668][ T1269] R10: 00007f3d62801ac0 R11: 0000000000000206 R12: 0000555a3e6099e8 [ 347.894866][ T1269] R13: 0000000000000000 R14: 0000555a3e6099e8 R15: 00007ffc06969b08 [ 347.895063][ T1269]