[ 33.235680][ T257] netdevsim netdevsim1337 eni1337np1: renamed from eth0 [ 37.323947][ T297] devlink (297) used greatest stack depth: 24000 bytes left [ 355.871822][ T1151] netdevsim: Exceeded number of supported nexthops [ 359.609174][ T1197] netdevsim: Failed to replace nexthop bucket [ 359.610388][ T1197] netdevsim: Failed to replace nexthop bucket [ 363.653016][ T1252] Failed to register nexthop notifier [ 364.898467][ T1266] [ 364.898574][ T1266] ====================================================== [ 364.898736][ T1266] WARNING: possible circular locking dependency detected [ 364.898905][ T1266] 6.12.0-rc5-virtme #1 Not tainted [ 364.899037][ T1266] ------------------------------------------------------ [ 364.899237][ T1266] modprobe/1266 is trying to acquire lock: [ 364.899396][ T1266] ffffffffc027b4e0 (&ops->srcu){.+.+}-{0:0}, at: __synchronize_srcu+0x21/0x2b0 [ 364.899636][ T1266] [ 364.899636][ T1266] but task is already holding lock: [ 364.899827][ T1266] ffffffff92bd4908 (rtnl_mutex){+.+.}-{3:3}, at: rtnl_link_unregister+0x10c/0x1c0 [ 364.900068][ T1266] [ 364.900068][ T1266] which lock already depends on the new lock. [ 364.900068][ T1266] [ 364.900321][ T1266] [ 364.900321][ T1266] the existing dependency chain (in reverse order) is: [ 364.900540][ T1266] [ 364.900540][ T1266] -> #1 (rtnl_mutex){+.+.}-{3:3}: [ 364.900759][ T1266] __lock_acquire+0xb3f/0x1580 [ 364.900897][ T1266] lock_acquire.part.0+0xeb/0x330 [ 364.901049][ T1266] __mutex_lock+0x149/0xac0 [ 364.901180][ T1266] rtnl_newlink+0x64f/0xa20 [ 364.901309][ T1266] rtnetlink_rcv_msg+0x712/0xc10 [ 364.901437][ T1266] netlink_rcv_skb+0x130/0x360 [ 364.901573][ T1266] netlink_unicast+0x44b/0x710 [ 364.901715][ T1266] netlink_sendmsg+0x723/0xbe0 [ 364.901843][ T1266] ____sys_sendmsg+0x7ac/0xa10 [ 364.901982][ T1266] ___sys_sendmsg+0xee/0x170 [ 364.902118][ T1266] __sys_sendmsg+0xcd/0x170 [ 364.902245][ T1266] do_syscall_64+0xc1/0x1d0 [ 364.902378][ T1266] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 364.902537][ T1266] [ 364.902537][ T1266] -> #0 (&ops->srcu){.+.+}-{0:0}: [ 364.902737][ T1266] check_prev_add+0x182/0xce0 [ 364.902868][ T1266] validate_chain+0x71d/0x9b0 [ 364.902995][ T1266] __lock_acquire+0xb3f/0x1580 [ 364.903123][ T1266] lock_sync+0xd7/0x180 [ 364.903252][ T1266] __synchronize_srcu+0x9e/0x2b0 [ 364.903379][ T1266] __rtnl_link_unregister+0x14a/0x380 [ 364.903539][ T1266] rtnl_link_unregister+0x14c/0x1c0 [ 364.903665][ T1266] nsim_module_exit+0x10/0x1a [netdevsim] [ 364.903840][ T1266] __do_sys_delete_module+0x2bd/0x470 [ 364.903998][ T1266] do_syscall_64+0xc1/0x1d0 [ 364.904122][ T1266] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 364.904281][ T1266] [ 364.904281][ T1266] other info that might help us debug this: [ 364.904281][ T1266] [ 364.904526][ T1266] Possible unsafe locking scenario: [ 364.904526][ T1266] [ 364.904709][ T1266] CPU0 CPU1 [ 364.904839][ T1266] ---- ---- [ 364.904962][ T1266] lock(rtnl_mutex); [ 364.905063][ T1266] lock(&ops->srcu); [ 364.905218][ T1266] lock(rtnl_mutex); [ 364.905375][ T1266] sync(&ops->srcu); [ 364.905469][ T1266] [ 364.905469][ T1266] *** DEADLOCK *** [ 364.905469][ T1266] [ 364.905647][ T1266] 2 locks held by modprobe/1266: [ 364.905769][ T1266] #0: ffffffff92bb8890 (pernet_ops_rwsem){++++}-{3:3}, at: rtnl_link_unregister+0xa6/0x1c0 [ 364.906033][ T1266] #1: ffffffff92bd4908 (rtnl_mutex){+.+.}-{3:3}, at: rtnl_link_unregister+0x10c/0x1c0 [ 364.906257][ T1266] [ 364.906257][ T1266] stack backtrace: [ 364.906410][ T1266] CPU: 2 UID: 0 PID: 1266 Comm: modprobe Not tainted 6.12.0-rc5-virtme #1 [ 364.906601][ T1266] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 364.906882][ T1266] Call Trace: [ 364.906990][ T1266] [ 364.907057][ T1266] dump_stack_lvl+0x82/0xd0 [ 364.907189][ T1266] print_circular_bug+0x2e2/0x4b0 [ 364.907316][ T1266] check_noncircular+0x2f9/0x3e0 [ 364.907454][ T1266] ? __pfx_check_noncircular+0x10/0x10 [ 364.907585][ T1266] ? __kernel_text_address+0x12/0x40 [ 364.907716][ T1266] ? unwind_get_return_address+0x5e/0xa0 [ 364.907841][ T1266] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 364.908000][ T1266] ? arch_stack_walk+0xa2/0xf0 [ 364.908137][ T1266] check_prev_add+0x182/0xce0 [ 364.908265][ T1266] ? __pfx_stack_trace_save+0x10/0x10 [ 364.908392][ T1266] validate_chain+0x71d/0x9b0 [ 364.908527][ T1266] ? __pfx_validate_chain+0x10/0x10 [ 364.908654][ T1266] ? mark_lock+0x335/0x3e0 [ 364.908778][ T1266] ? __pfx_validate_chain+0x10/0x10 [ 364.908909][ T1266] __lock_acquire+0xb3f/0x1580 [ 364.909046][ T1266] lock_sync+0xd7/0x180 [ 364.909141][ T1266] ? __synchronize_srcu+0x21/0x2b0 [ 364.909270][ T1266] __synchronize_srcu+0x9e/0x2b0 [ 364.909396][ T1266] ? __pfx___synchronize_srcu+0x10/0x10 [ 364.909521][ T1266] ? hlock_class+0x4e/0x130 [ 364.909649][ T1266] ? mark_lock+0x38/0x3e0 [ 364.909747][ T1266] ? kvm_clock_get_cycles+0x18/0x30 [ 364.909873][ T1266] ? ktime_get_mono_fast_ns+0x84/0x360 [ 364.910004][ T1266] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 364.910165][ T1266] __rtnl_link_unregister+0x14a/0x380 [ 364.910292][ T1266] ? mark_lock+0x38/0x3e0 [ 364.910385][ T1266] ? __pfx___rtnl_link_unregister+0x10/0x10 [ 364.910538][ T1266] ? mark_held_locks+0x9e/0xe0 [ 364.910669][ T1266] rtnl_link_unregister+0x14c/0x1c0 [ 364.910794][ T1266] ? __pfx_rtnl_link_unregister+0x10/0x10 [ 364.910922][ T1266] ? __pfx_woken_wake_function+0x10/0x10 [ 364.911053][ T1266] nsim_module_exit+0x10/0x1a [netdevsim] [ 364.911198][ T1266] __do_sys_delete_module+0x2bd/0x470 [ 364.911323][ T1266] ? __pfx___do_sys_delete_module+0x10/0x10 [ 364.911480][ T1266] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 364.911640][ T1266] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 364.911796][ T1266] ? trace_rcu_segcb_stats+0x37/0x1e0 [ 364.911923][ T1266] ? __pfx_slab_free_after_rcu_debug+0x10/0x10 [ 364.912083][ T1266] ? lockdep_hardirqs_on_prepare+0x275/0x410 [ 364.912245][ T1266] do_syscall_64+0xc1/0x1d0 [ 364.912371][ T1266] entry_SYSCALL_64_after_hwframe+0x77/0x7f [ 364.912528][ T1266] RIP: 0033:0x7f048ae465ab [ 364.912660][ T1266] Code: 73 01 c3 48 8b 0d 55 98 1b 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 90 f3 0f 1e fa b8 b0 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 25 98 1b 00 f7 d8 64 89 01 48 [ 364.913108][ T1266] RSP: 002b:00007ffd36618bb8 EFLAGS: 00000206 ORIG_RAX: 00000000000000b0 [ 364.913305][ T1266] RAX: ffffffffffffffda RBX: 000055f95ab14980 RCX: 00007f048ae465ab [ 364.913490][ T1266] RDX: 0000000000000000 RSI: 0000000000000800 RDI: 000055f95ab149e8 [ 364.913681][ T1266] RBP: 000055f95ab14980 R08: 0000000000000000 R09: 0000000000000000 [ 364.913901][ T1266] R10: 00007f048afa5ac0 R11: 0000000000000206 R12: 000055f95ab149e8 [ 364.914098][ T1266] R13: 0000000000000000 R14: 000055f95ab149e8 R15: 00007ffd3661aee8 [ 364.914292][ T1266]