======================================
| [ 4760.670245][ T3884] netdevsim netdevsim384 eni384np1: renamed from eth0
| [ 4763.767765][    C0] ------------[ cut here ]------------
| [ 4763.768411][    C0] WARNING: CPU: 0 PID: 3912 at ./include/net/sch_generic.h:843 __dev_xmit_skb (./include/net/sch_generic.h:843 ./include/net/sch_generic.h:889 ./include/net/sch_generic.h:895 net/core/dev.c:4168)
| [ 4763.769165][    C0] Modules linked in: netdevsim psample act_mirred cls_matchall ip6_gre gre xfrm_user l2tp_ip6 l2tp_eth l2tp_ip l2tp_netlink l2tp_core xt_conntrack nf_conntrack nf_defrag_ipv4 nf_defrag_ipv6 act_gact cls_flower sch_ingress vxlan ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 nft_compat nf_tables
[ 4763.771901][    C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011
[ 4763.772372][    C0] RIP: 0010:__dev_xmit_skb (./include/net/sch_generic.h:843 ./include/net/sch_generic.h:889 ./include/net/sch_generic.h:895 net/core/dev.c:4168)
[ 4763.772759][    C0] Code: ea 03 0f b6 04 02 48 89 fa 83 e2 07 38 d0 7f 09 84 c0 74 05 e8 1c c6 e8 fe 41 c6 87 b0 01 00 00 00 45 31 ed e9 06 f6 ff ff 90 <0f> 0b 90 e9 00 ff ff ff be 08 00 00 00 48 89 ef e8 56 cc e8 fe f0
All code
========
   0:	ea                   	(bad)
   1:	03 0f                	add    (%rdi),%ecx
   3:	b6 04                	mov    $0x4,%dh
   5:	02 48 89             	add    -0x77(%rax),%cl
   8:	fa                   	cli
   9:	83 e2 07             	and    $0x7,%edx
   c:	38 d0                	cmp    %dl,%al
   e:	7f 09                	jg     0x19
  10:	84 c0                	test   %al,%al
  12:	74 05                	je     0x19
  14:	e8 1c c6 e8 fe       	call   0xfffffffffee8c635
  19:	41 c6 87 b0 01 00 00 	movb   $0x0,0x1b0(%r15)
  20:	00 
  21:	45 31 ed             	xor    %r13d,%r13d
  24:	e9 06 f6 ff ff       	jmp    0xfffffffffffff62f
  29:	90                   	nop
  2a:*	0f 0b                	ud2		<-- trapping instruction
  2c:	90                   	nop
  2d:	e9 00 ff ff ff       	jmp    0xffffffffffffff32
  32:	be 08 00 00 00       	mov    $0x8,%esi
  37:	48 89 ef             	mov    %rbp,%rdi
  3a:	e8 56 cc e8 fe       	call   0xfffffffffee8cc95
  3f:	f0                   	lock

Code starting with the faulting instruction
===========================================
   0:	0f 0b                	ud2
   2:	90                   	nop
   3:	e9 00 ff ff ff       	jmp    0xffffffffffffff08
   8:	be 08 00 00 00       	mov    $0x8,%esi
   d:	48 89 ef             	mov    %rbp,%rdi
  10:	e8 56 cc e8 fe       	call   0xfffffffffee8cc6b
  15:	f0                   	lock
[ 4763.774087][    C0] RSP: 0018:ffffc900000076a0 EFLAGS: 00010202
[ 4763.774901][    C0] RAX: 0000000000000001 RBX: ffffe8ffffc08910 RCX: 0000000000000000
[ 4763.775485][    C0] RDX: 0000000000000007 RSI: ffffffffa90602c0 RDI: ffff88801ad38886
[ 4763.776070][    C0] RBP: ffff888018216998 R08: 0000000000000001 R09: 0000000000000001
[ 4763.776633][    C0] R10: 000000000000a000 R11: ffff888018216a28 R12: ffff888026b76228
[ 4763.777202][    C0] R13: ffff88801ad38880 R14: ffff888018216a10 R15: ffff888018216800
[ 4763.777757][    C0] FS:  00007f863c4ccb80(0000) GS:ffff8880c1b08000(0000) knlGS:0000000000000000
[ 4763.778410][    C0] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 4763.778883][    C0] CR2: 00007f863c5fdb90 CR3: 00000000095f5003 CR4: 0000000000772ef0
[ 4763.779444][    C0] PKRU: 55555554
[ 4763.779730][    C0] Call Trace:
[ 4763.780013][    C0]  <IRQ>
[ 4763.780205][    C0]  ? napi_hash_add (net/core/dev.c:4073)
[ 4763.780583][    C0]  ? dev_get_stats (net/core/dev.c:4143)
[ 4763.780976][    C0]  __dev_queue_xmit (net/core/dev.c:4786)
[ 4763.781351][    C0]  ? __lock_acquire (kernel/locking/lockdep.c:5237)
[ 4763.781730][    C0]  ? netdev_core_pick_tx (net/core/dev.c:4728)
[ 4763.782112][    C0]  ? eth_header (net/ethernet/eth.c:100)
[ 4763.782489][    C0]  ? neigh_resolve_output (./include/linux/netdevice.h:3422 net/core/neighbour.c:1589 net/core/neighbour.c:1574)
[ 4763.782866][    C0]  ? __neigh_update (./include/linux/rcupdate.h:331 ./include/linux/rcupdate.h:867 net/core/neighbour.c:1476)
[ 4763.783249][    C0]  __neigh_update (./include/linux/instrumented.h:96 (discriminator 2) ./include/linux/atomic/atomic-instrumented.h:400 (discriminator 2) ./include/linux/refcount.h:389 (discriminator 2) ./include/linux/refcount.h:432 (discriminator 2) ./include/linux/refcount.h:450 (discriminator 2) ./include/net/neighbour.h:458 (discriminator 2) net/core/neighbour.c:1494 (discriminator 2))
[ 4763.783642][    C0]  arp_process (./include/linux/instrumented.h:96 (discriminator 4) ./include/linux/atomic/atomic-instrumented.h:400 (discriminator 4) ./include/linux/refcount.h:389 (discriminator 4) ./include/linux/refcount.h:432 (discriminator 4) ./include/linux/refcount.h:450 (discriminator 4) ./include/net/neighbour.h:458 (discriminator 4) net/ipv4/arp.c:937 (discriminator 4))
[ 4763.784031][    C0]  ? arp_send (net/ipv4/arp.c:702)
[ 4763.784309][    C0]  ? arch_stack_walk (arch/x86/kernel/stacktrace.c:26)
[ 4763.784696][    C0]  ? __lock_acquire (kernel/locking/lockdep.c:5237)
[ 4763.785071][    C0]  ? arp_rcv.part.0 (net/ipv4/arp.c:968)
[ 4763.785436][    C0]  __netif_receive_skb_one_core (net/core/dev.c:6131)
[ 4763.785897][    C0]  ? __netif_receive_skb_list_core (net/core/dev.c:6131)
[ 4763.786364][    C0]  ? rcu_is_watching (./include/linux/context_tracking.h:128 kernel/rcu/tree.c:751)
[ 4763.786749][    C0]  ? lock_acquire (./include/trace/events/lock.h:24 kernel/locking/lockdep.c:5831)
[ 4763.787136][    C0]  ? netif_receive_skb_internal (./include/linux/rcupdate.h:331 (discriminator 16) ./include/linux/rcupdate.h:867 (discriminator 16) net/core/dev.c:6324 (discriminator 16))
[ 4763.787605][    C0]  netif_receive_skb_internal (net/core/dev.c:6337)
[ 4763.787978][    C0]  ? __netif_receive_skb (net/core/dev.c:6316)
[ 4763.788342][    C0]  ? mark_held_locks (kernel/locking/lockdep.c:4325)
[ 4763.788712][    C0]  ? _raw_spin_unlock_irqrestore (./include/linux/spinlock_api_smp.h:151 kernel/locking/spinlock.c:194)
[ 4763.789178][    C0]  ? lockdep_hardirqs_on (kernel/locking/lockdep.c:4472)
[ 4763.789560][    C0]  ? rcu_is_watching (./include/linux/context_tracking.h:128 kernel/rcu/tree.c:751)
[ 4763.789937][    C0]  netif_receive_skb (net/core/dev.c:6396)
[ 4763.790300][    C0] nsim_poll (drivers/net/netdevsim/netdev.c:439 drivers/net/netdevsim/netdev.c:454) netdevsim
[ 4763.790685][    C0]  ? nsim_start_peer_tx_queue.isra.0 (drivers/net/netdevsim/netdev.c:450) netdevsim
[ 4763.791245][    C0]  ? rcu_is_watching (./include/linux/context_tracking.h:128 kernel/rcu/tree.c:751)
[ 4763.791622][    C0]  __napi_poll.constprop.0 (net/core/dev.c:7668)
[ 4763.791996][    C0]  net_rx_action (net/core/dev.c:7730 net/core/dev.c:7882)
[ 4763.792378][    C0]  ? run_backlog_napi (net/core/dev.c:7844)
[ 4763.792745][    C0]  ? clockevents_program_event (kernel/time/clockevents.c:326)
[ 4763.793122][    C0]  ? lock_downgrade (kernel/locking/lockdep.c:471 kernel/locking/lockdep.c:5764)
[ 4763.793490][    C0]  ? kvm_clock_get_cycles (./arch/x86/include/asm/preempt.h:95 arch/x86/kernel/kvmclock.c:80 arch/x86/kernel/kvmclock.c:86)
[ 4763.793861][    C0]  ? ktime_get (kernel/time/timekeeping.c:387 (discriminator 4) kernel/time/timekeeping.c:404 (discriminator 4) kernel/time/timekeeping.c:826 (discriminator 4))
[ 4763.794148][    C0]  ? clockevents_program_event (kernel/time/clockevents.c:336 (discriminator 3))
[ 4763.794613][    C0]  handle_softirqs (kernel/softirq.c:623)
[ 4763.794996][    C0]  ? __neigh_event_send (./include/linux/bottom_half.h:33 net/core/neighbour.c:1273)
[ 4763.795370][    C0]  do_softirq (kernel/softirq.c:523 kernel/softirq.c:510)
[ 4763.795654][    C0]  </IRQ>
[ 4763.795843][    C0]  <TASK>
[ 4763.796040][    C0]  __local_bh_enable_ip (kernel/softirq.c:450)
[ 4763.796400][    C0]  __neigh_event_send (net/core/neighbour.c:1274)
[ 4763.796778][    C0]  neigh_resolve_output (net/core/neighbour.c:1578)
[ 4763.797161][    C0]  ? __local_bh_enable_ip (./arch/x86/include/asm/irqflags.h:42 ./arch/x86/include/asm/irqflags.h:119 kernel/softirq.c:455)
[ 4763.797530][    C0]  ? ___neigh_create (net/core/neighbour.c:727)
[ 4763.797904][    C0]  ip_finish_output2 (./include/net/neighbour.h:556 net/ipv4/ip_output.c:237)
[ 4763.798285][    C0]  ? ip_skb_dst_mtu (./include/linux/rcupdate.h:341 ./include/linux/rcupdate.h:897 ./include/net/ip.h:504 ./include/net/ip.h:518)
[ 4763.798656][    C0]  ? ip_append_data.part.0 (net/ipv4/ip_output.c:201)
[ 4763.799033][    C0]  ? ip_skb_dst_mtu (./include/net/ip.h:523)
[ 4763.799394][    C0]  ? __ip_finish_output (./include/linux/skbuff.h:1724 ./include/linux/skbuff.h:5149 net/ipv4/ip_output.c:309 net/ipv4/ip_output.c:297)
[ 4763.799765][    C0]  ip_output (./include/linux/netfilter.h:307 net/ipv4/ip_output.c:438)
[ 4763.800055][    C0]  ? ip_finish_output (net/ipv4/ip_output.c:429)
[ 4763.800420][    C0]  ? find_held_lock (kernel/locking/lockdep.c:5350)
[ 4763.800804][    C0]  __ip_queue_xmit (./include/net/dst.h:464 net/ipv4/ip_output.c:131 net/ipv4/ip_output.c:534)
[ 4763.801178][    C0]  ? __skb_clone (./arch/x86/include/asm/atomic.h:53 (discriminator 4) ./include/linux/atomic/atomic-arch-fallback.h:992 (discriminator 4) ./include/linux/atomic/atomic-instrumented.h:436 (discriminator 4) net/core/skbuff.c:1585 (discriminator 4))
[ 4763.801552][    C0]  __tcp_transmit_skb (net/ipv4/tcp_output.c:1628)
[ 4763.801934][    C0]  ? __tcp_select_window (net/ipv4/tcp_output.c:1449)
[ 4763.802297][    C0]  ? tcp_fastopen_cache_get (./include/linux/rcupdate.h:341 ./include/linux/rcupdate.h:897 net/ipv4/tcp_metrics.c:581)
[ 4763.802669][    C0]  ? __lock_release (kernel/locking/lockdep.c:5536)
[ 4763.803055][    C0]  ? tcp_fastopen_no_cookie (./include/net/net_namespace.h:414 ./include/net/sock.h:695 net/ipv4/tcp_fastopen.c:342)
[ 4763.803421][    C0]  tcp_send_syn_data (net/ipv4/tcp_output.c:1646 net/ipv4/tcp_output.c:4245)
[ 4763.803801][    C0]  tcp_connect (net/ipv4/tcp_output.c:4336 (discriminator 2))
[ 4763.804179][    C0]  tcp_v4_connect (net/ipv4/tcp_ipv4.c:347)
[ 4763.804560][    C0]  ? tcp_v4_conn_request (net/ipv4/tcp_ipv4.c:225)
[ 4763.804933][    C0]  ? kasan_save_stack (mm/kasan/common.c:58)
[ 4763.805298][    C0]  ? kasan_save_track (./arch/x86/include/asm/current.h:25 mm/kasan/common.c:69 mm/kasan/common.c:78)
[ 4763.805674][    C0]  ? __kasan_kmalloc (mm/kasan/common.c:421)
[ 4763.806047][    C0]  ? tcp_sendmsg_fastopen (net/ipv4/tcp.c:1046)
[ 4763.806410][    C0]  ? tcp_sendmsg_locked (net/ipv4/tcp.c:1143)
[ 4763.806778][    C0]  ? tcp_sendmsg (net/ipv4/tcp.c:1413)
[ 4763.807165][    C0]  ? __sys_sendto (net/socket.c:727 net/socket.c:742 net/socket.c:2244)
[ 4763.807538][    C0]  tcp_v6_connect (net/ipv6/tcp_ipv6.c:241)
[ 4763.807907][    C0]  ? __lock_acquire (kernel/locking/lockdep.c:5237)
[ 4763.808287][    C0]  ? inet6_sk_rx_dst_set (net/ipv6/tcp_ipv6.c:138)
[ 4763.808665][    C0]  ? find_held_lock (kernel/locking/lockdep.c:5350)
[ 4763.809059][    C0]  ? _raw_spin_unlock_irqrestore (./arch/x86/include/asm/preempt.h:104 ./include/linux/spinlock_api_smp.h:152 kernel/locking/spinlock.c:194)
[ 4763.809512][    C0]  ? rcu_is_watching (./include/linux/context_tracking.h:128 kernel/rcu/tree.c:751)
[ 4763.809889][    C0]  __inet_stream_connect (net/ipv4/af_inet.c:679)
[ 4763.810263][    C0]  ? kasan_save_track (./arch/x86/include/asm/current.h:25 mm/kasan/common.c:69 mm/kasan/common.c:78)
[ 4763.810635][    C0]  tcp_sendmsg_fastopen (net/ipv4/tcp.c:1069)
[ 4763.811013][    C0]  tcp_sendmsg_locked (net/ipv4/tcp.c:1143)
[ 4763.811388][    C0]  ? validate_chain (kernel/locking/lockdep.c:3801 kernel/locking/lockdep.c:3821 kernel/locking/lockdep.c:3876)
[ 4763.811752][    C0]  ? rcu_read_lock_any_held (kernel/rcu/update.c:386 kernel/rcu/update.c:380)
[ 4763.812131][    C0]  ? __lock_acquire (kernel/locking/lockdep.c:5237)
[ 4763.812497][    C0]  ? tcp_sendmsg_fastopen (net/ipv4/tcp.c:1078)
[ 4763.812871][    C0]  ? find_held_lock (kernel/locking/lockdep.c:5350)
[ 4763.813252][    C0]  ? __local_bh_enable_ip (./arch/x86/include/asm/irqflags.h:42 ./arch/x86/include/asm/irqflags.h:119 kernel/softirq.c:455)
[ 4763.813626][    C0]  tcp_sendmsg (net/ipv4/tcp.c:1413)
[ 4763.813908][    C0]  __sys_sendto (net/socket.c:727 net/socket.c:742 net/socket.c:2244)
[ 4763.814287][    C0]  ? __ia32_sys_getpeername (net/socket.c:2211)
[ 4763.814664][    C0]  ? fd_install (./include/linux/rcupdate.h:341 ./include/linux/rcupdate.h:979 fs/file.c:676)
[ 4763.815036][    C0]  ? __lock_release (kernel/locking/lockdep.c:5536)
[ 4763.815402][    C0]  ? fd_install (./arch/x86/include/asm/preempt.h:104 ./include/linux/rcupdate.h:981 fs/file.c:676)
[ 4763.815775][    C0]  ? __sys_socket (net/socket.c:516 net/socket.c:1756)
[ 4763.816148][    C0]  ? update_socket_protocol+0x10/0x10
[ 4763.816514][    C0]  ? do_user_addr_fault (./include/linux/mmap_lock.h:396 arch/x86/mm/fault.c:1415)
[ 4763.816890][    C0]  __x64_sys_sendto (net/socket.c:2247)
[ 4763.817274][    C0]  ? do_syscall_64 (./arch/x86/include/asm/irqflags.h:42 ./arch/x86/include/asm/irqflags.h:119 ./include/linux/entry-common.h:124 arch/x86/entry/syscall_64.c:90)
[ 4763.817655][    C0]  ? lockdep_hardirqs_on (kernel/locking/lockdep.c:4472)
[ 4763.818033][    C0]  do_syscall_64 (arch/x86/entry/syscall_64.c:63 arch/x86/entry/syscall_64.c:94)
[ 4763.818394][    C0]  entry_SYSCALL_64_after_hwframe (arch/x86/entry/entry_64.S:130)
[ 4763.818850][    C0] RIP: 0033:0x7f863c5df27a
[ 4763.819238][    C0] Code: d8 64 89 02 48 c7 c0 ff ff ff ff eb b8 0f 1f 00 f3 0f 1e fa 41 89 ca 64 8b 04 25 18 00 00 00 85 c0 75 15 b8 2c 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 7e c3 0f 1f 44 00 00 41 54 48 83 ec 30 44 89
All code
========
   0:	d8 64 89 02          	fsubs  0x2(%rcx,%rcx,4)
   4:	48 c7 c0 ff ff ff ff 	mov    $0xffffffffffffffff,%rax
   b:	eb b8                	jmp    0xffffffffffffffc5
   d:	0f 1f 00             	nopl   (%rax)
  10:	f3 0f 1e fa          	endbr64
  14:	41 89 ca             	mov    %ecx,%r10d
  17:	64 8b 04 25 18 00 00 	mov    %fs:0x18,%eax
  1e:	00 
  1f:	85 c0                	test   %eax,%eax
  21:	75 15                	jne    0x38
  23:	b8 2c 00 00 00       	mov    $0x2c,%eax
  28:	0f 05                	syscall
  2a:*	48 3d 00 f0 ff ff    	cmp    $0xfffffffffffff000,%rax		<-- trapping instruction
  30:	77 7e                	ja     0xb0
  32:	c3                   	ret
  33:	0f 1f 44 00 00       	nopl   0x0(%rax,%rax,1)
  38:	41 54                	push   %r12
  3a:	48 83 ec 30          	sub    $0x30,%rsp
  3e:	44                   	rex.R
  3f:	89                   	.byte 0x89

Code starting with the faulting instruction
===========================================
   0:	48 3d 00 f0 ff ff    	cmp    $0xfffffffffffff000,%rax
   6:	77 7e                	ja     0x86
   8:	c3                   	ret
   9:	0f 1f 44 00 00       	nopl   0x0(%rax,%rax,1)
   e:	41 54                	push   %r12
  10:	48 83 ec 30          	sub    $0x30,%rsp
  14:	44                   	rex.R
  15:	89                   	.byte 0x89
[ 4763.820573][    C0] RSP: 002b:00007ffd8da0fb68 EFLAGS: 00000246 ORIG_RAX: 000000000000002c
[ 4763.821134][    C0] RAX: ffffffffffffffda RBX: 0000000000000006 RCX: 00007f863c5df27a
[ 4763.821697][    C0] RDX: 000000000000000d RSI: 000000000040213e RDI: 0000000000000005
[ 4763.822255][    C0] RBP: 0000000000000005 R08: 00000000004040c0 R09: 000000000000001c
[ 4763.822806][    C0] R10: 0000000020000000 R11: 0000000000000246 R12: 00007ffd8da109d8


Finger prints:
__dev_xmit_skb:__dev_queue_xmit:__neigh_update:arp_process:__netif_receive_skb_one_core