Hello everybody,
So i have 2 of these boxes (1 home and 1 at the office) :- Intel 11th GEN N5105 Mini PC with 4x 2.5G Intel i226LAN
Both running identical pfsesnse ce 2.7.2 under proxmox ve 8.14 configured with 16GB of RAM. I have a WireGuard connection between the 2 sites using pfsesne WireGuard package. Additionally, I am also running pfblockerng-devel from pfsense’s package manager on both sites. I have configured NIC hardware passthrough on both proxmox boxes (home and office) for pfsense WAN and LAN on both sites.
Both pfsense install have 2 cores and 8GB of RAM dedicated to them. So the configs are identical
One of my boxes keeps crashing randomly after 2-3 days, while the other box is rock stable for a month.
The box that crashes gives me the following crash dump.
Crash report begins. Anonymous machine information:
amd64
14.0-CURRENT
FreeBSD 14.0-CURRENT amd64 1400094 #1 RELENG_2_7_2-n255948-8d2b56da39c: Wed Dec 6 20:45:47 UTC 2023 root@freebsd:/var/jenkins/workspace/pfSense-CE-snapshots-2_7_2-main/obj/amd64/StdASW5b/var/jenkins/workspace/pfSense-CE-snapshots-2_7_2-main/sources/F
Crash report details:
No PHP errors found.
Filename: /var/crash/info.0
Dump header from device: /dev/da0p3
Architecture: amd64
Architecture Version: 4
Dump Length: 76800
Blocksize: 512
Compression: none
Dumptime: 2024-03-31 11:11:24 +0530
Hostname: home-pfSense.home.io
Magic: FreeBSD Text Dump
Version String: FreeBSD 14.0-CURRENT amd64 1400094 #1 RELENG_2_7_2-n255948-8d2b56da39c: Wed Dec 6 20:45:47 UTC 2023
root@freebsd:/var/jenkins/workspace/pfSense-CE-snapshots-2_7_2-main/obj/amd64/StdASW5
Panic String: double fault
Dump Parity: 3857874015
Bounds: 0
Dump Status: good
Filename: /var/crash/textdump.tar.0
ddb.txt���������������������������������������������������������������������������������������������0600����0�������0�������140000������14602173604� 7075� �����������������������������������������������������������������������������������������������������ustar���root����������������������������wheel������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������db:0:kdb.enter.default> show registers
cs 0x20
ds 0x3b
es 0x3b
fs 0x13
gs 0x1b
ss 0x28
rax 0x12
rcx 0xffffffff81451bc8
rdx 0xffffffff831031a0 dblfault_stack+0x910
rbx 0x4
rsp 0xffffffff83103560 dblfault_stack+0xcd0
rbp 0xffffffff83103560 dblfault_stack+0xcd0
rsi 0x19
rdi 0xffffffff82d3f3d8 vt_conswindow+0x10
r8 0
r9 0
r10 0
r11 0
r12 0x1
r13 0x3b
r14 0xffffffff813a43cc
r15 0xfffffe00a7700e40
rip 0xffffffff80d32342 kdb_enter+0x32
rflags 0x86
kdb_enter+0x32: movq $0,0x234a4c3(%rip)
db:0:kdb.enter.default> run lockinfo
db:1:lockinfo> show locks
No such command; use "help" to list available commands
db:1:lockinfo> show alllocks
No such command; use "help" to list available commands
db:1:lockinfo> show lockedvnods
Locked vnodes
db:0:kdb.enter.default> show pcpu
cpuid = 0
dynamic pcpu = 0x1123f80
curthread = 0xfffffe00a7700e40: pid 0 tid 100788 critnest 1 "wg_tqg_0"
curpcb = 0xfffffe00a7701360
fpcurthread = none
idlethread = 0xfffffe0011ed83a0: tid 100003 "idle: cpu0"
self = 0xffffffff84010000
curpmap = 0xffffffff83020ab0
tssp = 0xffffffff84010384
rsp0 = 0xfffffe00a8d39000
kcr3 = 0x76932000
ucr3 = 0xffffffffffffffff
scr3 = 0x76932000
gs32p = 0xffffffff84010404
ldt = 0xffffffff84010444
tss = 0xffffffff84010434
curvnet = 0
db:0:kdb.enter.default> bt
Tracing pid 0 tid 100788 td 0xfffffe00a7700e40
kdb_enter() at kdb_enter+0x32/frame 0xffffffff83103560
vpanic() at vpanic+0x163/frame 0xffffffff83103690
panic() at panic+0x43/frame 0xffffffff831036f0
dblfault_handler() at dblfault_handler+0x1ce/frame 0xffffffff831037b0
Xdblfault() at Xdblfault+0xd7/frame 0xffffffff831037b0
--- trap 0x17, rip = 0xffffffff8126af94, rsp = 0xffffffff83103850, rbp = 0xfffffe00a8d38e40 ---
Xdblfault() at Xdblfault+0x4/frame 0xfffffe00a8d38e40
gtaskqueue_run_locked() at gtaskqueue_run_locked+0x14e/frame 0xfffffe00a8d38ec0
gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xc2/frame 0xfffffe00a8d38ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00a8d38f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a8d38f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
db:0:kdb.enter.default> ps
pid ppid pgrp uid state wmesg wchan cmd
11472 64390 22 0 S nanslp 0xffffffff83063d61 sleep
55253 55196 54266 0 S piperd 0xfffffe00a65dbe38 sh
55196 54266 54266 0 S wait 0xfffffe00a77095a0 sh
55192 54266 54266 0 S (threaded) sshg-blocker
100787 S piperd 0xfffffe00a65d92d8 sshg-blocker
126480 S nanslp 0xffffffff83063d60 sshg-blocker
54869 54266 54266 0 S piperd 0xfffffe00a7112e38 sshg-parser
54617 54266 54266 0 S piperd 0xfffffe00a65dac70 cat
54266 88941 54266 0 Ss wait 0xfffffe00a7707560 sh
6512 6359 5051 0 S nanslp 0xffffffff83063d60 sleep
6359 1 5051 0 S wait 0xfffffe00a7ca5b00 sh
13944 398 398 0 S accept 0xfffff80017181590 php-fpm
55768 398 398 0 S (threaded) php-fpm
100229 S accept 0xfffff80017181590 php-fpm
46086 398 398 0 S accept 0xfffff80017181590 php-fpm
77585 1 77585 59 Ss (threaded) unbound
100770 S kqread 0xfffff8010a3f1c00 unbound
126509 S kqread 0xfffff8010a3f1900 unbound
9256 1 9256 136 Ss select 0xfffff8010abb50c0 dhcpd
49605 1 49605 0 Ss kqread 0xfffff8006e748900 dhcpleases
2768 1 2768 0 Ss (threaded) dpinger
100781 S uwait 0xfffff801f554f800 dpinger
115765 S sbwait 0xfffff8010aa241cc dpinger
115766 S nanslp 0xffffffff83063d60 dpinger
115767 S nanslp 0xffffffff83063d60 dpinger
115768 S accept 0xfffff8010adb3d10 dpinger
2170 1 2170 0 Ss (threaded) dpinger
101605 S uwait 0xfffff8006ea25280 dpinger
115761 S sbwait 0xfffff801f55bc1cc dpinger
115762 S nanslp 0xffffffff83063d60 dpinger
115763 S nanslp 0xffffffff83063d61 dpinger
115764 S accept 0xfffff8001706e950 dpinger
31012 398 398 0 S accept 0xfffff80017181590 php-fpm
73835 1 17089 0 S select 0xfffff801f576eec0 tail_pfb
72280 1 17089 0 S piperd 0xfffffe00a65dcc70 php_pfb
72060 1 17089 0 S kqread 0xfffff801f55ddd00 tail_pfb
67765 62906 67765 0 S+ ttyin 0xfffff800079548b0 sh
62906 60665 62906 0 S+ wait 0xfffffe00857a1580 sh
61694 1 61694 0 Ss+ ttyin 0xfffff800079570b0 getty
61576 1 61576 0 Ss+ ttyin 0xfffff800079578b0 getty
61381 1 61381 0 Ss+ ttyin 0xfffff800079560b0 getty
61056 1 61056 0 Ss+ ttyin 0xfffff800079568b0 getty
60816 1 60816 0 Ss+ ttyin 0xfffff800079550b0 getty
60756 1 60756 0 Ss+ ttyin 0xfffff800079558b0 getty
60694 1 60694 0 Ss+ ttyin 0xfffff800079540b0 getty
60665 1 60665 0 Ss+ wait 0xfffffe0011fcdac0 login
37384 1 37384 0 Ss nanslp 0xffffffff83063d61 php_wg
69291 1 68981 0 S kqread 0xfffff8006e655d00 lighttpd_pfb
93349 93128 93128 0 S nanslp 0xffffffff83063d60 minicron
93128 1 93128 0 Ss wait 0xfffffe00a6d4b5a0 minicron
93106 92730 92730 0 S nanslp 0xffffffff83063d61 minicron
92730 1 92730 0 Ss wait 0xfffffe00a6d4a580 minicron
92395 91810 91810 0 S nanslp 0xffffffff83063d60 minicron
91810 1 91810 0 Ss wait 0xfffffe00a788a020 minicron
91506 91364 91364 0 S nanslp 0xffffffff83063d61 minicron
91364 1 91364 0 Ss wait 0xfffffe00a6ca95a0 minicron
88941 1 88941 0 Ss select 0xfffff80007aebec0 syslogd
64390 1 22 0 S+ wait 0xfffffe00a788b040 sh
17591 1 17591 0 Ss select 0xfffff800184a58c0 radvd
9564 9195 9195 0 S kqread 0xfffff80068ebcd00 nginx
9462 9195 9195 0 S kqread 0xfffff80068ebbe00 nginx
9195 1 9195 0 Ss pause 0xfffffe0011ed4bb0 nginx
97647 1 97647 0 Ss (threaded) ntpd
100331 S select 0xfffff801f5348840 ntpd
22198 1 22198 0 Ss nanslp 0xffffffff83063d60 cron
15332 1 15332 0 Ss bpf 0xfffff8006ed14800 filterlog
601 1 601 0 Ss select 0xfffff8006e442440 devd
441 439 439 0 S kqread 0xfffff80017644000 check_reload_status
439 1 439 0 Ss kqread 0xfffff800056eb400 check_reload_status
398 1 398 0 Ss kqread 0xfffff80048175400 php-fpm
21 0 0 0 DL aldslp 0xffffffff83020d58 [ALQ Daemon]
20 0 0 0 DL syncer 0xffffffff8309dba8 [syncer]
19 0 0 0 DL vlruwt 0xfffffe00857a3060 [vnlru]
18 0 0 0 DL (threaded) [bufdaemon]
100145 D psleep 0xffffffff8309cbb0 [bufdaemon]
100151 D - 0xffffffff82c03100 [bufspacedaemon-0]
100152 D - 0xffffffff82c03380 [bufspacedaemon-1]
100153 D - 0xffffffff82c03600 [bufspacedaemon-2]
100154 D - 0xffffffff82c03880 [bufspacedaemon-3]
17 0 0 0 DL psleep 0xffffffff830f4050 [vmdaemon]
9 0 0 0 DL (threaded) [pagedaemon]
100143 D psleep 0xffffffff830dc4b8 [dom0]
100149 D launds 0xffffffff830dc4c4 [laundry: dom0]
100150 D umarcl 0xffffffff811372a0 [uma]
8 0 0 0 DL - 0xffffffff82e77708 [rand_harvestq]
7 0 0 0 DL pftm 0xffffffff80fa33c0 [pf purge]
6 0 0 0 DL (threaded) [zfskern]
100108 D t->zthr 0xfffff800027b5248 [arc_evict]
100109 D t->zthr 0xfffff800027b5048 [arc_reap]
100110 D - 0xfffff800027b6d00 [dbu_evict]
100111 D dbuf_ev 0xffffffff838f7f28 [dbuf_evict_thread]
100112 D - 0xfffff800027b6800 [z_vdev_file_0]
100113 D - 0xfffff800027b6800 [z_vdev_file_1]
100114 D - 0xfffff800027b6800 [z_vdev_file_2]
100115 D - 0xfffff800027b6800 [z_vdev_file_3]
100116 D - 0xfffff800027b6800 [z_vdev_file_4]
100117 D - 0xfffff800027b6800 [z_vdev_file_5]
100118 D - 0xfffff800027b6800 [z_vdev_file_6]
100119 D - 0xfffff800027b6800 [z_vdev_file_7]
100120 D - 0xfffff800027b6800 [z_vdev_file_8]
100121 D - 0xfffff800027b6800 [z_vdev_file_9]
100122 D - 0xfffff800027b6800 [z_vdev_file_10]
100123 D - 0xfffff800027b6800 [z_vdev_file_11]
100124 D - 0xfffff800027b6800 [z_vdev_file_12]
100125 D - 0xfffff800027b6800 [z_vdev_file_13]
100126 D - 0xfffff800027b6800 [z_vdev_file_14]
100127 D - 0xfffff800027b6800 [z_vdev_file_15]
100128 D l2arc_f 0xffffffff838f7428 [l2arc_feed_thread]
100129 D - 0xfffff800027b7500 [zfsvfs]
100130 S zevent_ 0xffffffff838f84c8 [sysevent]
100189 D - 0xfffff800056d4400 [z_zvol]
100190 D - 0xfffff800056d4200 [z_prefetch_0]
100191 D - 0xfffff800056d4200 [z_prefetch_1]
100192 D - 0xfffff800056d5e00 [z_upgrade_0]
100193 D - 0xfffff800056d5e00 [z_upgrade_1]
100196 D - 0xfffff800056d2700 [dp_sync_taskq]
100197 D - 0xfffff800056d5b00 [dp_zil_clean_taskq_]
100198 D - 0xfffff800056d5b00 [dp_zil_clean_taskq_]
100199 D - 0xfffff800056d5300 [z_zrele_0]
100200 D - 0xfffff800056d5300 [z_zrele_1]
100201 D - 0xfffff800056d5000 [z_unlinked_drain_0]
100202 D - 0xfffff800056d5000 [z_unlinked_drain_1]
100206 D - 0xfffff800056d2b00 [metaslab_group_task]
100207 D - 0xfffff80007a83600 [metaslab_group_task]
100220 D tx->tx_ 0xfffff800029aad50 [txg_thread_enter]
100221 D tx->tx_ 0xfffff800029aad30 [txg_thread_enter]
100222 D mmp->mm 0xfffffe0094de4478 [mmp_thread_enter]
100223 D t->zthr 0xfffff80007a86c48 [z_indirect_condense]
100224 D t->zthr 0xfffff80007b5c248 [z_livelist_destroy]
100225 D t->zthr 0xfffff80007a85348 [z_livelist_condense]
100226 D t->zthr 0xfffff80007b5c348 [z_checkpoint_discar]
100227 D vd->vde 0xfffffe0094f4edd8 [vdev_autotrim_threa]
5 0 0 0 DL - 0xffffffff830fdd18 [busdma]
16 0 0 0 DL (threaded) [usb]
100049 D - 0xfffffe008560edc8 [usbus0]
100050 D - 0xfffffe008560ee20 [usbus0]
100051 D - 0xfffffe008560ee78 [usbus0]
100052 D - 0xfffffe008560eed0 [usbus0]
100053 D - 0xfffffe008560ef28 [usbus0]
100055 D - 0xfffffe00857acdc8 [usbus1]
100056 D - 0xfffffe00857ace20 [usbus1]
100057 D - 0xfffffe00857ace78 [usbus1]
100058 D - 0xfffffe00857aced0 [usbus1]
100059 D - 0xfffffe00857acf28 [usbus1]
100061 D - 0xfffffe0085942dc8 [usbus2]
100062 D - 0xfffffe0085942e20 [usbus2]
100063 D - 0xfffffe0085942e78 [usbus2]
100064 D - 0xfffffe0085942ed0 [usbus2]
100065 D - 0xfffffe0085942f28 [usbus2]
100067 D - 0xfffffe0085addcf0 [usbus3]
100068 D - 0xfffffe0085addd48 [usbus3]
100069 D - 0xfffffe0085addda0 [usbus3]
100070 D - 0xfffffe0085adddf8 [usbus3]
100071 D - 0xfffffe0085adde50 [usbus3]
100073 D - 0xfffffe008e470dc8 [usbus4]
100074 D - 0xfffffe008e470e20 [usbus4]
100075 D - 0xfffffe008e470e78 [usbus4]
100076 D - 0xfffffe008e470ed0 [usbus4]
100077 D - 0xfffffe008e470f28 [usbus4]
100078 D - 0xfffffe008e615dc8 [usbus5]
100079 D - 0xfffffe008e615e20 [usbus5]
100080 D - 0xfffffe008e615e78 [usbus5]
100081 D - 0xfffffe008e615ed0 [usbus5]
100082 D - 0xfffffe008e615f28 [usbus5]
100083 D - 0xfffffe008e7abdc8 [usbus6]
100084 D - 0xfffffe008e7abe20 [usbus6]
100085 D - 0xfffffe008e7abe78 [usbus6]
100086 D - 0xfffffe008e7abed0 [usbus6]
100087 D - 0xfffffe008e7abf28 [usbus6]
100088 D - 0xfffffe008e941cf0 [usbus7]
100089 D - 0xfffffe008e941d48 [usbus7]
100090 D - 0xfffffe008e941da0 [usbus7]
100091 D - 0xfffffe008e941df8 [usbus7]
100092 D - 0xfffffe008e941e50 [usbus7]
4 0 0 0 DL (threaded) [cam]
100046 D - 0xffffffff82e28240 [doneq0]
100047 D - 0xffffffff82e281c0 [async]
100141 D - 0xffffffff82e28090 [scanner]
15 0 0 0 DL seqstat 0xfffff8000294ac88 [sequencer 00]
3 0 0 0 DL (threaded) [crypto]
100041 D crypto_ 0xffffffff830d9ac0 [crypto]
100042 D crypto_ 0xfffff800026a9230 [crypto returns 0]
100043 D crypto_ 0xfffff800026a9280 [crypto returns 1]
14 0 0 0 DL (threaded) [geom]
100036 D - 0xffffffff8301f738 [g_event]
100037 D - 0xffffffff8301f740 [g_up]
100038 D - 0xffffffff8301f748 [g_down]
13 0 0 0 DL (threaded) [ng_queue]
100033 D sleep 0xffffffff82d99380 [ng_queue0]
100034 D sleep 0xffffffff82d99380 [ng_queue1]
2 0 0 0 WL (threaded) [clock]
100031 I [clock (0)]
100032 I [clock (1)]
12 0 0 0 WL (threaded) [intr]
100015 I [swi5: fast taskq]
100019 I [swi6: task queue]
100020 I [swi6: Giant taskq]
100029 I [swi1: netisr 0]
100030 I [swi1: netisr 1]
100048 I [irq16: uhci0 uhci3+]
100054 I [irq17: uhci1 uhci4]
100060 I [irq18: uhci2 uhci5]
100066 I [irq19: ehci0 ehci1]
100072 I [irq24: hdac0]
100093 I [irq20: virtio_pci0]
100096 I [irq34: virtio_pci1]
100097 I [irq35: virtio_pci1]
100098 I [irq36: virtio_pci1]
100099 I [irq37: virtio_pci1]
100100 I [irq38: ahci0]
100101 I [irq1: atkbd0]
100102 I [irq12: psm0]
100133 I [swi1: pf send]
100134 I [swi1: pfsync]
11 0 0 0 RL (threaded) [idle]
100003 CanRun [idle: cpu0]
100004 Run CPU 1 [idle: cpu1]
1 0 1 0 SLs wait 0xfffffe0011ed4040 [init]
10 0 0 0 DL audit_w 0xffffffff830d9fa8 [audit]
0 0 0 0 RLs (threaded) [kernel]
100000 D swapin 0xffffffff8301fcd0 [swapper]
100005 D - 0xfffff800021e7100 [if_io_tqg_0]
100006 D - 0xfffff800021e6e00 [if_io_tqg_1]
100007 D - 0xfffff800021e6c00 [if_config_tqg_0]
100008 D - 0xfffff800021e6a00 [softirq_0]
100009 D - 0xfffff800021e6800 [softirq_1]
100010 D - 0xfffff800021e6600 [linuxkpi_irq_wq]
100011 D - 0xfffff800021e6400 [thread taskq]
100012 D - 0xfffff800021e6200 [aiod_kick taskq]
100013 D - 0xfffff800021e6000 [deferred_unmount ta]
100014 D - 0xfffff80002761200 [inm_free taskq]
100016 D - 0xfffff80002762c00 [in6m_free taskq]
100017 D - 0xfffff80002762a00 [kqueue_ctx taskq]
100018 D - 0xfffff80002762800 [pci_hp taskq]
100021 D - 0xfffff80002762000 [linuxkpi_short_wq_0]
100022 D - 0xfffff80002762000 [linuxkpi_short_wq_1]
100023 D - 0xfffff80002762000 [linuxkpi_short_wq_2]
100024 D - 0xfffff80002762000 [linuxkpi_short_wq_3]
100025 D - 0xfffff80002763a00 [linuxkpi_long_wq_0]
100026 D - 0xfffff80002763a00 [linuxkpi_long_wq_1]
100027 D - 0xfffff80002763a00 [linuxkpi_long_wq_2]
100028 D - 0xfffff80002763a00 [linuxkpi_long_wq_3]
100035 D - 0xfffff80002764900 [firmware taskq]
100039 D - 0xfffff800021ea200 [crypto_0]
100040 D - 0xfffff800021ea200 [crypto_1]
100044 D - 0xfffff800026aac00 [t4_rst_thr]
100094 D vtbslp 0xfffff800027e1580 [virtio_balloon]
100103 D - 0xfffff80003135500 [system_taskq_0]
100104 D - 0xfffff80003135500 [system_taskq_1]
100105 D - 0xfffff80003135200 [system_delay_taskq_]
100106 D - 0xfffff80003135200 [system_delay_taskq_]
100107 D - 0xfffff800027b5400 [arc_prune]
100131 D - 0xfffff80007833900 [ip_mroute_tskq task]
100135 D - 0xfffff80007959200 [acpi_task_0]
100136 D - 0xfffff80007959200 [acpi_task_1]
100137 D - 0xfffff80007959200 [acpi_task_2]
100139 D - 0xfffff800021e9300 [mca taskq]
100140 D - 0xfffff800026aa100 [CAM taskq]
100142 D - 0xfffff8000795bd00 [mlx4]
100155 D - 0xfffff800056e9400 [z_null_iss]
100156 D - 0xfffff80007a83900 [z_null_int]
100157 D - 0xfffff800056e9900 [z_rd_iss_0]
100158 D - 0xfffff800056e9900 [z_rd_iss_1]
100159 D - 0xfffff800056e9900 [z_rd_iss_2]
100160 D - 0xfffff800056e9900 [z_rd_iss_3]
100161 D - 0xfffff800056e9900 [z_rd_iss_4]
100162 D - 0xfffff800056e9900 [z_rd_iss_5]
100163 D - 0xfffff800056e9900 [z_rd_iss_6]
100164 D - 0xfffff800056e9900 [z_rd_iss_7]
100165 D - 0xfffff800056e9700 [z_rd_int]
100166 D - 0xfffff800056ea300 [z_wr_iss]
100167 D - 0xfffff800056ea600 [z_wr_iss_h_0]
100168 D - 0xfffff800056ea600 [z_wr_iss_h_1]
100169 D - 0xfffff800056ea600 [z_wr_iss_h_2]
100170 D - 0xfffff800056ea600 [z_wr_iss_h_3]
100171 D - 0xfffff800056ea600 [z_wr_iss_h_4]
100172 D - 0xfffff800056d2100 [z_wr_int]
100173 D - 0xfffff800056d3e00 [z_wr_int_h_0]
100174 D - 0xfffff800056d3e00 [z_wr_int_h_1]
100175 D - 0xfffff800056d3e00 [z_wr_int_h_2]
100176 D - 0xfffff800056d3e00 [z_wr_int_h_3]
100177 D - 0xfffff800056d3e00 [z_wr_int_h_4]
100178 D - 0xfffff800056d3800 [z_fr_iss]
100179 D - 0xfffff800056d3600 [z_fr_int]
100180 D - 0xfffff800056d3400 [z_cl_iss]
100181 D - 0xfffff800056d3200 [z_cl_int]
100182 D - 0xfffff800056d3000 [z_ioctl_iss]
100183 D - 0xfffff800056d4d00 [z_ioctl_int]
100184 D - 0xfffff800056d4b00 [z_trim_iss_0]
100185 D - 0xfffff800056d4b00 [z_trim_iss_1]
100186 D - 0xfffff800056d4b00 [z_trim_iss_2]
100187 D - 0xfffff800056d4b00 [z_trim_iss_3]
100188 D - 0xfffff800056d4600 [z_trim_int]
100259 D - 0xfffff80069bfa400 [wg_tqg_0]
100260 D - 0xfffff80017644b00 [wg_tqg_1]
100316 D - 0xfffff8006e657300 [dummynet]
100788 Run CPU 0 [wg_tqg_0]
100789 D - 0xfffff801f5e03500 [wg_tqg_1]
db:0:kdb.enter.default> alltrace
Tracing command kernel pid 0 tid 100000 td 0xffffffff83020240
sched_switch() at sched_switch+0x88a/frame 0xffffffff83f1fe70
mi_switch() at mi_switch+0xbb/frame 0xffffffff83f1fe90
sleepq_timedwait() at sleepq_timedwait+0x2f/frame 0xffffffff83f1fed0
_sleep() at _sleep+0x1d0/frame 0xffffffff83f1ff50
swapper() at swapper+0x69/frame 0xffffffff83f1ffa0
mi_startup() at mi_startup+0x30c/frame 0xffffffff83f1fff0
btext() at btext+0x23
Tracing command kernel pid 0 tid 100005 td 0xfffffe0011ed7560
sched_switch() at sched_switch+0x88a/frame 0xfffffe00107ace50
mi_switch() at mi_switch+0xbb/frame 0xfffffe00107ace70
msleep_spin_sbt() at msleep_spin_sbt+0x186/frame 0xfffffe00107acec0
gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00107acef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00107acf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00107acf30
--- trap 0x65006d, rip = 0x53006900000074, rsp = 0x73006e00440000, rbp = 0x61006400720049 ---
Tracing command kernel pid 0 tid 100006 td 0xfffffe0011ed6e40
sched_switch() at sched_switch+0x88a/frame 0xfffffe00107a7e50
mi_switch() at mi_switch+0xbb/frame 0xfffffe00107a7e70
msleep_spin_sbt() at msleep_spin_sbt+0x186/frame 0xfffffe00107a7ec0
gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00107a7ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00107a7f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00107a7f30
--- trap 0x5f5e5b28, rip = 0x84ffffda1ee8d989, rsp = 0x8d4affffda65e8c4, rbp = 0xc3c031fffffe6be9 ---
Tracing command kernel pid 0 tid 100007 td 0xfffffe0011ed6720
sched_switch() at sched_switch+0x88a/frame 0xfffffe00107a2e50
mi_switch() at mi_switch+0xbb/frame 0xfffffe00107a2e70
msleep_spin_sbt() at msleep_spin_sbt+0x186/frame 0xfffffe00107a2ec0
gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00107a2ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00107a2f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00107a2f30
--- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf ---
Tracing command kernel pid 0 tid 100008 td 0xfffffe0011ed6000
sched_switch() at sched_switch+0x88a/frame 0xfffffe001079de50
mi_switch() at mi_switch+0xbb/frame 0xfffffe001079de70
msleep_spin_sbt() at msleep_spin_sbt+0x186/frame 0xfffffe001079dec0
gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe001079def0
fork_exit() at fork_exit+0x7f/frame 0xfffffe001079df30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001079df30
--- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf ---
Tracing command kernel pid 0 tid 100009 td 0xfffffe0011f6ac80
sched_switch() at sched_switch+0x88a/frame 0xfffffe0010798e50
mi_switch() at mi_switch+0xbb/frame 0xfffffe0010798e70
msleep_spin_sbt() at msleep_spin_sbt+0x186/frame 0xfffffe0010798ec0
gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe0010798ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe0010798f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0010798f30
--- trap 0x38c840f, rip = 0xffc8014881046348, rsp = 0xc7580e380d98948, rbp = 0x894dfe894c03ebc6 ---
Tracing command kernel pid 0 tid 100010 td 0xfffffe0011f6a560
sched_switch() at sched_switch+0x88a/frame 0xfffffe0010793e50
mi_switch() at mi_switch+0xbb/frame 0xfffffe0010793e70
msleep_spin_sbt() at msleep_spin_sbt+0x186/frame 0xfffffe0010793ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe0010793ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe0010793f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0010793f30
--- trap 0xb0f05, rip = 0x11890ff3474, rsp = 0x8b4800000757880f, rbp = 0x20244c894800000a ---
Tracing command kernel pid 0 tid 100011 td 0xfffffe0011f69e40
sched_switch() at sched_switch+0x88a/frame 0xfffffe001078ee20
mi_switch() at mi_switch+0xbb/frame 0xfffffe001078ee40
_sleep() at _sleep+0x1f0/frame 0xfffffe001078eec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe001078eef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe001078ef30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001078ef30
--- trap 0x8e, rip = 0x4be49d231f089, rsp = 0xee834918438b4859, rbp = 0x7b800000008890ff ---
Tracing command kernel pid 0 tid 100012 td 0xfffffe0011f69720
sched_switch() at sched_switch+0x88a/frame 0xfffffe0010789e20
mi_switch() at mi_switch+0xbb/frame 0xfffffe0010789e40
_sleep() at _sleep+0x1f0/frame 0xfffffe0010789ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0010789ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe0010789f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0010789f30
--- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf ---
Tracing command kernel pid 0 tid 100013 td 0xfffffe0011f69000
sched_switch() at sched_switch+0x88a/frame 0xfffffe0010784e20
mi_switch() at mi_switch+0xbb/frame 0xfffffe0010784e40
_sleep() at _sleep+0x1f0/frame 0xfffffe0010784ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0010784ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe0010784f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0010784f30
--- trap 0x565755c4, rip = 0xd28548d689480000, rsp = 0xdf840fc085, rbp = 0xba000024e5058b48 ---
Tracing command kernel pid 0 tid 100014 td 0xfffffe0011eda740
sched_switch() at sched_switch+0x88a/frame 0xfffffe001077fe20
mi_switch() at mi_switch+0xbb/frame 0xfffffe001077fe40
_sleep() at _sleep+0x1f0/frame 0xfffffe001077fec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe001077fef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe001077ff30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001077ff30
--- trap 0, rip = 0, rsp = 0x200000000000, rbp = 0 ---
Tracing command kernel pid 0 tid 100016 td 0xfffffe0011ed9900
sched_switch() at sched_switch+0x88a/frame 0xfffffe0010775e20
mi_switch() at mi_switch+0xbb/frame 0xfffffe0010775e40
_sleep() at _sleep+0x1f0/frame 0xfffffe0010775ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0010775ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe0010775f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0010775f30
--- trap 0x342f3412, rip = 0, rsp = 0, rbp = 0xd198cbb94cdc23aa ---
Tracing command kernel pid 0 tid 100017 td 0xfffffe0011f6e720
sched_switch() at sched_switch+0x88a/frame 0xfffffe00853b3e20
mi_switch() at mi_switch+0xbb/frame 0xfffffe00853b3e40
_sleep() at _sleep+0x1f0/frame 0xfffffe00853b3ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00853b3ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00853b3f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00853b3f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
Tracing command kernel pid 0 tid 100018 td 0xfffffe0011f6e000
sched_switch() at sched_switch+0x88a/frame 0xfffffe00853aee20
mi_switch() at mi_switch+0xbb/frame 0xfffffe00853aee40
_sleep() at _sleep+0x1f0/frame 0xfffffe00853aeec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00853aeef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00853aef30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00853aef30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
Tracing command kernel pid 0 tid 100021 td 0xfffffe0011f6c900
sched_switch() at sched_switch+0x88a/frame 0xfffffe00107fce20
mi_switch() at mi_switch+0xbb/frame 0xfffffe00107fce40
_sleep() at _sleep+0x1f0/frame 0xfffffe00107fcec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00107fcef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00107fcf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00107fcf30
--- trap 0xfffc700d, rip = 0xfde08302e2832043, rsp = 0xe81febffffd531e8, rbp = 0x8a0824448b48ffff ---
Tracing command kernel pid 0 tid 100022 td 0xfffffe0011f6c1e0
sched_switch() at sched_switch+0x88a/frame 0xfffffe00107f7e20
mi_switch() at mi_switch+0xbb/frame 0xfffffe00107f7e40
_sleep() at _sleep+0x1f0/frame 0xfffffe00107f7ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00107f7ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00107f7f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00107f7f30
--- trap 0xe8f78948, rip = 0x487934b70f422b7e, rsp = 0x8e840ffff8834800, rbp = 0x89483024548b4824 ---
Tracing command kernel pid 0 tid 100023 td 0xfffffe0011f6bac0
sched_switch() at sched_switch+0x88a/frame 0xfffffe00107f2e20
mi_switch() at mi_switch+0xbb/frame 0xfffffe00107f2e40
_sleep() at _sleep+0x1f0/frame 0xfffffe00107f2ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00107f2ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00107f2f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00107f2f30
--- trap 0x78aa, rip = 0x485355f489495441, rsp = 0x246c6349df894808, rbp = 0x5ce851ee89485300 ---
Tracing command kernel pid 0 tid 100024 td 0xfffffe0011f6b3a0
sched_switch() at sched_switch+0x88a/frame 0xfffffe00107ede20
mi_switch() at mi_switch+0xbb/frame 0xfffffe00107ede40
_sleep() at _sleep+0x1f0/frame 0xfffffe00107edec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00107edef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00107edf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00107edf30
--- trap 0x558b4818, rip = 0x474ff85485041c3, rsp = 0x107f8b4850c3c0b6, rbp = 0x1892158d480000c6 ---
Tracing command kernel pid 0 tid 100025 td 0xfffffe0011f72020
sched_switch() at sched_switch+0x88a/frame 0xfffffe00107e8e20
mi_switch() at mi_switch+0xbb/frame 0xfffffe00107e8e40
_sleep() at _sleep+0x1f0/frame 0xfffffe00107e8ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00107e8ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00107e8f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00107e8f30
--- trap 0x1644e800, rip = 0x8024948b48, rsp = 0x1e283c2890874ff, rbp = 0x752c244c39000000 ---
Tracing command kernel pid 0 tid 100026 td 0xfffffe0011f71900
sched_switch() at sched_switch+0x88a/frame 0xfffffe00107e3e20
mi_switch() at mi_switch+0xbb/frame 0xfffffe00107e3e40
_sleep() at _sleep+0x1f0/frame 0xfffffe00107e3ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00107e3ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00107e3f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00107e3f30
--- trap 0x68b4820, rip = 0x48c300000001b8c3, rsp = 0x9e820d8d48fb8948, rbp = 0x481024448d481024 ---
Tracing command kernel pid 0 tid 100027 td 0xfffffe0011f711e0
sched_switch() at sched_switch+0x88a/frame 0xfffffe00107dee20
mi_switch() at mi_switch+0xbb/frame 0xfffffe00107dee40
_sleep() at _sleep+0x1f0/frame 0xfffffe00107deec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00107deef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00107def30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00107def30
--- trap 0, rip = 0x100000001000, rsp = 0x6000002000000000, rbp = 0 ---
Tracing command kernel pid 0 tid 100028 td 0xfffffe0011f70ac0
sched_switch() at sched_switch+0x88a/frame 0xfffffe00107d9e20
mi_switch() at mi_switch+0xbb/frame 0xfffffe00107d9e40
_sleep() at _sleep+0x1f0/frame 0xfffffe00107d9ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00107d9ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00107d9f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00107d9f30
--- trap 0, rip = 0xafafafaf6c617470, rsp = 0xafafafafafafafaf, rbp = 0x30646870 ---
Tracing command kernel pid 0 tid 100035 td 0xfffffe0011f74c80
sched_switch() at sched_switch+0x88a/frame 0xfffffe0085409e20
mi_switch() at mi_switch+0xbb/frame 0xfffffe0085409e40
_sleep() at _sleep+0x1f0/frame 0xfffffe0085409ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0085409ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe0085409f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0085409f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
Tracing command kernel pid 0 tid 100039 td 0xfffffe0011f73000
sched_switch() at sched_switch+0x88a/frame 0xfffffe00853f5e20
mi_switch() at mi_switch+0xbb/frame 0xfffffe00853f5e40
_sleep() at _sleep+0x1f0/frame 0xfffffe00853f5ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00853f5ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00853f5f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00853f5f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
Tracing command kernel pid 0 tid 100040 td 0xfffffe0011f72740
sched_switch() at sched_switch+0x88a/frame 0xfffffe00853f0e20
mi_switch() at mi_switch+0xbb/frame 0xfffffe00853f0e40
_sleep() at _sleep+0x1f0/frame 0xfffffe00853f0ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00853f0ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00853f0f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00853f0f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
Tracing command kernel pid 0 tid 100044 td 0xfffffe0011fb2000
sched_switch() at sched_switch+0x88a/frame 0xfffffe00853dce20
mi_switch() at mi_switch+0xbb/frame 0xfffffe00853dce40
_sleep() at _sleep+0x1f0/frame 0xfffffe00853dcec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00853dcef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00853dcf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00853dcf30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
Tracing command kernel pid 0 tid 100094 td 0xfffffe008eace720
sched_switch() at sched_switch+0x88a/frame 0xfffffe00854bddf0
mi_switch() at mi_switch+0xbb/frame 0xfffffe00854bde10
_sleep() at _sleep+0x1f0/frame 0xfffffe00854bde90
vtballoon_thread() at vtballoon_thread+0xd9/frame 0xfffffe00854bdef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00854bdf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00854bdf30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
Tracing command kernel pid 0 tid 100103 td 0xfffffe008ead2020
sched_switch() at sched_switch+0x88a/frame 0xfffffe0085535e20
mi_switch() at mi_switch+0xbb/frame 0xfffffe0085535e40
_sleep() at _sleep+0x1f0/frame 0xfffffe0085535ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0085535ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe0085535f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0085535f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
Tracing command kernel pid 0 tid 100104 td 0xfffffe008ead1900
sched_switch() at sched_switch+0x88a/frame 0xfffffe0085530e20
mi_switch() at mi_switch+0xbb/frame 0xfffffe0085530e40
_sleep() at _sleep+0x1f0/frame 0xfffffe0085530ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0085530ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe0085530f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0085530f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
Tracing command kernel pid 0 tid 100105 td 0xfffffe0090d00720
sched_switch() at sched_switch+0x88a/frame 0xfffffe008552be20
mi_switch() at mi_switch+0xbb/frame 0xfffffe008552be40
_sleep() at _sleep+0x1f0/frame 0xfffffe008552bec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe008552bef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe008552bf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe008552bf30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
Tracing command kernel pid 0 tid 100106 td 0xfffffe0090d00000
sched_switch() at sched_switch+0x88a/frame 0xfffffe0085526e20
mi_switch() at mi_switch+0xbb/frame 0xfffffe0085526e40
_sleep() at _sleep+0x1f0/frame 0xfffffe0085526ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0085526ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe0085526f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0085526f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
Tracing command kernel pid 0 tid 100107 td 0xfffffe0090d04020
sched_switch() at sched_switch+0x88a/frame 0xfffffe00855a5e20
mi_switch() at mi_switch+0xbb/frame 0xfffffe00855a5e40
_sleep() at _sleep+0x1f0/frame 0xfffffe00855a5ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00855a5ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00855a5f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00855a5f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
Tracing command kernel pid 0 tid 100131 td 0xfffffe0091cbd000
sched_switch() at sched_switch+0x88a/frame 0xfffffe00855cde50
mi_switch() at mi_switch+0xbb/frame 0xfffffe00855cde70
msleep_spin_sbt() at msleep_spin_sbt+0x186/frame 0xfffffe00855cdec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00855cdef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00855cdf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00855cdf30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
Tracing command kernel pid 0 tid 100135 td 0xfffffe0091b831e0
sched_switch() at sched_switch+0x88a/frame 0xfffffe00855b9e50
mi_switch() at mi_switch+0xbb/frame 0xfffffe00855b9e70
msleep_spin_sbt() at msleep_spin_sbt+0x186/frame 0xfffffe00855b9ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00855b9ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00855b9f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00855b9f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
Tracing command kernel pid 0 tid 100136 td 0xfffffe0091b82ac0
sched_switch() at sched_switch+0x88a/frame 0xfffffe00855b4e50
mi_switch() at mi_switch+0xbb/frame 0xfffffe00855b4e70
msleep_spin_sbt() at msleep_spin_sbt+0x186/frame 0xfffffe00855b4ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00855b4ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00855b4f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00855b4f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
Tracing command kernel pid 0 tid 100137 td 0xfffffe0091b823a0
sched_switch() at sched_switch+0x88a/frame 0xfffffe00855afe50
mi_switch() at mi_switch+0xbb/frame 0xfffffe00855afe70
msleep_spin_sbt() at msleep_spin_sbt+0x186/frame 0xfffffe00855afec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00855afef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00855aff30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00855aff30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
Tracing command kernel pid 0 tid 100139 td 0xfffffe0091cc0900
sched_switch() at sched_switch+0x88a/frame 0xfffffe0091e59e50
mi_switch() at mi_switch+0xbb/frame 0xfffffe0091e59e70
msleep_spin_sbt() at msleep_spin_sbt+0x186/frame 0xfffffe0091e59ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe0091e59ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe0091e59f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0091e59f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
Tracing command kernel pid 0 tid 100140 td 0xfffffe0091cc01e0
sched_switch() at sched_switch+0x88a/frame 0xfffffe0091e54e20
mi_switch() at mi_switch+0xbb/frame 0xfffffe0091e54e40
_sleep() at _sleep+0x1f0/frame 0xfffffe0091e54ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0091e54ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe0091e54f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0091e54f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
Tracing command kernel pid 0 tid 100142 td 0xfffffe0091cbf3a0
sched_switch() at sched_switch+0x88a/frame 0xfffffe0091e4ae20
mi_switch() at mi_switch+0xbb/frame 0xfffffe0091e4ae40
_sleep() at _sleep+0x1f0/frame 0xfffffe0091e4aec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0091e4aef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe0091e4af30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0091e4af30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
Tracing command kernel pid 0 tid 100155 td 0xfffffe0094df2e40
sched_switch() at sched_switch+0x88a/frame 0xfffffe00a5b5be20
mi_switch() at mi_switch+0xbb/frame 0xfffffe00a5b5be40
_sleep() at _sleep+0x1f0/frame 0xfffffe00a5b5bec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00a5b5bef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00a5b5bf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5b5bf30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
Tracing command kernel pid 0 tid 100156 td 0xfffffe0094df2720
sched_switch() at sched_switch+0x88a/frame 0xfffffe00a5b56e20
mi_switch() at mi_switch+0xbb/frame 0xfffffe00a5b56e40
_sleep() at _sleep+0x1f0/frame 0xfffffe00a5b56ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00a5b56ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00a5b56f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5b56f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
Tracing command kernel pid 0 tid 100157 td 0xfffffe0094df2000
sched_switch() at sched_switch+0x88a/frame 0xfffffe00a5b51e20
mi_switch() at mi_switch+0xbb/frame 0xfffffe00a5b51e40
_sleep() at _sleep+0x1f0/frame 0xfffffe00a5b51ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00a5b51ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00a5b51f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5b51f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
Tracing command kernel pid 0 tid 100158 td 0xfffffe0094ce6740
sched_switch() at sched_switch+0x88a/frame 0xfffffe00a5b4ce20
mi_switch() at mi_switch+0xbb/frame 0xfffffe00a5b4ce40
_sleep() at _sleep+0x1f0/frame 0xfffffe00a5b4cec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00a5b4cef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00a5b4cf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5b4cf30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
Tracing command kernel pid 0 tid 100159 td 0xfffffe0094ce6020
sched_switch() at sched_switch+0x88a/frame 0xfffffe00a5b47e20
mi_switch() at mi_switch+0xbb/frame 0xfffffe00a5b47e40
_sleep() at _sleep+0x1f0/frame 0xfffffe00a5b47ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00a5b47ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00a5b47f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5b47f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
Tracing command kernel pid 0 tid 100160 td 0xfffffe0094ce5900
sched_switch() at sched_switch+0x88a/frame 0xfffffe00a5b42e20
mi_switch() at mi_switch+0xbb/frame 0xfffffe00a5b42e40
_sleep() at _sleep+0x1f0/frame 0xfffffe00a5b42ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00a5b42ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00a5b42f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5b42f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
Tracing command kernel pid 0 tid 100161 td 0xfffffe0094ce51e0
sched_switch() at sched_switch+0x88a/frame 0xfffffe00a5b3de20
mi_switch() at mi_switch+0xbb/frame 0xfffffe00a5b3de40
_sleep() at _sleep+0x1f0/frame 0xfffffe00a5b3dec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00a5b3def0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00a5b3df30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5b3df30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
Tracing command kernel pid 0 tid 100162 td 0xfffffe0094ce4ac0
sched_switch() at sched_switch+0x88a/frame 0xfffffe00a5b38e20
mi_switch() at mi_switch+0xbb/frame 0xfffffe00a5b38e40
_sleep() at _sleep+0x1f0/frame 0xfffffe00a5b38ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00a5b38ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00a5b38f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5b38f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
Tracing command kernel pid 0 tid 100163 td 0xfffffe0094df6740
sched_switch() at sched_switch+0x88a/frame 0xfffffe00a5b33e20
mi_switch() at mi_switch+0xbb/frame 0xfffffe00a5b33e40
_sleep() at _sleep+0x1f0/frame 0xfffffe00a5b33ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00a5b33ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00a5b33f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5b33f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
Tracing command kernel pid 0 tid 100164 td 0xfffffe0094df6020
sched_switch() at sched_switch+0x88a/frame 0xfffffe00a5b2ee20
mi_switch() at mi_switch+0xbb/frame 0xfffffe00a5b2ee40
_sleep() at _sleep+0x1f0/frame 0xfffffe00a5b2eec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00a5b2eef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00a5b2ef30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5b2ef30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
Tracing command kernel pid 0 tid 100165 td 0xfffffe0094df5900
sched_switch() at sched_switch+0x88a/frame 0xfffffe00a5b29e20
mi_switch() at mi_switch+0xbb/frame 0xfffffe00a5b29e40
_sleep() at _sleep+0x1f0/frame 0xfffffe00a5b29ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frameconfig.txt������������������������������������������������������������������������������������������0600����0�������0�������14036�������14602173604� 7542� �����������������������������������������������������������������������������������������������������ustar���root����������������������������wheel������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������options CONFIG_AUTOGENERATED
ident pfSense
machine amd64
cpu HAMMER
makeoptions WITH_CTF=1
makeoptions DEBUG=-g
options RSS
options RATELIMIT
options MROUTING
options MSGTQL=2048
options MSGSSZ=32
options MSGSEG=512
options MSGMNI=40
options MSGMNB=8192
options ALTQ_CODEL
options ALTQ_NOPCC
options ALTQ_FAIRQ
options ALTQ_PRIQ
options ALTQ_HFSC
options ALTQ_RIO
options ALTQ_RED
options ALTQ_CBQ
options ALTQ
options IPSEC
options TCP_SIGNATURE
options NETGRAPH_PRED1
options NETGRAPH_DEFLATE
options NETGRAPH_CAR
options NETGRAPH_PIPE
options NETGRAPH_TCPMSS
options NETGRAPH_TEE
options NETGRAPH_HOLE
options NETGRAPH_FRAME_RELAY
options NETGRAPH_ASYNC
options NETGRAPH_ECHO
options NETGRAPH_CISCO
options NETGRAPH_BRIDGE
options NETGRAPH_ONE2MANY
options NETGRAPH_LMI
options NETGRAPH_KSOCKET
options NETGRAPH_VJC
options NETGRAPH_UI
options NETGRAPH_MPPC_ENCRYPTION
options NETGRAPH_TTY
options NETGRAPH_SOCKET
options NETGRAPH_RFC1490
options NETGRAPH_PPTPGRE
options NETGRAPH_PPPOE
options NETGRAPH_PPP
options NETGRAPH_EIFACE
options NETGRAPH_IFACE
options NETGRAPH_ETHER
options NETGRAPH_BPF
options NETGRAPH_L2TP
options NETGRAPH_VLAN
options NETGRAPH
options IPSTEALTH
options IPFIREWALL_VERBOSE
options IPFIREWALL_DEFAULT_TO_ACCEPT
options ALQ
options NULLFS
options GEOM_BDE
options GEOM_ELI
options GEOM_UZIP
options GEOM_MIRROR
options IICHID_SAMPLING
options EVDEV_SUPPORT
options XENHVM
options ATH_ENABLE_11N
options AH_AR5416_INTERRUPT_MITIGATION
options IEEE80211_SUPPORT_MESH
options SC_PIXEL_MODE
options PPS_SYNC
options COMPAT_LINUXKPI
options PCI_IOV
options PCI_HP
options IOMMU
options SMP
options NETGDB
options NETDUMP
options DEBUGNET
options ZSTDIO
options GZIO
options EKCD
options VERBOSE_SYSINIT=0
options GDB
options DDB
options KDB
options RCTL
options RACCT_DEFAULT_TO_DISABLED
options RACCT
options INCLUDE_CONFIG_FILE
options DDB_CTF
options KDTRACE_HOOKS
options KDTRACE_FRAME
options CAPABILITIES
options CAPABILITY_MODE
options AUDIT
options HWPMC_HOOKS
options KBD_INSTALL_CDEV
options PRINTF_BUFR_SIZE=128
options _KPOSIX_PRIORITY_SCHEDULING
options SYSVSEM
options SYSVMSG
options SYSVSHM
options STACK
options KTRACE
options SCSI_DELAY=5000
options COMPAT_FREEBSD13
options COMPAT_FREEBSD12
options COMPAT_FREEBSD11
options COMPAT_FREEBSD10
options COMPAT_FREEBSD9
options COMPAT_FREEBSD32
options EFIRT
options GEOM_LABEL
options GEOM_RAID
options TMPFS
options PSEUDOFS
options PROCFS
options CD9660
options MSDOSFS
options NFS_ROOT
options NFSLOCKD
options NFSD
options NFSCL
options MD_ROOT
options QUOTA
options UFS_GJOURNAL
options UFS_DIRHASH
options UFS_ACL
options SOFTUPDATES
options FFS
options KERN_TLS
options SCTP_SUPPORT
options TCP_RFC7413
options TCP_HHOOK
options TCP_BLACKBOX
options TCP_OFFLOAD
options FIB_ALGO
options ROUTE_MPATH
options IPSEC_SUPPORT
options INET6
options INET
options VIMAGE
options PREEMPTION
options NUMA
options SCHED_ULE
options NETLINK
options NEW_PCIB
options CC_CUBIC
options GEOM_PART_GPT
options GEOM_PART_MBR
options GEOM_PART_EBR
options GEOM_PART_BSD
options EARLY_AP_STARTUP
options DDB
options TMPFS
options PPS_SYNC
options COMPAT_LINUXKPI
device isa
device mem
device io
device uart_ns8250
device cpufreq
device acpi
device smbios
device pci
device fdc
device ahci
device ata
device mvs
device siis
device ahc
device ahd
device hptiop
device isp
device mpt
device mps
device mpr
device sym
device isci
device ocs_fc
device pvscsi
device scbus
device ch
device da
device sa
device cd
device pass
device ses
device arcmsr
device ciss
device ips
device smartpqi
device tws
device aac
device aacp
device aacraid
device ida
device mfi
device mlx
device mrsas
device nvme
device nvd
device vmd
device atkbdc
device atkbd
device psm
device kbdmux
device vga
device splash
device sc
device vt
device vt_vga
device vt_efifb
device vt_vbefb
device agp
device cbb
device cardbus
device uart
device ppc
device ppbus
device lpt
device ppi
device puc
device iflib
device em
device igc
device ix
device ixv
device ixl
device iavf
device ice
device vmx
device axp
device bxe
device le
device ti
device mlx5
device mlxfw
device mlx5en
device miibus
device ae
device age
device alc
device ale
device bce
device bfe
device bge
device cas
device dc
device et
device fxp
device gem
device jme
device lge
device msk
device nfe
device nge
device re
device rl
device sge
device sis
device sk
device ste
device stge
device vge
device vr
device xl
device wlan
device wlan_wep
device wlan_ccmp
device wlan_tkip
device wlan_amrr
device ath
device ath_hal
device ath_rate_sample
device ipw
device iwi
device iwn
device malo
device mwl
device ral
device wpi
device crypto
device loop
device padlock_rng
device rdrand_rng
device ether
device vlan
device tuntap
device md
device gif
device firmware
device xz
device bpf
device uhci
device ohci
device ehci
device xhci
device usb
device ukbd
device umass
device sound
device snd_cmi
device snd_csa
device snd_emu10kx
device snd_es137x
device snd_hda
device snd_ich
device snd_via8233
device mmc
device mmcsd
device sdhci
device virtio
device virtio_pci
device vtnet
device virtio_blk
device virtio_scsi
device virtio_balloon
device kvm_clock
device hyperv
device xenefi
device xenpci
device xentimer
device netmap
device evdev
device uinput
device hid
device wlan_rssadapt
device wlan_xauth
device wlan_acl
device iwm
device iwmfw
device iwifw
device ipwfw
device wpifw
device iwnfw
device uath
device ralfw
device ural
device urtw
device rum
device mwlfw
device zyd
device upgt
device udav
device axe
device axge
device aue
device cue
device kue
device mos
device rsu
device rsufw
device rtwn
device rtwnfw
device rtwn_pci
device rtwn_usb
device run
device runfw
device rue
device bwn
device bwi
device ufoma
device ucom
device uslcom
device uplcom
device umct
device uvisor
device uark
device uftdi
device uvscom
device umodem
device u3g
device cdce
device uhid
device firewire
device sbp
device gre
device if_bridge
device carp
device lagg
device vte
device enc
device pf
device pflog
device pfsync
device rndtest
device speaker
device mxge
device cxgb
device cxgbe
device oce
device mlx4
device mlx4en
device qlxgb
device bnxt
device virtio_console
��������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������msgbuf.txt������������������������������������������������������������������������������������������0600����0�������0�������41101�������14602173604� 7551� �����������������������������������������������������������������������������������������������������ustar���root����������������������������wheel������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������---<<BOOT>>---
Copyright (c) 1992-2023 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 14.0-CURRENT amd64 1400094 #1 RELENG_2_7_2-n255948-8d2b56da39c: Wed Dec 6 20:45:47 UTC 2023
root@freebsd:/var/jenkins/workspace/pfSense-CE-snapshots-2_7_2-main/obj/amd64/StdASW5b/var/jenkins/workspace/pfSense-CE-snapshots-2_7_2-main/sources/FreeBSD-src-RELENG_2_7_2/amd64.amd64/sys/pfSense amd64
FreeBSD clang version 16.0.6 (https://github.com/llvm/llvm-project.git llvmorg-16.0.6-0-g7cbf1a259152)
VT(efifb): resolution 1280x800
CPU: QEMU Virtual CPU version 2.5+ (1996.85-MHz K8-class CPU)
Origin="GenuineIntel" Id=0x60fb1 Family=0xf Model=0x6b Stepping=1
Features=0x1783fbfd<FPU,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE,SSE2,HTT>
Features2=0x82b82201<SSE3,SSSE3,CX16,SSE4.1,SSE4.2,x2APIC,POPCNT,AESNI,HV>
AMD Features=0x20100800<SYSCALL,NX,LM>
AMD Features2=0x1<LAHF>
Hypervisor: Origin = "KVMKVMKVM"
real memory = 8589934592 (8192 MB)
avail memory = 8182571008 (7803 MB)
Event timer "LAPIC" quality 100
ACPI APIC Table: <BOCHS BXPC >
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
FreeBSD/SMP: 1 package(s) x 2 core(s)
random: unblocking device.
ioapic0 <Version 1.1> irqs 0-23
Launching APs: 1
TCP_ratelimit: Is now initialized
wlan: mac acl policy registered
ipw_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE.
ipw_bss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (ipw_bss_fw, 0xffffffff807475a0, 0) error 1
ipw_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE.
ipw_ibss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (ipw_ibss_fw, 0xffffffff80747650, 0) error 1
ipw_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE.
ipw_monitor: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (ipw_monitor_fw, 0xffffffff80747700, 0) error 1
iwi_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE.
iwi_bss: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (iwi_bss_fw, 0xffffffff80765180, 0) error 1
iwi_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE.
iwi_ibss: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (iwi_ibss_fw, 0xffffffff80765230, 0) error 1
iwi_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE.
iwi_monitor: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (iwi_monitor_fw, 0xffffffff807652e0, 0) error 1
random: entropy device external interface
kbd1 at kbdmux0
WARNING: Device "spkr" is Giant locked and may be deleted before FreeBSD 14.0.
netgate0: <QEMU Guest>
efirtc0: <EFI Realtime Clock>
efirtc0: registered as a time-of-day clock, resolution 1.000000s
kvmclock0: <KVM paravirtual clock>
Timecounter "kvmclock" frequency 1000000000 Hz quality 975
kvmclock0: registered as a time-of-day clock, resolution 0.000001s
smbios0: <System Management BIOS> at iomem 0x7e9d4000-0x7e9d401e
smbios0: Version: 3.0, BCD Revision: 3.0
acpi0: <BOCHS BXPC>
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> on acpi0
atrtc0: <AT realtime clock> port 0x70-0x77 irq 8 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 100000000 Hz quality 950
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x608-0x60b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
vgapci0: <VGA-compatible display> mem 0x80000000-0x80ffffff,0x8241b000-0x8241bfff at device 1.0 on pci0
vgapci0: Boot video device
uhci0: <Intel 82801I (ICH9) USB controller> port 0x8100-0x811f irq 16 at device 26.0 on pci0
usbus0 on uhci0
usbus0: 12Mbps Full Speed USB v1.0
uhci1: <Intel 82801I (ICH9) USB controller> port 0x80e0-0x80ff irq 17 at device 26.1 on pci0
usbus1 on uhci1
usbus1: 12Mbps Full Speed USB v1.0
uhci2: <Intel 82801I (ICH9) USB controller> port 0x80c0-0x80df irq 18 at device 26.2 on pci0
usbus2 on uhci2
usbus2: 12Mbps Full Speed USB v1.0
ehci0: <Intel 82801I (ICH9) USB 2.0 controller> mem 0x8241a000-0x8241afff irq 19 at device 26.7 on pci0
usbus3: EHCI version 1.0
usbus3 on ehci0
usbus3: 480Mbps High Speed USB v2.0
hdac0: <Intel 82801I HDA Controller> mem 0x82410000-0x82413fff irq 16 at device 27.0 on pci0
pcib1: <ACPI PCI-PCI bridge> mem 0x82419000-0x82419fff irq 16 at device 28.0 on pci0
pci1: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> mem 0x82418000-0x82418fff irq 16 at device 28.1 on pci0
pci2: <ACPI PCI bus> on pcib2
pcib3: <ACPI PCI-PCI bridge> mem 0x82417000-0x82417fff irq 16 at device 28.2 on pci0
pci3: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> mem 0x82416000-0x82416fff irq 16 at device 28.3 on pci0
pci4: <ACPI PCI bus> on pcib4
uhci3: <Intel 82801I (ICH9) USB controller> port 0x80a0-0x80bf irq 16 at device 29.0 on pci0
usbus4 on uhci3
usbus4: 12Mbps Full Speed USB v1.0
uhci4: <Intel 82801I (ICH9) USB controller> port 0x8080-0x809f irq 17 at device 29.1 on pci0
usbus5 on uhci4
usbus5: 12Mbps Full Speed USB v1.0
uhci5: <Intel 82801I (ICH9) USB controller> port 0x8060-0x807f irq 18 at device 29.2 on pci0
usbus6 on uhci5
usbus6: 12Mbps Full Speed USB v1.0
ehci1: <Intel 82801I (ICH9) USB 2.0 controller> mem 0x82415000-0x82415fff irq 19 at device 29.7 on pci0
usbus7: EHCI version 1.0
usbus7 on ehci1
usbus7: 480Mbps High Speed USB v2.0
pcib5: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci5: <ACPI PCI bus> on pcib5
pcib6: <ACPI PCI-PCI bridge> mem 0x81a00000-0x81a000ff irq 21 at device 1.0 on pci5
pci6: <ACPI PCI bus> on pcib6
virtio_pci0: <VirtIO PCI (legacy) Balloon adapter> port 0x7000-0x703f mem 0x800100000-0x800103fff irq 20 at device 3.0 on pci6
vtballoon0: <VirtIO Balloon Adapter> on virtio_pci0
igc0: <Intel(R) Ethernet Controller I226-V> mem 0x81800000-0x818fffff,0x81908000-0x8190bfff irq 21 at device 16.0 on pci6
igc0: Using 1024 TX descriptors and 1024 RX descriptors
igc0: Using 2 RX queues 2 TX queues
igc0: Using MSI-X interrupts with 3 vectors
<6>igc0: Ethernet address: 60:be:b4:0c:6b:e1
<6>igc0: netmap queues/slots: TX 2/1024, RX 2/1024
igc1: <Intel(R) Ethernet Controller I226-V> mem 0x81700000-0x817fffff,0x81904000-0x81907fff irq 22 at device 17.0 on pci6
igc1: Using 1024 TX descriptors and 1024 RX descriptors
igc1: Using 2 RX queues 2 TX queues
igc1: Using MSI-X interrupts with 3 vectors
<6>igc1: Ethernet address: 60:be:b4:0c:6b:e3
<6>igc1: netmap queues/slots: TX 2/1024, RX 2/1024
igc2: <Intel(R) Ethernet Controller I226-V> mem 0x81600000-0x816fffff,0x81900000-0x81903fff irq 20 at device 27.0 on pci6
igc2: Using 1024 TX descriptors and 1024 RX descriptors
igc2: Using 2 RX queues 2 TX queues
igc2: Using MSI-X interrupts with 3 vectors
<6>igc2: Ethernet address: 60:be:b4:0c:6b:e4
<6>igc2: netmap queues/slots: TX 2/1024, RX 2/1024
pcib7: <ACPI PCI-PCI bridge> mem 0x81a01000-0x81a010ff irq 22 at device 2.0 on pci5
pci7: <ACPI PCI bus> on pcib7
pcib8: <ACPI PCI-PCI bridge> mem 0x81a02000-0x81a020ff irq 23 at device 3.0 on pci5
pci8: <ACPI PCI bus> on pcib8
pcib9: <ACPI PCI-PCI bridge> mem 0x81a03000-0x81a030ff irq 20 at device 4.0 on pci5
pci9: <ACPI PCI bus> on pcib9
virtio_pci1: <VirtIO PCI (legacy) SCSI adapter> port 0x6000-0x603f mem 0x81000000-0x81000fff,0x800000000-0x800003fff irq 21 at device 1.0 on pci9
vtscsi0: <VirtIO SCSI Adapter> on virtio_pci1
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
ahci0: <Intel ICH9 AHCI SATA controller> port 0x8040-0x805f mem 0x82414000-0x82414fff irq 16 at device 31.2 on pci0
ahci0: AHCI v1.00 with 6 1.5Gbps ports, Port Multiplier not supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
ahcich4: <AHCI channel> at channel 4 on ahci0
ahcich5: <AHCI channel> at channel 5 on ahci0
acpi_syscontainer0: <System Container> on acpi0
vmgenc0: <VM Generation Counter> on acpi0
acpi_syscontainer1: <System Container> port 0xb2-0xb3 on acpi0
acpi_syscontainer2: <System Container> port 0xcd8-0xce3 on acpi0
acpi_syscontainer3: <System Container> port 0x620-0x62f on acpi0
acpi_syscontainer4: <System Container> port 0xcc0-0xcd7 on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
WARNING: Device "psm" is Giant locked and may be deleted before FreeBSD 14.0.
psm0: model IntelliMouse Explorer, device ID 4
attimer0: <AT timer> at port 0x40 on isa0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
Timecounters tick every 10.000 msec
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
ugen7.1: <Intel EHCI root HUB> at usbus7
ugen6.1: <Intel UHCI root HUB> at usbus6
uhub0 on usbus7
uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus7
uhub1 on usbus6
uhub1: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus6
ugen4.1: <Intel UHCI root HUB> at usbus4
ugen5.1: <Intel UHCI root HUB> at usbus5
uhub2 on usbus4
uhub2: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus4
ugen2.1: <Intel UHCI root HUB> at usbus2
uhub3 on usbus5
uhub3: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus5
ugen3.1: <Intel EHCI root HUB> at usbus3
uhub4 on usbus2
uhub5 on usbus3
uhub5: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus3
uhub4: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus2
ugen0.1: <Intel UHCI root HUB> at usbus0
ugen1.1: <Intel UHCI root HUB> at usbus1
uhub6 on usbus0
uhub6: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
uhub7 on usbus1
uhub7: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1
Trying to mount root from zfs:pfSense/ROOT/default []...
uhub1: 2 ports with 2 removable, self powered
uhub2: 2 ports with 2 removable, self powered
uhub3: 2 ports with 2 removable, self powered
uhub4: 2 ports with 2 removable, self powered
uhub6: 2 ports with 2 removable, self powered
uhub7: 2 ports with 2 removable, self powered
Root mount waiting for: usbus3 usbus7 CAM
Root mount waiting for: usbus3 usbus7 CAM
uhub0: 6 ports with 6 removable, self powered
uhub5: 6 ports with 6 removable, self powered
ugen7.2: <QEMU QEMU USB Tablet> at usbus7
uhid0 on uhub0
uhid0: <QEMU QEMU USB Tablet, class 0/0, rev 2.00/0.00, addr 2> on usbus7
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
cd0 at ahcich1 bus 0 scbus2 target 0 lun 0
cd0: <QEMU QEMU DVD-ROM 2.5+> Removable CD-ROM SCSI device
cd0: Serial Number QM00003
cd0: 150.000MB/s transfers (SATA 1.x, UDMA5, ATAPI 12bytes, PIO 8192bytes)
cd0: 834MB (427086 2048 byte sectors)
da0 at vtscsi0 bus 0 scbus0 target 0 lun 0
da0: <QEMU QEMU HARDDISK 2.5+> Fixed Direct Access SPC-3 SCSI device
da0: 300.000MB/s transfers
da0: Command Queueing enabled
da0: 10240MB (20971520 512 byte sectors)
<118>Configuring crash dumps...
<118>Using /dev/da0p3 for dump device.
<118>/dev/gpt/efiboot0: 6 files, 259 MiB free (16549 clusters)
<118>FIXED
<118>/dev/gpt/efiboot0: MARKING FILE SYSTEM CLEAN
<118>Filesystems are clean, continuing...
<118>Mounting filesystems...
<118>Mounting ZFS boot environment... done.
<118>
<118> __
<118> _ __ / _|___ ___ _ __ ___ ___
<118>| '_ \| |_/ __|/ _ \ '_ \/ __|/ _ \
<118>| |_) | _\__ \ __/ | | \__ \ __/
<118>| .__/|_| |___/\___|_| |_|___/\___|
<118>|_|
<118>
<118>
<118>Welcome to pfSense 2.7.2-RELEASE...
<118>
<118>Checking dump device /dev/da0p3 for crash dumps ... no crash dumps on /dev/da0p3.
<118>...ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/lib/compat/pkg /usr/local/lib/ipsec /usr/local/lib/perl5/5.34/mach/CORE
<118>32-bit compatibility ldconfig path:
<118>done.
<118>>>> Removing vital flag from php82... done.
<118>7580
<118>External config loader 1.0 is now starting... da0p1 da0p2 da0p4
<118>Launching the init system...Updating CPU Microcode...
CPU: QEMU Virtual CPU version 2.5+ (1996.80-MHz K8-class CPU)
Origin="GenuineIntel" Id=0x60fb1 Family=0xf Model=0x6b Stepping=1
Features=0x178bfbfd<FPU,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
Features2=0x82b82201<SSE3,SSSE3,CX16,SSE4.1,SSE4.2,x2APIC,POPCNT,AESNI,HV>
AMD Features=0x20100800<SYSCALL,NX,LM>
AMD Features2=0x1<LAHF>
Hypervisor: Origin = "KVMKVMKVM"
<118>Done.
<118> done.
<118>Initializing................... done.
<118>Starting device manager (devd)...
ichsmb0: <Intel 82801I (ICH9) SMBus controller> port 0x8000-0x803f irq 16 at device 31.3 on pci0
smbus0: <System Management Bus> on ichsmb0
<118>done.
<118>Loading configuration....done.
<118>Configuring WireGuard tunnels...
<6>wg0: changing name to 'tun_wg0'
<6>tun_wg0: link state changed to UP
<6>igc0: link state changed to UP
<6>igc1: link state changed to UP
<118>done.
<118>Updating configuration...done.
<118>Checking config backups consistency...done.
<118>Setting up extended sysctls...done.
<118>Setting timezone...done.
<118>Configuring loopback interface...
<6>lo0: link state changed to UP
<118>done.
<118>Starting syslog...done.
<118>Setting up interfaces microcode...done.
<118>Configuring loopback interface...done.
<118>Configuring WAN interface...
<6>igc0: link state changed to DOWN
<118>done.
<118>Configuring HOME_VPN interface...done.
<118>Configuring LAN interface...
<6>igc1: link state changed to DOWN
<118>done.
<118>Configuring CARP settings...done.
<118>Syncing OpenVPN settings...done.
<118>Configuring firewall.
<6>pflog0: promiscuous mode enabled
<118>.
load_dn_sched dn_sched FIFO loaded
load_dn_sched dn_sched QFQ loaded
load_dn_sched dn_sched RR loaded
load_dn_sched dn_sched WF2Q+ loaded
load_dn_sched dn_sched PRIO loaded
load_dn_sched dn_sched FQ_CODEL loaded
load_dn_sched dn_sched FQ_PIE loaded
load_dn_aqm dn_aqm CODEL loaded
load_dn_aqm dn_aqm PIE loaded
<118>....done.
<118>Starting PFLOG...done.
<118>Setting up gateway monitors...done.
<118>Setting up static routes...
[fib_algo] inet.0 (bsearch4#27) rebuild_fd_flm: switching algo to radix4_lockless
<118>done.
<118>Setting up DNSs...
<118>Starting DNS Resolver...
<6>igc0: link state changed to UP
<6>igc1: link state changed to UP
<118>done.
<118>Synchronizing user settings...done.
<118>Configuring CRON...done.
<118>Bootstrapping clock...done.
<118>Starting NTP Server...done.
<118>Starting webConfigurator...done.
<118>Starting DHCP service...done.
<118>Starting DHCPv6 service...done.
<118>Configuring firewall......done.
<118>Generating RRD graphs...done.
<118>Starting syslog...done.
<118>Starting CRON... done.
<6>tun_wg0: link state changed to DOWN
<118> Starting package WireGuard...done.
<118> Starting package pfBlockerNG-devel...done.
<118> Starting /usr/local/etc/rc.d/pfb_dnsbl.sh...done.
<118> Starting /usr/local/etc/rc.d/pfb_filter.sh...done.
<118>pfSense 2.7.2-RELEASE amd64 20231206-2010
<118>Bootup complete
<6>wg0: changing name to 'tun_wg0'
<6>tun_wg0: link state changed to UP
Fatal double fault
rip 0xffffffff81255c16 rsp 0xfffffe00107b1d70 rbp 0xfffffe00107b1d70
rax 0x1c158de77117e rdx 0x1c15800000000 rbx 0x1c158de77117e
rcx 0 rsi 0 rdi 0
r8 0 r9 0x2 r10 0
r11 0x1 r12 0xfffff80002a5f828 r13 0
r14 0xffffffff84011000 r15 0xfffff80002a5f800 rflags 0x10246
cs 0x20 ss 0x28 ds 0x3b es 0x3b fs 0x13 gs 0x1b
fsbase 0x4938f9a07120 gsbase 0xffffffff84011000 kgsbase 0
cpuid = 1; apic id = 01
Fatal double fault
rip 0xffffffff8126af94 rsp 0xffffffff83103850 rbp 0xfffffe00a8d38e40
rax 0 rdx 0 rbx 0xfffff80007c97c00
rcx 0xfffffe00a8d38e78 rsi 0xfffff80007c97c00 rdi 0xffffffff83020ab0
r8 0xfffffe00a7701360 r9 0xfffffe00a8d39000 r10 0x1f4
r11 0x81789bd4 r12 0xfffff801f55dd558 r13 0xfffffe00a7700e40
r14 0xfffff80007c97e30 r15 0 rflags 0x10086
cs 0x20 ss 0x28 ds 0x3b es 0x3b fs 0x13 gs 0x1b
fsbase 0x4938f9a07120 gsbase 0xffffffff84010000 kgsbase 0
cpuid = 0; apic id = 00
timeout stopping cpus
panic: double fault
panic: double fault
cpuid = 0
time = 1711863684
KDB: enter: panic
���������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������panic.txt�������������������������������������������������������������������������������������������0600����0�������0�������14����������14602173604� 7136� �����������������������������������������������������������������������������������������������������ustar���root����������������������������wheel������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������double fault��������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������version.txt�����������������������������������������������������������������������������������������0600����0�������0�������457���������14602173604� 7624� �����������������������������������������������������������������������������������������������������ustar���root����������������������������wheel������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������FreeBSD 14.0-CURRENT amd64 1400094 #1 RELENG_2_7_2-n255948-8d2b56da39c: Wed Dec 6 20:45:47 UTC 2023
root@freebsd:/var/jenkins/workspace/pfSense-CE-snapshots-2_7_2-main/obj/amd64/StdASW5b/var/jenkins/workspace/pfSense-CE-snapshots-2_7_2-main/sources/FreeBSD-src-RELENG_2_7_2/amd64.amd64/sys/pfSense
�����������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������
I think i’ve eliminated hardware as the cause of the issue, as proxmox on the same box shows an uptime of 26 days where as pfsense (the only VM on proxmox) crashes after 2-3 days.
Any help on this would be greatly appreciated.