Skip site navigation (1)Skip section navigation (2)
Date:      Mon, 14 Oct 2019 14:45:04 -0700
From:      Brian Buhrow <buhrow@nfbcal.org>
To:        =?UTF-8?Q?Roger_Pau_Monn=C3=A9?= <royger@freebsd.org>
Cc:        Roger Pau Monne <roger.pau@citrix.com>, freebsd-xen@freebsd.org, buhrow@nfbcal.org
Subject:   Re: i/o is very slow on FreeBSD dom0 with Xen-4.12 and Freebsd-12
Message-ID:  <201910142145.x9ELj4c8008732@lothlorien.nfbcal.org>
In-Reply-To: <CAPLaKK7TKGQ23njecW7UhHxvaSm%2B44Y%2BnkdPQ=_FSXZShniH2g@mail.gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
	hello.  Using: ioapic_ack=old causes the dom0 to crash.  Below are the
logs.

-thanks
-Brian


<loader.conf>
boot_serial="YES"		# -h: Use serial console
comconsole_speed="115200"	# Set the current serial console speed
comconsole_port="0x2f8"	# Set the current serial console port
#console="vidconsole"		# A comma separated list of console(s)
console="comconsole"		# A comma separated list of console(s)
geom_mirror_load="YES"		# RAID1 disk driver (see gmirror(8))
ahci_load="YES"		# ahci driver
ipmi_load="YES"		# Ripmi driver
if_tap_load="YES"		# Load bridge driver.
if_vlan_load="YES"		# Load vlan driver.
# Turn on Xen (BB 10/08/2019)
xen_kernel="/boot/xen"
xen_cmdline="dom0_mem=4096m dom0_max_vcpus=4 dom0=pvh,verbose console=com2,vga ioapic_ack=old iommu=verbose,debug sync_console=true com2=115200,8n1 guest_loglvl=all loglvl=all"

<logs>

(XEN) Xen version 4.12.1 (buhrow@) (FreeBSD clang version 6.0.1 (tags/RELEASE_601/final 335540) (based on LLVM 6.0.1)) debug=n  Thu Oct  3 11:34:20 PDT 2019
(XEN) Latest ChangeSet: 
(XEN) Console output is synchronous.
(XEN) Bootloader: FreeBSD Loader
(XEN) Command line: dom0_mem=4096m dom0_max_vcpus=4 dom0=pvh,verbose console=com2,vga ioapic_ack=old iommu=verbose,debug sync_console=true com2=115200,8n1 guest_loglvl=all loglvl=all
(XEN) Xen image load base address: 0
(XEN) Video information:
(XEN)  VGA is text mode 80x25, font 8x16
(XEN)  VBE/DDC methods: none; EDID transfer time: 0 seconds
(XEN)  EDID info not retrieved because no DDC retrieval method detected
(XEN) Disc information:
(XEN)  Found 4 MBR signatures
(XEN)  Found 4 EDD information structures
(XEN) Xen-e820 RAM map:
(XEN)  0000000000000000 - 0000000000098400 (usable)
(XEN)  0000000000098400 - 00000000000a0000 (reserved)
(XEN)  00000000000e0000 - 0000000000100000 (reserved)
(XEN)  0000000000100000 - 00000000bf780000 (usable)
(XEN)  00000000bf78e000 - 00000000bf790000 type 9
(XEN)  00000000bf790000 - 00000000bf79e000 (ACPI data)
(XEN)  00000000bf79e000 - 00000000bf7d0000 (ACPI NVS)
(XEN)  00000000bf7d0000 - 00000000bf7e0000 (reserved)
(XEN)  00000000bf7ec000 - 00000000c0000000 (reserved)
(XEN)  00000000e0000000 - 00000000f0000000 (reserved)
(XEN)  00000000fee00000 - 00000000fee01000 (reserved)
(XEN)  00000000ffc00000 - 0000000100000000 (reserved)
(XEN)  0000000100000000 - 0000001840000000 (usable)
(XEN) New Xen image base address: 0xbf000000
(XEN) ACPI: RSDP 000FACE0, 0024 (r2 ACPIAM)
(XEN) ACPI: XSDT BF790100, 008C (r1 SMCI            20120803 MSFT       97)
(XEN) ACPI: FACP BF790290, 00F4 (r3 080312 FACP1521 20120803 MSFT       97)
(XEN) ACPI: DSDT BF7906A0, 6580 (r1  10600 10600000        0 INTL 20051117)
(XEN) ACPI: FACS BF79E000, 0040
(XEN) ACPI: APIC BF790390, 011E (r1 080312 APIC1521 20120803 MSFT       97)
(XEN) ACPI: MCFG BF7904B0, 003C (r1 080312 OEMMCFG  20120803 MSFT       97)
(XEN) ACPI: SLIT BF7904F0, 0030 (r1 080312 OEMSLIT  20120803 MSFT       97)
(XEN) ACPI: OEMB BF79E040, 0086 (r1 080312 OEMB1521 20120803 MSFT       97)
(XEN) ACPI: SRAT BF79A6A0, 01D0 (r1 080312 OEMSRAT         1 INTL        1)
(XEN) ACPI: HPET BF79A870, 0038 (r1 080312 OEMHPET  20120803 MSFT       97)
(XEN) ACPI: DMAR BF79E0D0, 0130 (r1    AMI  OEMDMAR        1 MSFT       97)
(XEN) ACPI: SSDT BF7A1710, 0363 (r1 DpgPmm    CpuPm       12 INTL 20051117)
(XEN) ACPI: EINJ BF79A8B0, 0130 (r1  AMIER AMI_EINJ 20120803 MSFT       97)
(XEN) ACPI: BERT BF79AA40, 0030 (r1  AMIER AMI_BERT 20120803 MSFT       97)
(XEN) ACPI: ERST BF79AA70, 01B0 (r1  AMIER AMI_ERST 20120803 MSFT       97)
(XEN) ACPI: HEST BF79AC20, 00A8 (r1  AMIER ABC_HEST 20120803 MSFT       97)
(XEN) System RAM: 98295MB (100654176kB)
(XEN) SRAT: PXM 0 -> APIC 00 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 02 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 04 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 06 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 01 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 03 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 05 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 07 -> Node 0
(XEN) SRAT: PXM 1 -> APIC 10 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 12 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 14 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 16 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 11 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 13 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 15 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 17 -> Node 1
(XEN) SRAT: Node 0 PXM 0 0-a0000
(XEN) SRAT: Node 0 PXM 0 100000-c0000000
(XEN) SRAT: Node 0 PXM 0 100000000-c40000000
(XEN) SRAT: Node 1 PXM 1 c40000000-1840000000
(XEN) NUMA: Allocated memnodemap from 183e1b7000 - 183e1d0000
(XEN) NUMA: Using 8 for the hash shift.
(XEN) Domain heap initialised DMA width 32 bits
(XEN) CPU Vendor: Intel, Family 6 (0x6), Model 26 (0x1a), Stepping 5 (raw 000106a5)
(XEN) found SMP MP-table at 000ff780
(XEN) DMI present.
(XEN) Using APIC driver default
(XEN) ACPI: PM-Timer IO Port: 0x808 (32 bits)
(XEN) ACPI: SLEEP INFO: pm1x_cnt[1:804,1:0], pm1x_evt[1:800,1:0]
(XEN) ACPI:             wakeup_vec[bf79e00c], vec_size[20]
(XEN) ACPI: Local APIC address 0xfee00000
(XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x10] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x02] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x12] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x04] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x06] lapic_id[0x14] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x07] lapic_id[0x06] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x08] lapic_id[0x16] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x09] lapic_id[0x01] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x11] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x03] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x13] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x05] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x15] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x07] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x10] lapic_id[0x17] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x11] lapic_id[0x90] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x12] lapic_id[0x91] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x13] lapic_id[0x92] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x14] lapic_id[0x93] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x15] lapic_id[0x94] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x16] lapic_id[0x95] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x17] lapic_id[0x96] disabled)
(XEN) ACPI: LAPIC (acpi_id[0x18] lapic_id[0x97] disabled)
(XEN) ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
(XEN) Overriding APIC driver with bigsmp
(XEN) ACPI: IOAPIC (id[0x08] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
(XEN) ACPI: IOAPIC (id[0x09] address[0xfec8a000] gsi_base[24])
(XEN) IOAPIC[1]: apic_id 9, version 32, address 0xfec8a000, GSI 24-47
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
(XEN) ACPI: IRQ0 used by override.
(XEN) ACPI: IRQ2 used by override.
(XEN) ACPI: IRQ9 used by override.
(XEN) Enabling APIC mode:  Phys.  Using 2 I/O APICs
(XEN) ACPI: HPET id: 0x8086a301 base: 0xfed00000
(XEN) PCI: MCFG configuration 0: base e0000000 segment 0000 buses 00 - ff
(XEN) PCI: MCFG area at e0000000 reserved in E820
(XEN) PCI: Using MCFG for segment 0000 bus 00-ff
(XEN) [VT-D]Host address width 40
(XEN) [VT-D]found ACPI_DMAR_DRHD:
(XEN) [VT-D]  dmaru->address = fbffe000
(XEN) [VT-D]drhd->address = fbffe000 iommu->reg = ffff82c00021d000
(XEN) [VT-D]cap = c90780106f0462 ecap = f020fe
(XEN) [VT-D] IOAPIC: 0000:f0:1f.7
(XEN) [VT-D] IOAPIC: 0000:00:13.0
(XEN) [VT-D]  flags: INCLUDE_ALL
(XEN) [VT-D]found ACPI_DMAR_RMRR:
(XEN) [VT-D] endpoint: 0000:00:1d.0
(XEN) [VT-D] endpoint: 0000:00:1d.1
(XEN) [VT-D] endpoint: 0000:00:1d.2
(XEN) [VT-D] endpoint: 0000:00:1d.7
(XEN) [VT-D] endpoint: 0000:00:1a.0
(XEN) [VT-D] endpoint: 0000:00:1a.1
(XEN) [VT-D] endpoint: 0000:00:1a.2
(XEN) [VT-D] endpoint: 0000:00:1a.7
(XEN) [VT-D]found ACPI_DMAR_RMRR:
(XEN) [VT-D] endpoint: 0000:00:1d.0
(XEN) [VT-D] endpoint: 0000:00:1d.1
(XEN) [VT-D] endpoint: 0000:00:1d.2
(XEN) [VT-D] endpoint: 0000:00:1d.7
(XEN) [VT-D] endpoint: 0000:00:1a.0
(XEN) [VT-D] endpoint: 0000:00:1a.1
(XEN) [VT-D] endpoint: 0000:00:1a.2
(XEN) [VT-D] endpoint: 0000:00:1a.7
(XEN) [VT-D]found ACPI_DMAR_ATSR:
(XEN) [VT-D]  atsru->all_ports: 0
(XEN) [VT-D] bridge: 0000:00:01.0 start=0 sec=1 sub=1
(XEN) [VT-D] bridge: 0000:00:03.0 start=0 sec=2 sub=2
(XEN) [VT-D] bridge: 0000:00:05.0 start=0 sec=3 sub=3
(XEN) [VT-D] bridge: 0000:00:07.0 start=0 sec=4 sub=4
(XEN) [VT-D] bridge: 0000:00:09.0 start=0 sec=5 sub=5
(XEN) Failed to get Error Log Address Range.
(XEN) HEST: Table parsing has been initialized
(XEN) Using ACPI (MADT) for SMP configuration information
(XEN) SMP: Allowing 24 CPUs (8 hotplug CPUs)
(XEN) IRQ limits: 48 GSI, 3040 MSI/MSI-X
(XEN) CPU0: Intel machine check reporting enabled
(XEN) Speculative mitigation facilities:
(XEN)   Hardware features:
(XEN)   Compiled-in support: SHADOW_PAGING
(XEN)   Xen settings: BTI-Thunk N/A, SPEC_CTRL: No, Other:
(XEN)   L1TF: believed vulnerable, maxphysaddr L1D 44, CPUID 40, Safe address 10000000000
(XEN)   Support for HVM VMs: RSB EAGER_FPU
(XEN)   Support for PV VMs: RSB EAGER_FPU
(XEN)   XPTI (64-bit PV only): Dom0 enabled, DomU enabled (without PCID)
(XEN)   PV L1TF shadowing: Dom0 disabled, DomU enabled
(XEN) Using scheduler: SMP Credit Scheduler rev2 (credit2)
(XEN) Initializing Credit2 scheduler
(XEN)  load_precision_shift: 18
(XEN)  load_window_shift: 30
(XEN)  underload_balance_tolerance: 0
(XEN)  overload_balance_tolerance: -3
(XEN)  runqueues arrangement: socket
(XEN)  cap enforcement granularity: 10ms
(XEN) load tracking window length 1073741824 ns
(XEN) Adding cpu 0 to runqueue 0
(XEN)  First cpu on runqueue, activating
(XEN) Platform timer is 14.318MHz HPET
(XEN) Detected 2279.646 MHz processor.
(XEN) Initing memory sharing.
(XEN) alt table ffff82d0804309b8 -> ffff82d0804318d0
(XEN) Intel VT-d iommu 0 supported page sizes: 4kB.
(XEN) Intel VT-d Snoop Control enabled.
(XEN) Intel VT-d Dom0 DMA Passthrough not enabled.
(XEN) Intel VT-d Queued Invalidation enabled.
(XEN) Intel VT-d Interrupt Remapping enabled.
(XEN) Intel VT-d Posted Interrupt not enabled.
(XEN) Intel VT-d Shared EPT tables not enabled.
(XEN) I/O virtualisation enabled
(XEN)  - Dom0 mode: Relaxed
(XEN) Interrupt remapping enabled
(XEN) nr_sockets: 3
(XEN) ENABLING IO-APIC IRQs
(XEN)  -> Using old ACK method
(XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1
(XEN) Allocated console ring of 128 KiB.
(XEN) mwait-idle: MWAIT substates: 0x1120
(XEN) mwait-idle: v0.4.1 model 0x1a
(XEN) mwait-idle: lapic_timer_reliable_states 0x2
(XEN) HPET: 0 timers usable for broadcast (4 total)
(XEN) VMX: Supported advanced features:
(XEN)  - APIC MMIO access virtualisation
(XEN)  - APIC TPR shadow
(XEN)  - Extended Page Tables (EPT)
(XEN)  - Virtual-Processor Identifiers (VPID)
(XEN)  - Virtual NMI
(XEN)  - MSR direct-access bitmap
(XEN) HVM: ASIDs enabled.
(XEN) HVM: VMX enabled
(XEN) HVM: Hardware Assisted Paging (HAP) detected
(XEN) HVM: HAP page sizes: 4kB, 2MB
(XEN) Adding cpu 1 to runqueue 0
(XEN) Adding cpu 2 to runqueue 0
(XEN) Adding cpu 3 to runqueue 0
(XEN) Adding cpu 4 to runqueue 0
(XEN) Adding cpu 5 to runqueue 0
(XEN) Adding cpu 6 to runqueue 0
(XEN) Adding cpu 7 to runqueue 0
(XEN) Adding cpu 8 to runqueue 1
(XEN)  First cpu on runqueue, activating
(XEN) Adding cpu 9 to runqueue 1
(XEN) Adding cpu 10 to runqueue 1
(XEN) Adding cpu 11 to runqueue 1
(XEN) Adding cpu 12 to runqueue 1
(XEN) Adding cpu 13 to runqueue 1
(XEN) Adding cpu 14 to runqueue 1
(XEN) Adding cpu 15 to runqueue 1
(XEN) Brought up 16 CPUs
(XEN) build-id: aba2ec2f0b48776dac7a6e615962fec7240f6447
(XEN) ACPI sleep modes: S3
(XEN) VPMU: disabled
(XEN) mcheck_poll: Machine check polling timer started.
(XEN) Dom0 has maximum 816 PIRQs
(XEN) NX (Execute Disable) protection active
(XEN) *** Building a PVH Dom0 ***
(XEN) [VT-D]d0:Hostbridge: skip 0000:00:00.0 map
(XEN) Masked UR signaling on 0000:00:00.0
(XEN) Masked UR signaling on 0000:00:01.0
(XEN) Masked UR signaling on 0000:00:03.0
(XEN) Masked UR signaling on 0000:00:05.0
(XEN) Masked UR signaling on 0000:00:07.0
(XEN) Masked UR signaling on 0000:00:09.0
(XEN) [VT-D]d0:PCI: map 0000:00:13.0
(XEN) [VT-D]d0:PCIe: map 0000:00:14.0
(XEN) Masked VT-d error signaling on 0000:00:14.0
(XEN) [VT-D]d0:PCIe: map 0000:00:14.1
(XEN) [VT-D]d0:PCIe: map 0000:00:14.2
(XEN) [VT-D]d0:PCI: map 0000:00:14.3
(XEN) [VT-D]d0:PCIe: map 0000:00:16.0
(XEN) [VT-D]d0:PCIe: map 0000:00:16.1
(XEN) [VT-D]d0:PCIe: map 0000:00:16.2
(XEN) [VT-D]d0:PCIe: map 0000:00:16.3
(XEN) [VT-D]d0:PCIe: map 0000:00:16.4
(XEN) [VT-D]d0:PCIe: map 0000:00:16.5
(XEN) [VT-D]d0:PCIe: map 0000:00:16.6
(XEN) [VT-D]d0:PCIe: map 0000:00:16.7
(XEN) [VT-D]d0:PCI: map 0000:00:1a.0
(XEN) [VT-D]d0:PCI: map 0000:00:1a.1
(XEN) [VT-D]d0:PCI: map 0000:00:1a.2
(XEN) [VT-D]d0:PCI: map 0000:00:1a.7
(XEN) [VT-D]d0:PCI: map 0000:00:1d.0
(XEN) [VT-D]d0:PCI: map 0000:00:1d.1
(XEN) [VT-D]d0:PCI: map 0000:00:1d.2
(XEN) [VT-D]d0:PCI: map 0000:00:1d.7
(XEN) [VT-D]d0:PCI: map 0000:00:1f.0
(XEN) [VT-D]d0:PCI: map 0000:00:1f.2
(XEN) [VT-D]d0:PCI: map 0000:00:1f.3
(XEN) [VT-D]d0:PCIe: map 0000:01:00.0
(XEN) [VT-D]d0:PCIe: map 0000:01:00.1
(XEN) [VT-D]d0:PCIe: map 0000:03:00.0
(XEN) [VT-D]d0:PCIe: map 0000:03:00.1
(XEN) [VT-D]d0:PCI: map 0000:06:01.0
(XEN) [VT-D]d0:Hostbridge: skip 0000:fe:00.0 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:fe:00.1 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:fe:02.0 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:fe:02.1 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:fe:02.4 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:fe:02.5 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:fe:03.0 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:fe:03.1 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:fe:03.2 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:fe:03.4 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:fe:04.0 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:fe:04.1 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:fe:04.2 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:fe:04.3 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:fe:05.0 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:fe:05.1 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:fe:05.2 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:fe:05.3 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:fe:06.0 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:fe:06.1 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:fe:06.2 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:fe:06.3 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:ff:00.0 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:ff:00.1 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:ff:02.0 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:ff:02.1 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:ff:02.4 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:ff:02.5 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:ff:03.0 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:ff:03.1 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:ff:03.2 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:ff:03.4 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:ff:04.0 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:ff:04.1 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:ff:04.2 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:ff:04.3 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:ff:05.0 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:ff:05.1 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:ff:05.2 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:ff:05.3 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:ff:06.0 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:ff:06.1 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:ff:06.2 map
(XEN) [VT-D]d0:Hostbridge: skip 0000:ff:06.3 map
(XEN) [VT-D]iommu_enable_translation: iommu->reg = ffff82c00021d000
(XEN) Dom0 memory allocation stats:
(XEN) order  3 allocations: 2
(XEN) order  4 allocations: 1
(XEN) order  5 allocations: 1
(XEN) order  6 allocations: 1
(XEN) order  7 allocations: 3
(XEN) order  8 allocations: 2
(XEN) order  9 allocations: 2
(XEN) order 10 allocations: 2
(XEN) order 11 allocations: 2
(XEN) order 12 allocations: 2
(XEN) order 13 allocations: 2
(XEN) order 14 allocations: 2
(XEN) order 15 allocations: 2
(XEN) order 16 allocations: 2
(XEN) order 17 allocations: 2
(XEN) order 18 allocations: 2
(XEN) WARNING: PVH is an experimental mode with limited functionality
(XEN) Initial low memory virq threshold set at 0x4000 pages.
(XEN) Scrubbing Free RAM in background
(XEN) Std. Loglevel: All
(XEN) Guest Loglevel: All
(XEN) ***************************************************
(XEN) WARNING: CONSOLE OUTPUT IS SYNCHRONOUS
(XEN) This option is intended to aid debugging of Xen by ensuring
(XEN) that all output is synchronously delivered on the serial line.
(XEN) However it can introduce SIGNIFICANT latencies and affect
(XEN) timekeeping. It is NOT recommended for production use!
(XEN) ***************************************************
(XEN) Booted on L1TF-vulnerable hardware with SMT/Hyperthreading
(XEN) enabled.  Please assess your configuration and choose an
(XEN) explicit 'smt=<bool>' setting.  See XSA-273.
(XEN) ***************************************************
(XEN) Booted on MLPDS/MFBDS-vulnerable hardware with SMT/Hyperthreading
(XEN) enabled.  Mitigations will not be fully effective.  Please
(XEN) choose an explicit smt=<bool> setting.  See XSA-297.
(XEN) ***************************************************
(XEN) 3... 2... 1... 
(XEN) Xen is relinquishing VGA console.
(XEN) *** Serial input to DOM0 (type 'CTRL-a' three times to switch input)
(XEN) Freed 500kB init memory
---<<BOOT>>---
Copyright (c) 1992-2018 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 12.0-RELEASE-p10 GENERIC amd64
FreeBSD clang version 6.0.1 (tags/RELEASE_601/final 335540) (based on LLVM 6.0.1)
VT(vga): text 80x25
XEN: Hypervisor version 4.12 detected.
CPU: Intel(R) Xeon(R) CPU           E5520  @ 2.27GHz (2279.65-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x106a5  Family=0x6  Model=0x1a  Stepping=5
  Features=0x1fc3fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT>
  Features2=0x80982201<SSE3,SSSE3,CX16,SSE4.1,SSE4.2,POPCNT,HV>
  AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
  AMD Features2=0x1<LAHF>
  TSC: P-state invariant
Hypervisor: Origin = "XenVMMXenVMM"
real memory  = 5378048000 (5128 MB)
avail memory = 4099301376 (3909 MB)
Event timer "LAPIC" quality 100
ACPI APIC Table: <080312 APIC1521>
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
FreeBSD/SMP: 1 package(s) x 4 core(s)
random: unblocking device.
Firmware Warning (ACPI): 32/64X length mismatch in FADT/Gpe0Block: 128/64 (20181003/tbfadt-748)
ioapic1: Changing APIC ID to 9
ioapic0 <Version 1.1> irqs 0-23 on motherboard
ioapic1 <Version 0.0> irqs 24-24 on motherboard
Launching APs: 2 1 3
random: entropy device external interface
kbd1 at kbdmux0
netmap: loaded module
[ath_hal] loaded
module_register_init: MOD_LOAD (vesa, 0xffffffff810f9a00, 0) error 19
nexus0
vtvga0: <VT VGA driver> on motherboard
cryptosoft0: <software crypto> on motherboard
acpi0: <SMCI > on motherboard
(XEN) d0: bind: m_gsi=9 g_gsi=9
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> on acpi0
attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
(XEN) d0: bind: m_gsi=8 g_gsi=8
Event timer "RTC" frequency 32768 Hz quality 0
hpet0: <High Precision Event Timer> iomem 0xfed03000-0xfed033ff on acpi0
hpet0: HPET never increments, disabling
device_attach: hpet0 attach returned 6
Timecounter "ACPI-safe" frequency 3579545 Hz quality 850
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 1.0 on pci0
pci1: <ACPI PCI bus> on pcib1
igb0: <Intel(R) PRO/1000 PCI-Express Network Driver> port 0xdc00-0xdc1f mem 0xfbce0000-0xfbcfffff,0xfbcc0000-0xfbcdffff,0xfbc9c000-0xfbc9ffff irq 28 at device 0.0 on pci1
igb0: attach_pre capping queues at 8
igb0: using 1024 tx descriptors and 1024 rx descriptors
igb0: msix_init qsets capped at 8
igb0: pxm cpus: 4 queue msgs: 9 admincnt: 1
igb0: using 4 rx queues 4 tx queues 
igb0: Using MSIX interrupts with 5 vectors
igb0: allocated for 4 tx_queues
igb0: allocated for 4 rx_queues
igb0: Ethernet address: 00:25:90:36:fd:2e
igb0: netmap queues/slots: TX 4/1024, RX 4/1024
igb1: <Intel(R) PRO/1000 PCI-Express Network Driver> port 0xd880-0xd89f mem 0xfbc60000-0xfbc7ffff,0xfbc40000-0xfbc5ffff,0xfbc1c000-0xfbc1ffff irq 40 at device 0.1 on pci1
igb1: attach_pre capping queues at 8
igb1: using 1024 tx descriptors and 1024 rx descriptors
igb1: msix_init qsets capped at 8
igb1: pxm cpus: 4 queue msgs: 9 admincnt: 1
igb1: using 4 rx queues 4 tx queues 
igb1: Using MSIX interrupts with 5 vectors
igb1: allocated for 4 tx_queues
igb1: allocated for 4 rx_queues
igb1: Ethernet address: 00:25:90:36:fd:2f
igb1: netmap queues/slots: TX 4/1024, RX 4/1024
pcib2: <ACPI PCI-PCI bridge> at device 3.0 on pci0
pci2: <ACPI PCI bus> on pcib2
pcib3: <ACPI PCI-PCI bridge> at device 5.0 on pci0
pci3: <ACPI PCI bus> on pcib3
igb2: <Intel(R) PRO/1000 PCI-Express Network Driver> port 0xec00-0xec1f mem 0xfbde0000-0xfbdfffff,0xfbdc0000-0xfbddffff,0xfbd9c000-0xfbd9ffff irq 26 at device 0.0 on pci3
igb2: attach_pre capping queues at 8
igb2: using 1024 tx descriptors and 1024 rx descriptors
igb2: msix_init qsets capped at 8
igb2: pxm cpus: 4 queue msgs: 9 admincnt: 1
igb2: using 4 rx queues 4 tx queues 
igb2: Using MSIX interrupts with 5 vectors
igb2: allocated for 4 tx_queues
igb2: allocated for 4 rx_queues
igb2: Ethernet address: 00:25:90:09:c8:da
igb2: netmap queues/slots: TX 4/1024, RX 4/1024
igb3: <Intel(R) PRO/1000 PCI-Express Network Driver> port 0xe880-0xe89f mem 0xfbd60000-0xfbd7ffff,0xfbd40000-0xfbd5ffff,0xfbd1c000-0xfbd1ffff irq 25 at device 0.1 on pci3
igb3: attach_pre capping queues at 8
igb3: using 1024 tx descriptors and 1024 rx descriptors
igb3: msix_init qsets capped at 8
igb3: pxm cpus: 4 queue msgs: 9 admincnt: 1
igb3: using 4 rx queues 4 tx queues 
igb3: Using MSIX interrupts with 5 vectors
igb3: allocated for 4 tx_queues
igb3: allocated for 4 rx_queues
igb3: Ethernet address: 00:25:90:09:c8:db
igb3: netmap queues/slots: TX 4/1024, RX 4/1024
pcib4: <ACPI PCI-PCI bridge> at device 7.0 on pci0
pci4: <ACPI PCI bus> on pcib4
pcib5: <ACPI PCI-PCI bridge> at device 9.0 on pci0
pci5: <ACPI PCI bus> on pcib5
pci0: <base peripheral, interrupt controller> at device 20.0 (no driver attached)
pci0: <base peripheral, interrupt controller> at device 20.1 (no driver attached)
pci0: <base peripheral, interrupt controller> at device 20.2 (no driver attached)
pci0: <base peripheral, interrupt controller> at device 20.3 (no driver attached)
uhci0: <Intel 82801JI (ICH10) USB controller USB-D> port 0xcc00-0xcc1f irq 16 at device 26.0 on pci0
(XEN) d0: bind: m_gsi=16 g_gsi=16
uhci0: LegSup = 0x2f00
usbus0 on uhci0
usbus0: 12Mbps Full Speed USB v1.0
uhci1: <Intel 82801JI (ICH10) USB controller USB-E> port 0xc880-0xc89f irq 21 at device 26.1 on pci0
(XEN) d0: bind: m_gsi=21 g_gsi=21
uhci1: LegSup = 0x2f00
usbus1 on uhci1
usbus1: 12Mbps Full Speed USB v1.0
uhci2: <Intel 82801JI (ICH10) USB controller USB-F> port 0xc800-0xc81f irq 19 at device 26.2 on pci0
(XEN) d0: bind: m_gsi=19 g_gsi=19
uhci2: LegSup = 0x2f00
usbus2 on uhci2
usbus2: 12Mbps Full Speed USB v1.0
ehci0: <Intel 82801JI (ICH10) USB 2.0 controller USB-B> mem 0xfbeda000-0xfbeda3ff irq 18 at device 26.7 on pci0
(XEN) d0: bind: m_gsi=18 g_gsi=18
usbus3: EHCI version 1.0
usbus3 on ehci0
usbus3: 480Mbps High Speed USB v2.0
uhci3: <Intel 82801JI (ICH10) USB controller USB-A> port 0xc480-0xc49f irq 23 at device 29.0 on pci0
(XEN) d0: bind: m_gsi=23 g_gsi=23
uhci3: LegSup = 0x2f00
usbus4 on uhci3
usbus4: 12Mbps Full Speed USB v1.0
uhci4: <Intel 82801JI (ICH10) USB controller USB-B> port 0xc400-0xc41f irq 19 at device 29.1 on pci0
uhci4: LegSup = 0x2f00
usbus5 on uhci4
usbus5: 12Mbps Full Speed USB v1.0
uhci5: <Intel 82801JI (ICH10) USB controller USB-C> port 0xc080-0xc09f irq 18 at device 29.2 on pci0
uhci5: LegSup = 0x2f00
usbus6 on uhci5
usbus6: 12Mbps Full Speed USB v1.0
ehci1: <Intel 82801JI (ICH10) USB 2.0 controller USB-A> mem 0xfbed8000-0xfbed83ff irq 23 at device 29.7 on pci0
usbus7: EHCI version 1.0
usbus7 on ehci1
usbus7: 480Mbps High Speed USB v2.0
pcib6: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci6: <ACPI PCI bus> on pcib6
vgapci0: <VGA-compatible display> mem 0xf9000000-0xf9ffffff,0xfaffc000-0xfaffffff,0xfb000000-0xfb7fffff irq 18 at device 1.0 on pci6
vgapci0: Boot video device
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
ahci0: <Intel ICH10 AHCI SATA controller> port 0xb480-0xb487,0xc000-0xc003,0xbc00-0xbc07,0xb880-0xb883,0xb800-0xb81f mem 0xfbed6000-0xfbed67ff irq 19 at device 31.2 on pci0
ahci0: AHCI v1.20 with 6 3Gbps ports, Port Multiplier not supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
ahcich4: <AHCI channel> at channel 4 on ahci0
ahcich5: <AHCI channel> at channel 5 on ahci0
ahciem0: <AHCI enclosure management bridge> on ahci0
acpi_button0: <Power Button> on acpi0
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
(XEN) d0: bind: m_gsi=4 g_gsi=4
xenpv0: <Xen PV bus> on motherboard
granttable0: <Xen Grant-table Device> on xenpv0
xen_et0: <Xen PV Clock> on xenpv0
Event timer "XENTIMER" frequency 1000000000 Hz quality 950
Timecounter "XENTIMER" frequency 1000000000 Hz quality 950
xen_et0: registered as a time-of-day clock, resolution 0.000001s
xenstore0: <XenStore> on xenpv0
xsd_dev0: <Xenstored user-space device> on xenpv0
evtchn0: <Xen event channel user-space device> on xenpv0
privcmd0: <Xen privileged interface user-space device> on xenpv0
gntdev0: <Xen grant-table user-space device> on xenpv0
debug0: <Xen debug handler> on xenpv0
xc0: <Xen Console> on xenpv0
ipmi0: <IPMI System Interface> on isa0
ipmi0: KCS mode found at io 0xca2 alignment 0x1 on isa
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xc8fff,0xc9000-0xc9fff,0xca000-0xcafff pnpid ORM0000 on isa0
vga0: <Generic ISA VGA> at port 0x3d0-0x3db iomem 0xb8000-0xbffff pnpid PNP0900 on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
(XEN) d0: bind: m_gsi=1 g_gsi=1
atkbd0: [GIANT-LOCKED]
atkbdc0: non-PNP ISA device will be removed from GENERIC in FreeBSD 12.
Timecounters tick every 10.000 msec
ipmi0: IPMI device rev. 1, firmware rev. 3.13, version 2.0, device support mask 0xbf
ipmi0: Number of channels 2
ipmi0: Attached watchdog
ipmi0: Establishing power cycle handler
ugen0.1: <Intel UHCI root HUB> at usbus0
ugen7.1: <Intel EHCI root HUB> at usbus7
uhub0: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
ugen6.1: <Intel UHCI root HUB> at usbus6
ugen4.1: <Intel UHCI root HUB> at usbus4
ugen2.1: <Intel UHCI root HUB> at usbus2
uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus7
uhub2: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus4
ugen1.1: <Intel UHCI root HUB> at usbus1
uhub4: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus2
ugen3.1: <Intel EHCI root HUB> at usbus3
uhub5: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1
uhub3: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus6
ugen5.1: <Intel UHCI root HUB> at usbus5
uhub6: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus3
uhub7: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus5
uhub0: 2 ports with 2 removable, self powered
uhub4: 2 ports with 2 removable, self powered
uhub2: 2 ports with 2 removable, self powered
uhub3: 2 ports with 2 removable, self powered
uhub5: 2 ports with 2 removable, self powered
uhub7: 2 ports with 2 removable, self powered
ses0 at ahciem0 bus 0 scbus6 target 0 lun 0
ses0: <AHCI SGPIO Enclosure 1.00 0001> SEMB S-E-S 2.00 device
ses0: SEMB SES Device
ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
ada0: <ST4000DM005-2DP166 0001> ACS-3 ATA SATA 3.x device
ada0: Serial Number ZGY0KSAS
ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 3815447MB (7814037168 512 byte sectors)
ada0: quirks=0x1<4K>
ada1 at ahcich1 bus 0 scbus1 target 0 lun 0
ada1: <ST4000DM005-2DP166 0001> ACS-3 ATA SATA 3.x device
ada1: Serial Number ZGY0KSC9
ada1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada1: Command Queueing enabled
ada1: 3815447MB (7814037168 512 byte sectors)
ada1: quirks=0x1<4K>
ada2 at ahcich2 bus 0 scbus2 target 0 lun 0
ada2: <ST4000DM005-2DP166 0001> ACS-3 ATA SATA 3.x device
ada2: Serial Number ZGY0KS9B
ada2: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada2: Command Queueing enabled
ada2: 3815447MB (7814037168 512 byte sectors)
ada2: quirks=0x1<4K>
ada3 at ahcich3 bus 0 scbus3 target 0 lun 0
ada3: <ST4000DM005-2DP166 0001> ACS-3 ATA SATA 3.x device
ada3: Serial Number ZDH1SGEB
ada3: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada3: Command Queueing enabled
ada3: 3815447MB (7814037168 512 byte sectors)
ada3: quirks=0x1<4K>
Trying to mount root from ufs:/dev/gpt/gptroot [rw]...
uhub1: 6 ports with 6 removable, self powered
uhub6: 6 ports with 6 removable, self powered
cd0 at ahcich4 bus 0 scbus4 target 0 lun 0
cd0: <TEAC DV-28E-V 1.AB> Removable CD-ROM SCSI device
cd0: 150.000MB/s transfers (SATA 1.x, UDMA2, ATAPI 12bytes, PIO 8192bytes)
cd0: Attempt to query device size failed: NOT READY, Medium not present - tray closed
GEOM_MIRROR: Device mirror/gm0 launched (1/2).
GEOM_MIRROR: Device gm0: rebuilding provider ada2.
WARNING: /mnt was not properly dismounted
ugen1.2: <American Megatrends Inc. Virtual Keyboard and Mouse> at usbus1
ukbd0 on uhub5
ukbd0: <Keyboard Interface> on usbus1
kbd2 at ukbd0
Setting hostuuid: 49434d53-0200-9009-2500-09902500dac8.
Setting hostid: 0x0535156f.
ZFS NOTICE: Prefetch is disabled by default if less than 4GB of RAM is present;
            to enable, add "vfs.zfs.prefetch_disable=0" to /boot/loader.conf.
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Starting file system checks:
/dev/gpt/gptroot: DEFER FOR BACKGROUND CHECKING
WARNING: / was not properly dismounted
Mounting local filesystems:.
ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/gcc9 /usr/local/lib/perl5/5.30/mach/CORE
32-bit compatibility ldconfig path: /usr/lib32
Setting hostname: xen3.via.net.
Setting up harvesting: [UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,NET_ETHER,NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED
Feeding entropy: .
bridge0: Ethernet address: 02:05:35:15:6f:00
Created clone interfaces: bridge0.
lo0: link state changed to UP
ifconfig: BRDGADD vlan34: No such file or directory
igb0: link state changed to UP
Starting Network: lo0 igb0 igb1 igb2 igb3 bridge0.
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
	options=680003<RXCSUM,TXCSUM,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
	inet6 ::1 prefixlen 128 
	inet6 fe80::1%lo0 prefixlen 64 scopeid 0x5 
	inet 127.0.0.1 netmask 0xff000000 
	groups: lo 
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
igb0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=e527bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,WOL_MAGIC,VLAN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
	ether 00:25:90:36:fd:2e
	inet 209.81.0.202 netmask 0xffffff00 broadcast 209.81.0.255 
	media: Ethernet autoselect (1000baseT <full-duplex>)
	status: active
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
igb1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=e527bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,WOL_MAGIC,VLAN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
	ether 00:25:90:36:fd:2f
igb1: link state changed to UP
	media: Ethernet autoselect (1000baseT <full-duplex>)
	status: active
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
igb2: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=e527bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,WOL_MAGIC,VLAN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
	ether 00:25:90:09:c8:da
	media: Ethernet autoselect
	status: no carrier
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
igb3: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=e527bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,WOL_MAGIC,VLAN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
	ether 00:25:90:09:c8:db
	media: Ethernet autoselect
	status: no carrier
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
bridge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
	ether 02:05:35:15:6f:00
	id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15
	maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200
	root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
	groups: bridge 
	nd6 options=9<PERFORMNUD,IFDISABLED>
Starting devd.
Starting Network: igb2.
igb2: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=e527bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,WOL_MAGIC,VLAN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
	ether 00:25:90:09:c8:da
	media: Ethernet autoselect
	status: no carrier
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
Starting Network: igb3.
igb3: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=e527bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,WOL_MAGIC,VLAN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
	ether 00:25:90:09:c8:db
	media: Ethernet autoselect
	status: no carrier
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
Autoloading module: ioat.ko
ioat0: <TBG IOAT Ch0> mem 0xfbef8000-0xfbefbfff irq 43 at device 22.0 on pci0
ioat0: Capabilities: 77<Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat1: <TBG IOAT Ch1> mem 0xfbef4000-0xfbef7fff irq 44 at device 22.1 on pci0
ioat1: Capabilities: 77<Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat2: <TBG IOAT Ch2> mem 0xfbef0000-0xfbef3fff irq 45 at device 22.2 on pci0
ioat2: Capabilities: 77<Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat3: <TBG IOAT Ch3> mem 0xfbeec000-0xfbeeffff irq 46 at device 22.3 on pci0
ioat3: Capabilities: 77<Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat4: <TBG IOAT Ch4> mem 0xfbee8000-0xfbeebfff irq 43 at device 22.4 on pci0
ioat4: Capabilities: 77<Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat5: <TBG IOAT Ch5> mem 0xfbee4000-0xfbee7fff irq 44 at device 22.5 on pci0
ioat5: Capabilities: 77<Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat6: <TBG IOAT Ch6> mem 0xfbee0000-0xfbee3fff irq 45 at device 22.6 on pci0
ioat6: Capabilities: 77<Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
ioat7: <TBG IOAT Ch7> mem 0xfbedc000-0xfbedffff irq 46 at device 22.7 on pci0
ioat7: Capabilities: 77<Block_Fill,Move_CRC,DCA,Marker_Skipping,CRC,Page_Break>
Autoloading module: ioat.ko
Autoloading module: ioat.ko
Autoloading module: ioat.ko
Autoloading module: ioat.ko
Autoloading module: ioat.ko
Autoloading module: ioat.ko
Autoloading module: ioat.ko
Autoloading module: uhid.ko
Autoloading module: ums.ko
ums0 on uhub5
ums0: <Mouse Interface> on usbus1
Starting ums0 moused.
add host 127.0.0.1: gateway lo0 fib 0: route already in table
add net default: gateway 209.81.0.1
add host ::1: gateway lo0 fib 0: route already in table
add net fe80::: gateway ::1
add net ff02::: gateway ::1
add net ::ffff:0.0.0.0: gateway ::1
add net ::0.0.0.0: gateway ::1
Creating and/or trimming log files.
Starting syslogd.
Setting date via ntp.
Error resolving clock.via.net: hostname nor servname provided, or not known (8)
14 Oct 14:22:27 ntpdate[1145]: Can't find host clock.via.net: hostname nor servname provided, or not known (8)
14 Oct 14:22:27 ntpdate[1145]: no servers can be used, exiting
Clearing /tmp (X related).
Cleaning xenstore database.
Starting xenservices: xenstored, xenconsoled.Oct 14 14:22:28 xen3 xenstored[1271]: Checking store ...
Oct 14 14:22:28 xen3 xenstored[1271]: Checking store complete.
xs_dev0: <Xenstore user-space device> on xenstore0
xenbusb_front0: <Xen Frontend Devices> on xenstore0
xenbusb_back0: <Xen Backend Devices> on xenstore0
xenballoon0: <Xen Balloon Device> on xenstore0
xctrl0: <Xen Control Device> on xenstore0

Setting domain 0 name, domid and JSON config...
Done setting up Dom0
Updating motd:.
Mounting late filesystems:.
Configuring vt: blanktime.
Performing sanity check on sshd configuration.
Starting sshd.
Starting sendmail_submit.
Starting sendmail_msp_queue.
Starting cron.
Oct 14 14:22:34 xen3 sm-mta[1345]: x9C3a8eu001413: SYSERR(root): hash map "Alias0": missing map file /etc/mail/aliases.db: No such file or directory
Starting background file system checks in 60 seconds.

Mon Oct 14 14:22:35 PDT 2019
Oct 14 14:22:35 xen3 getty[1410]: open /dev/ttyu1: No such file or directory
Oct 14 14:22:35 xen3 getty[1411]: open /dev/ttyu1: No such file or directory
Oct 14 14:22:35 xen3 getty[1412]: open /dev/ttyu1: No such file or directory
Oct 14 14:22:35 xen3 getty[1413]: open /dev/ttyu1: No such file or directory
Oct 14 14:22:35 xen3 init[1414]: getty repeating too quickly on port /dev/ttyu1, sleeping 30 secs
Oct 14 14:23:05 xen3 getty[1414]: open /dev/ttyu1: No such file or directory
Oct 14 14:23:05 xen3 getty[1415]: open /dev/ttyu1: No such file or directory
Oct 14 14:23:05 xen3 getty[1416]: open /dev/ttyu1: No such file or directory
Oct 14 14:23:05 xen3 getty[1417]: open /dev/ttyu1: No such file or directory
Oct 14 14:23:05 xen3 getty[1418]: open /dev/ttyu1: No such file or directory
Oct 14 14:23:05 xen3 init[1419]: getty repeating too quickly on port /dev/ttyu1, sleeping 30 secs
Oct 14 14:23:35 xen3 getty[1419]: open /dev/ttyu1: No such file or directory
Oct 14 14:23:35 xen3 getty[1422]: open /dev/ttyu1: No such file or directory
Oct 14 14:23:35 xen3 getty[1423]: open /dev/ttyu1: No such file or directory
Oct 14 14:23:35 xen3 getty[1424]: open /dev/ttyu1: No such file or directory
Oct 14 14:23:35 xen3 getty[1425]: open /dev/ttyu1: No such file or directory
Oct 14 14:23:35 xen3 init[1426]: getty repeating too quickly on port /dev/ttyu1, sleeping 30 secs
dev = gpt/gptroot, block = 1, fs = /
panic: ffs_blkfree_cg: freeing free block
cpuid = 2
time = 1571088217
KDB: stack backtrace:
#0 0xffffffff80be78d7 at kdb_backtrace+0x67
#1 0xffffffff80b9b4b3 at vpanic+0x1a3
#2 0xffffffff80b9b303 at panic+0x43
#3 0xffffffff80e87345 at ffs_blkrelease_finish+0x6e5
#4 0xffffffff80e8433d at ffs_blkfree+0xad
#5 0xffffffff80eb10af at softdep_get_depcounts+0x48bf
#6 0xffffffff80eb0fe5 at softdep_get_depcounts+0x47f5
#7 0xffffffff80ea195a at softdep_update_inodeblock+0x178a
#8 0xffffffff80eab94a at softdep_request_cleanup+0xa8a
#9 0xffffffff80e95272 at softdep_flushworklist+0x1a2
#10 0xffffffff80e991df at softdep_unmount+0x4af
#11 0xffffffff80b5be83 at fork_exit+0x83
#12 0xffffffff8105061e at fork_trampoline+0xe
Uptime: 1m59s
Automatic reboot in 15 seconds - press a key on the console to abort
Rebooting...
cpu_reset: Restarting BSP
cpu_reset_proxy: Stopped CPU 2
(XEN) d0v2 Unexpected vmexit: reason 3
(XEN) d0v0 Unexpected vmexit: reason 3
(XEN) d0v1 Unexpected vmexit: reason 3
(XEN) d0v3 Unexpected vmexit: reason 3
(XEN) domain_crash called from vmx.c:4181
(XEN) domain_crash called from vmx.c:4181
(XEN) domain_crash called from vmx.c:4181
(XEN) domain_crash called from vmx.c:4181
(XEN) Domain 0 (vcpu#2) crashed on cpu#10:
(XEN) Domain 0 (vcpu#0) crashed on cpu#12:
(XEN) Domain 0 (vcpu#1) crashed on cpu#3:
(XEN) Domain 0 (vcpu#3) crashed on cpu#4:
(XEN) ----[ Xen-4.12.1  x86_64  debug=n   Tainted:  C   ]----
(XEN) CPU:    10
(XEN) RIP:    0020:[<ffffffff811df752>]
(XEN) RFLAGS: 0000000000000002   CONTEXT: hvm guest (d0v2)
(XEN) rax: 00000000000000aa   rbx: fffff80003061a40   rcx: 0000000000000001
(XEN) rdx: fffffe002ec63530   rsi: 0000000000000001   rdi: 0000000000000000
(XEN) rbp: fffffe002ec63660   rsp: fffffe002ec63630   r8:  0000000000000001
(XEN) r9:  fffffe002ec63530   r10: 000000000000001a   r11: 0000000000000001
(XEN) r12: fffff8000644f000   r13: fffff80003069628   r14: 0000000000000000
(XEN) r15: fffff80003069600   cr0: 000000008005003b   cr4: 00000000000006e0
(XEN) cr3: 00000000026a3000   cr2: 00000000002aab70
(XEN) fsb: 0000000800322830   gsb: ffffffff82014300   gss: 0000000000000000
(XEN) ds: 003b   es: 003b   fs: 0013   gs: 001b   ss: 0028   cs: 0020
(XEN) ----[ Xen-4.12.1  x86_64  debug=n   Tainted:  C   ]----
(XEN) CPU:    12
(XEN) RIP:    0020:[<ffffffff811f3624>]
(XEN) RFLAGS: 0000000000000087   CONTEXT: hvm guest (d0v0)
(XEN) rax: 0000000069cf48c9   rbx: 0000000000000000   rcx: 0000004fadbd25b9
(XEN) rdx: 000000000000004f   rsi: 0000004f69cccf55   rdi: 000000000007a120
(XEN) rbp: fffffe0025d117f0   rsp: fffffe0025d117b0   r8:  0000000000000001
(XEN) r9:  fffffe0025d11720   r10: 000000000000001f   r11: 0000000000000001
(XEN) r12: fffff80003257980   r13: 0000000000000001   r14: fffffe0025d11960
(XEN) r15: 0000000000000000   cr0: 000000008005003b   cr4: 00000000000006e0
(XEN) cr3: 00000000026a3000   cr2: 0000000800337fcc
(XEN) fsb: 00000008002398d0   gsb: ffffffff82012300   gss: 0000000000000000
(XEN) ds: 003b   es: 003b   fs: 0013   gs: 001b   ss: 0028   cs: 0020
(XEN) ----[ Xen-4.12.1  x86_64  debug=n   Tainted:  C   ]----
(XEN) CPU:    3
(XEN) RIP:    0020:[<ffffffff811eeb70>]
(XEN) RFLAGS: 0000000000000046   CONTEXT: hvm guest (d0v1)
(XEN) rax: 0000000000000000   rbx: 0000000000000001   rcx: 0000000000000000
(XEN) rdx: 0000000000000002   rsi: 0000000000000002   rdi: ffffffff82121e90
(XEN) rbp: fffffe0025c5f880   rsp: fffffe0025c5f870   r8:  0000001f9fdafdd5
(XEN) r9:  00000000000000fa   r10: 00000000000000fa   r11: 000000007fff3fa4
(XEN) r12: fffff80003257080   r13: 0000000000000001   r14: fffffe0025c5f9a0
(XEN) r15: 0000000000000000   cr0: 000000008005003b   cr4: 00000000000006e0
(XEN) cr3: 00000000026a3000   cr2: 00000008006a3000
(XEN) fsb: 000000080025a8d0   gsb: ffffffff82013300   gss: 0000000000000000
(XEN) ds: 003b   es: 003b   fs: 0013   gs: 001b   ss: 0028   cs: 0020
(XEN) ----[ Xen-4.12.1  x86_64  debug=n   Tainted:  C   ]----
(XEN) CPU:    4
(XEN) RIP:    0020:[<ffffffff811eeb72>]
(XEN) RFLAGS: 0000000000000046   CONTEXT: hvm guest (d0v3)
(XEN) rax: 0000000000000000   rbx: 0000000000000003   rcx: 0000000000000000
(XEN) rdx: 0000000000000008   rsi: 000000000000000a   rdi: ffffffff82122110
(XEN) rbp: fffffe0025c69880   rsp: fffffe0025c69870   r8:  0000001f9fdafce8
(XEN) r9:  00000000000000fa   r10: 00000000000000fa   r11: 000000007fff3fda
(XEN) r12: fffff80003255d80   r13: 0000000000000001   r14: fffffe0025c699a0
(XEN) r15: 0000000000000000   cr0: 000000008005003b   cr4: 00000000000006e0
(XEN) cr3: 00000000026a3000   cr2: 0000000800681000
(XEN) fsb: 000000080025a8d0   gsb: ffffffff82015300   gss: 0000000000000000
(XEN) ds: 003b   es: 003b   fs: 0013   gs: 001b   ss: 0028   cs: 0020
(XEN) Hardware Dom0 crashed: rebooting machine in 5 seconds.



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?201910142145.x9ELj4c8008732>