Skip site navigation (1)Skip section navigation (2)
Date:      Mon, 19 Nov 2007 16:32:14 +0300
From:      Alexey Popov <lol@chistydom.ru>
To:        freebsd-stable@freebsd.org
Subject:   2 x quad-core system is slower that 2 x dual core on FreeBSD
Message-ID:  <4741905E.8050300@chistydom.ru>

next in thread | raw e-mail | index | archive | help
This is a multi-part message in MIME format.
--------------060705080807060306020005
Content-Type: text/plain; charset=KOI8-R; format=flowed
Content-Transfer-Encoding: 7bit

Hi.

I have a large pool of web backends (Apache + mod_php5) with
2 x Xeon 3.2GHz processors and 2 x Xeon 5120 dual-core processors. The
workload is mostly CPU-bound. I'm using 6-STABLE-amd64 and also tried
7-STABLE.

Now I'm trying to use new hardware with 2 x Xeon 5320 (quad-core), but
it can not work under the same load as dual-core. It shows up to 80%
system CPU load in top:

last pid:  3850;  load averages: 22.51, 19.75, 12.18
                                                               up
0+02:41:41  15:54:40
71 processes:  25 running, 46 sleeping
CPU states:  9.5% user,  0.0% nice, 79.9% system,  1.2% interrupt,  9.5%
idle
Mem: 464M Active, 26M Inact, 75M Wired, 108K Cache, 51M Buf, 3323M Free
Swap: 2048M Total, 2048M Free

    PID USERNAME   THR PRI NICE   SIZE    RES STATE  C   TIME   WCPU COMMAND
   3729 www          1 118    0 99400K 50840K CPU4   1   1:55 23.24% httpd
   3751 www          1  -4    0 96312K 46380K RUN    0   1:53 22.85% httpd
   3732 www          1 118    0 96028K 47752K RUN    5   1:57 22.36% httpd
   3744 www          1  -4    0 96036K 47756K RUN    7   1:54 22.27% httpd
   3747 www          1  -4    0 96600K 48536K CPU5   1   1:53 22.07% httpd
   3734 www          1  -4    0 96360K 46388K RUN    7   1:57 22.02% httpd
   3758 www          1  -4    0 96004K 48208K CPU7   2   1:52 21.97% httpd
   3763 www          1  -4    0 94824K 46800K RUN    1   1:55 21.88% httpd
   3745 www          1  -4    0 97304K 47540K RUN    1   1:53 21.78% httpd
   3750 www          1  -4    0 98672K 49920K RUN    0   1:54 21.73% httpd
   3606 www          1  -4    0 96428K 48012K RUN    5   2:31 21.68% httpd
   3762 www          1  -4    0 96008K 47332K CPU1   1   1:54 21.63% httpd
   3757 www          1  -4    0 96368K 48020K RUN    0   1:53 21.48% httpd
   3730 www          1  -4    0 96648K 48096K CPU7   5   1:57 21.44% httpd
   3746 www          1  -4    0 96440K 48384K RUN    0   1:55 21.44% httpd
   3756 www          1  -4    0 95972K 46984K RUN    1   1:55 21.44% httpd
   3748 www          1 118    0 99756K 52056K select 6   1:55 21.39% httpd
   3743 www          1 117    0 98432K 49984K select 6   1:52 21.34% httpd
   3754 www          1  -4    0 98756K 50464K RUN    2   1:52 21.24% httpd
    731 www          1 117    0 99232K 51028K select 4   2:37 21.14% httpd
   3761 www          1 117    0 97384K 49136K RUN    0   1:53 21.14% httpd

Here's the output from 2xdual-core backend running under the same load
and with the same software:

last pid: 52086;  load averages:  3.84,  4.15,  4.11   up 42+01:14:01
16:06:10
45 processes:  8 running, 37 sleeping
CPU states:  0.0% user,  0.0% nice,  0.0% system,  0.0% interrupt,  0.0%
idle
Mem: 2264M Active, 704M Inact, 277M Wired, 181M Cache, 214M Buf, 384M Free
Swap: 2048M Total, 1412K Used, 2046M Free

    PID USERNAME   THR PRI NICE   SIZE    RES STATE  C   TIME   WCPU COMMAND
52067 www          1 111    0 96476K 46868K CPU2   0   0:19 40.45% httpd
52069 www          1 110    0    99M 51464K CPU3   0   0:13 37.62% httpd
52064 www          1   4    0 97168K 47636K sbwait 2   0:18 35.27% httpd
52078 www          1 112    0 96348K 45752K RUN    1   0:04 34.13% httpd
52083 www          1 112    0 96892K 42384K RUN    0   0:02 32.37% httpd
52058 www          1 108    0 96156K 47228K CPU0   2   0:21 32.32% httpd
52071 www          1 108    0    99M 50528K RUN    0   0:09 31.80% httpd
52074 www          1 111    0    99M 51180K select 1   0:07 29.35% httpd
    787 nobody       1   4    0  2079M  2077M kqread 1  20.7H  3.61%
memcached
    660 root         1  96    0 18120K  2108K select 0  25:17  0.00% snmpd
    795 root         6  20    0 14652K  2992K kserel 0  13:28  0.00%
bacula-fd

I tried Linux and it works much better than old (2 x dual-core)
backends. It handles 2 times more requests than FreeBSD on the old
backends. So there's a real scalability problem in FreeBSD. The more
processors it have the more CPU time it consumes.

Also I faced the same problem moving heavily loaded MySQL-server to new
hardware. That time I thought that the problem is in the mysql-server
itself and I had to install Linux.

See in attach: mutex statistics for quad-core system and dmesg and
vmstat for dual- and quad-core systems.

What can I do to make FreeBSD run faster on many-CPU systems???

With best regards,
Alexey Popov


--------------060705080807060306020005
Content-Type: text/plain;
 name="quad.txt"
Content-Transfer-Encoding: 7bit
Content-Disposition: inline;
 filename="quad.txt"

Copyright (c) 1992-2007 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 6.3-PRERELEASE #0: Mon Nov 19 12:50:10 MSK 2007
    llp@hydrogen.loadup.ru:/usr/obj/usr/src/sys/xxxSMP-amd64-HWPMC
module_register: module accf_http already exists!
Module accf_http failed to register: 17
module_register: module mfi_linux already exists!
Module mfi_linux failed to register: 17
ACPI APIC Table: <INTEL  S5000PAL>
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(R) CPU           E5320  @ 1.86GHz (1873.10-MHz K8-class CPU)
  Origin = "GenuineIntel"  Id = 0x6f7  Stepping = 7
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x4e3bd<SSE3,RSVD2,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA>
  AMD Features=0x20100800<SYSCALL,NX,LM>
  AMD Features2=0x1<LAHF>
  Cores per package: 4
real memory  = 5905580032 (5632 MB)
avail memory = 4096229376 (3906 MB)
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  1
 cpu2 (AP): APIC ID:  2
 cpu3 (AP): APIC ID:  3
 cpu4 (AP): APIC ID:  4
 cpu5 (AP): APIC ID:  5
 cpu6 (AP): APIC ID:  6
 cpu7 (AP): APIC ID:  7
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 24-47 on motherboard
lapic0: Forcing LINT1 to edge trigger
kbd1 at kbdmux0
module_register_init: MOD_LOAD (accf_http, 0xffffffff8033a0e0, 0xffffffff807a9720) error 17
acpi0: <INTEL S5000PAL> on motherboard
acpi0: Power Button (fixed)
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
acpi_hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 900
cpu0: <ACPI CPU> on acpi0
acpi_throttle0: <ACPI CPU Throttling> on cpu0
cpu1: <ACPI CPU> on acpi0
acpi_throttle1: <ACPI CPU Throttling> on cpu1
acpi_throttle1: failed to attach P_CNT
device_attach: acpi_throttle1 attach returned 6
cpu2: <ACPI CPU> on acpi0
acpi_throttle2: <ACPI CPU Throttling> on cpu2
acpi_throttle2: failed to attach P_CNT
device_attach: acpi_throttle2 attach returned 6
cpu3: <ACPI CPU> on acpi0
acpi_throttle3: <ACPI CPU Throttling> on cpu3
acpi_throttle3: failed to attach P_CNT
device_attach: acpi_throttle3 attach returned 6
cpu4: <ACPI CPU> on acpi0
acpi_throttle4: <ACPI CPU Throttling> on cpu4
acpi_throttle4: failed to attach P_CNT
device_attach: acpi_throttle4 attach returned 6
cpu5: <ACPI CPU> on acpi0
acpi_throttle5: <ACPI CPU Throttling> on cpu5
acpi_throttle5: failed to attach P_CNT
device_attach: acpi_throttle5 attach returned 6
cpu6: <ACPI CPU> on acpi0
acpi_throttle6: <ACPI CPU Throttling> on cpu6
acpi_throttle6: failed to attach P_CNT
device_attach: acpi_throttle6 attach returned 6
cpu7: <ACPI CPU> on acpi0
acpi_throttle7: <ACPI CPU Throttling> on cpu7
acpi_throttle7: failed to attach P_CNT
device_attach: acpi_throttle7 attach returned 6
acpi_button0: <Power Button> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xca2,0xca3,0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0
pci1: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> irq 16 at device 0.0 on pci1
pci2: <ACPI PCI bus> on pcib2
pcib3: <ACPI PCI-PCI bridge> irq 16 at device 0.0 on pci2
pci3: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> irq 16 at device 1.0 on pci2
pci4: <ACPI PCI bus> on pcib4
pcib5: <ACPI PCI-PCI bridge> irq 16 at device 2.0 on pci2
pci5: <ACPI PCI bus> on pcib5
em0: <Intel(R) PRO/1000 Network Connection Version - 6.7.2> port 0x2020-0x203f mem 0xb8820000-0xb883ffff,0xb8400000-0xb87fffff irq 18 at device 0.0 on pci5
em0: Ethernet address: 00:04:23:e1:30:ea
em1: <Intel(R) PRO/1000 Network Connection Version - 6.7.2> port 0x2000-0x201f mem 0xb8800000-0xb881ffff,0xb8000000-0xb83fffff irq 19 at device 0.1 on pci5
em1: Ethernet address: 00:04:23:e1:30:eb
pcib6: <ACPI PCI-PCI bridge> at device 0.3 on pci1
pci6: <ACPI PCI bus> on pcib6
pcib7: <PCI-PCI bridge> at device 3.0 on pci0
pci7: <PCI bus> on pcib7
pcib8: <ACPI PCI-PCI bridge> at device 4.0 on pci0
pci8: <ACPI PCI bus> on pcib8
pcib9: <ACPI PCI-PCI bridge> at device 5.0 on pci0
pci9: <ACPI PCI bus> on pcib9
pcib10: <ACPI PCI-PCI bridge> at device 6.0 on pci0
pci10: <ACPI PCI bus> on pcib10
pcib11: <PCI-PCI bridge> at device 0.0 on pci10
pci11: <PCI bus> on pcib11
mfi0: <LSI MegaSAS 1064R> mem 0xb8a00000-0xb8a0ffff,0xb8c00000-0xb8c1ffff irq 18 at device 14.0 on pci11
mfi0: Megaraid SAS driver Ver 2.00 
mfi0: 280 (248793038s/0x0020/0) - Shutdown command received from host
mfi0: 281 (4278190080s/0x0020/0) - PCI 0x041000 0x04411 0x041000 0x041004: Firmware initialization started (PCI ID 0411/1000/1004/1000)
mfi0: 282 (4278190080s/0x0020/0) - Type 18: Firmware version 1.03.60-0255
mfi0: 283 (4278190118s/0x0008/0) - Battery temperature is normal
mfi0: 284 (4278190118s/0x0008/0) - Battery Present
mfi0: 285 (4278190156s/0x0002/0) - PD 08(e0/s8) event: Inserted: PD 08(e0/s8)
mfi0: 286 (4278190156s/0x0002/0) - Type 29: Inserted: PD 08(e0/s8) Info: enclPd=ffff, scsiType=0, portMap=01, sasAddr=500000e016917972,0000000000000000
mfi0: 287 (4278190156s/0x0002/0) - PD 09(e0/s9) event: Inserted: PD 09(e0/s9)
mfi0: 288 (4278190156s/0x0002/0) - Type 29: Inserted: PD 09(e0/s9) Info: enclPd=ffff, scsiType=0, portMap=02, sasAddr=500000e016916272,0000000000000000
mfi0: 289 (248793151s/0x0020/0) - Adapter ticks 248793151 elapsed 77s: Time established as 11/19/07 13:12:31; (77 seconds since power on)
pcib12: <PCI-PCI bridge> at device 0.2 on pci10
pci12: <PCI bus> on pcib12
pcib13: <ACPI PCI-PCI bridge> at device 7.0 on pci0
pci13: <ACPI PCI bus> on pcib13
pci0: <base peripheral> at device 8.0 (no driver attached)
uhci0: <UHCI (generic) USB controller> port 0x3080-0x309f irq 23 at device 29.0 on pci0
uhci0: [GIANT-LOCKED]
usb0: <UHCI (generic) USB controller> on uhci0
usb0: USB revision 1.0
uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
uhci1: <UHCI (generic) USB controller> port 0x3060-0x307f irq 22 at device 29.1 on pci0
uhci1: [GIANT-LOCKED]
usb1: <UHCI (generic) USB controller> on uhci1
usb1: USB revision 1.0
uhub1: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub1: 2 ports with 2 removable, self powered
uhci2: <UHCI (generic) USB controller> port 0x3040-0x305f irq 23 at device 29.2 on pci0
uhci2: [GIANT-LOCKED]
usb2: <UHCI (generic) USB controller> on uhci2
usb2: USB revision 1.0
uhub2: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub2: 2 ports with 2 removable, self powered
uhci3: <UHCI (generic) USB controller> port 0x3020-0x303f irq 22 at device 29.3 on pci0
uhci3: [GIANT-LOCKED]
usb3: <UHCI (generic) USB controller> on uhci3
usb3: USB revision 1.0
uhub3: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub3: 2 ports with 2 removable, self powered
ehci0: <EHCI (generic) USB 2.0 controller> mem 0xb8d00400-0xb8d007ff irq 23 at device 29.7 on pci0
ehci0: [GIANT-LOCKED]
usb4: EHCI version 1.0
usb4: companion controllers, 2 ports each: usb0 usb1 usb2 usb3
usb4: <EHCI (generic) USB 2.0 controller> on ehci0
usb4: USB revision 2.0
uhub4: Intel EHCI root hub, class 9/0, rev 2.00/1.00, addr 1
uhub4: 8 ports with 8 removable, self powered
pcib14: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci14: <ACPI PCI bus> on pcib14
pci14: <display, VGA> at device 12.0 (no driver attached)
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel 63XXESB2 UDMA100 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x30b0-0x30bf irq 20 at device 31.1 on pci0
ata0: <ATA channel 0> on atapci0
ata1: <ATA channel 1> on atapci0
atapci1: <Intel 63XXESB2 SATA300 controller> port 0x30c8-0x30cf,0x30e4-0x30e7,0x30c0-0x30c7,0x30e0-0x30e3,0x30a0-0x30af mem 0xb8d00000-0xb8d003ff irq 20 at device 31.2 on pci0
ata2: <ATA channel 0> on atapci1
ata3: <ATA channel 1> on atapci1
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0: port may not be enabled
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
sio0: type 16550A, console
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc8fff,0xc9000-0xcdfff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounters tick every 1.000 msec
IP Filter: v4.1.28 initialized.  Default = pass all, Logging = enabled
ipfw2 initialized, divert enabled, rule-based forwarding disabled, default to accept, logging unlimited
acd0: DVDR <Optiarc DVD RW AD-7543A/1-00> at ata0-slave UDMA33
mfid0: <MFI Logical Disk> on mfi0
mfid0: 139236MB (285155328 sectors) RAID volume '' is optimal
lapic2: Forcing LINT1 to edge trigger
SMP: AP CPU #2 Launched!
lapic1: Forcing LINT1 to edge trigger
SMP: AP CPU #1 Launched!
lapic3: Forcing LINT1 to edge trigger
SMP: AP CPU #3 Launched!
lapic4: Forcing LINT1 to edge trigger
SMP: AP CPU #4 Launched!
lapic7: Forcing LINT1 to edge trigger
SMP: AP CPU #7 Launched!
lapic5: Forcing LINT1 to edge trigger
SMP: AP CPU #5 Launched!
lapic6: Forcing LINT1 to edge trigger
SMP: AP CPU #6 Launched!
Trying to mount root from ufs:/dev/mfid0s1a
em0: Hardware Initialization Failed
em0: Unable to initialize the hardware
em0: link state changed to UP

    1 users    Load 24.97 24.71 22.97                  Nov 19 16:25

Mem:KB    REAL            VIRTUAL                       VN PAGER   SWAP PAGER
        Tot   Share      Tot    Share    Free           in   out     in   out
Act  487264   19648   621692    33304 3400752  count
All  535596   20936  5003244    37628          pages
Proc:                                                            Interrupts
  r   p   d   s   w   Csw  Trp  Sys  Int  Sof  Flt        cow   16839 total
 27       1  39      137k 3390  33k 2490  313 2519   2519 zfod        sio0 irq4
                                                     2519 ozfod       ata0 irq14
78.0%Sys   1.1%Intr 13.1%User  0.0%Nice  7.8%Idle     100%ozfod   832 em0 mfi0 1
|    |    |    |    |    |    |    |    |    |    |       daefr       uhci0 uhci
=======================================+>>>>>>            prcfr  1999 cpu0: time
                                        37 dtbuf     2979 totfr  2000 cpu2: time
Namei     Name-cache   Dir-cache    100000 desvn          react  2000 cpu1: time
   Calls    hits   %    hits   %      5491 numvn          pdwak  2000 cpu3: time
   51775   51775 100                  3686 frevn          pdpgs  2002 cpu4: time
                                                          intrn  2002 cpu7: time
Disks mfid0                                         80080 wire   2002 cpu5: time
KB/t   0.00                                        472368 act    2002 cpu6: time
tps       0                                         26720 inact
MB/s   0.00                                           108 cache
%busy     0                                       3400644 free
                                                    59296 buf



debug.mutex.prof.stats: 
   max        total       count   avg     cnt_hold     cnt_lock name
 14830     12696030     1840283     6       622811       981441 /usr/src/sys/kern/kern_lock.c:168 (lockbuilder mtxpool)
  1152        67642       25424     2            0            0 /usr/src/sys/kern/kern_descrip.c:1962 (filedesc structure)
  2343      1526816      557240     2        13043       481687 /usr/src/sys/kern/vfs_subr.c:1997 (vnode interlock)
  1285        71570       25363     2            1            1 /usr/src/sys/kern/kern_descrip.c:1983 (sleep mtxpool)
   328      7238962     2175947     3      6165708      7064072 /usr/src/sys/kern/kern_synch.c:220 (lockbuilder mtxpool)
  1209        71686       25363     2            0            0 /usr/src/sys/kern/kern_descrip.c:1984 (filedesc structure)
  1553      2069549      806581     2       555036       175103 /usr/src/sys/kern/kern_lock.c:532 (lockbuilder mtxpool)
 14836     10286955      769265    13        36020        28870 /usr/src/sys/kern/vfs_subr.c:2119 (vnode interlock)
   272        51743       23159     2           19           62 /usr/src/sys/kern/kern_conf.c:61 (cdev)
  4189      8785941      350672    25        36714        13130 /usr/src/sys/kern/vfs_subr.c:2236 (vnode interlock)
    11          100          28     3            0            2 /usr/src/sys/kern/tty.c:2093 (process lock)
  3630       270809      103261     2          688         2045 /usr/src/sys/ufs/ufs/ufs_vnops.c:133 (vnode interlock)
   243        22329        2023    11           48         9491 /usr/src/sys/kern/sys_generic.c:1147 (sellck)
  2185       278665      102786     2         1002          450 /usr/src/sys/ufs/ufs/ufs_vnops.c:408 (vnode interlock)
   200         2425          38    63            4         2750 /usr/src/sys/kern/kern_conf.c:329 (Giant)
   353       326270      104708     3         3037        24148 /usr/src/sys/kern/vfs_mount.c:438 (struct mount mtx)
  2529       228837       81898     2            0            3 /usr/src/sys/kern/kern_descrip.c:2112 (sleep mtxpool)
  2307      1583215      257982     6        13461        23127 /usr/src/sys/kern/vfs_vnops.c:806 (vnode interlock)
 24007       185216         346   535          161           23 /usr/src/sys/kern/kern_sysctl.c:1313 (Giant)
   851        67462       24917     2            0            0 /usr/src/sys/kern/kern_descrip.c:1376 (filedesc structure)
  1316        69326       24925     2            2          169 /usr/src/sys/kern/kern_descrip.c:1268 (process lock)
  1420        77550       24917     3            0            0 /usr/src/sys/kern/kern_descrip.c:1391 (filedesc structure)
   516        66280       24783     2            0            0 /usr/src/sys/kern/vfs_syscalls.c:1007 (filedesc structure)
 11467        81199       24783     3            0            0 /usr/src/sys/kern/vfs_syscalls.c:1015 (filedesc structure)
  5259       308813      107752     2            0            0 /usr/src/sys/kern/vfs_lookup.c:188 (filedesc structure)
   599      2618267      455837     5        40555       177047 /usr/src/sys/kern/vfs_cache.c:356 (Name Cache)
  1474      4246486      452087     9         9871        85861 /usr/src/sys/kern/vfs_cache.c:457 (vnode interlock)
  2544       847434      317780     2        27777       152916 /usr/src/sys/kern/vfs_subr.c:2020 (vnode interlock)
  1888       305492      107752     2            0            0 /usr/src/sys/kern/vfs_lookup.c:195 (filedesc structure)
   437       277687      105799     2        11707        18106 /usr/src/sys/kern/vfs_subr.c:2060 (vnode interlock)
    63         1325         150     8           14            3 /usr/src/sys/kern/kern_condvar.c:189 (sellck)
    13         8322        2322     3            0            0 /usr/src/sys/kern/sys_generic.c:849 (filedesc structure)
   451         9400        2670     3           26           39 /usr/src/sys/kern/sys_generic.c:1099 (sellck)
  1146        41574        5704     7           62          169 /usr/src/sys/kern/uipc_socket.c:2049 (so_rcv)
  1155        89277        5704    15           34           19 /usr/src/sys/kern/uipc_socket.c:2048 (so_snd)
     5           27           8     3            0            0 /usr/src/sys/kern/kern_exit.c:139 (process lock)
    11           31           8     3            0            0 /usr/src/sys/kern/kern_exit.c:212 (p_peers)
   357         4300         493     8            0           46 /usr/src/sys/kern/sys_pipe.c:1345 (pipe mutex)
   376       567533      104712     5         3856         3057 /usr/src/sys/kern/vfs_subr.c:343 (struct mount mtx)
     8          103          16     6            0            0 /usr/src/sys/kern/subr_eventhandler.c:212 (eventhandler)
     8           55           9     6            0            0 /usr/src/sys/kern/subr_eventhandler.c:215 (process_exit)
    46         1333         121    11            5            9 /usr/src/sys/kern/kern_conf.c:341 (Giant)
     4           23           8     2            0            0 /usr/src/sys/kern/sysv_sem.c:1268 (sem)
     4           46          16     2            0            0 /usr/src/sys/kern/kern_exit.c:230 (process_exit)
   216         8050        2322     3            0            0 /usr/src/sys/kern/sys_generic.c:872 (filedesc structure)
     8           49           8     6            0            0 /usr/src/sys/fs/pseudofs/pseudofs_vncache.c:286 (pfs_vncache)
   116        24710        2322    10          807          784 /usr/src/sys/kern/sys_generic.c:771 (sellck)
    17          110           8    13            0            0 /usr/src/sys/fs/pseudofs/pseudofs_vncache.c:285 (Giant)
 11973       107437       33819     3            0            0 /usr/src/sys/kern/kern_descrip.c:994 (filedesc structure)
  2774       117520       37693     3            0           13 /usr/src/sys/kern/kern_sig.c:641 (process lock)
  1819      3983950      104533    38         7818        38206 /usr/src/sys/kern/vfs_hash.c:71 (vfs hash)
  2753        64202       22718     2            0            0 /usr/src/sys/kern/kern_descrip.c:1021 (filedesc structure)
     5           25           8     3            0            0 /usr/src/sys/kern/kern_exit.c:238 (process lock)
     5           24           8     3            0            0 /usr/src/sys/kern/kern_descrip.c:1639 (filedesc structure)
  1035      4256701      104533    40        78201        60906 /usr/src/sys/kern/vfs_hash.c:79 (vnode interlock)
   365        63008       22698     2          953         1293 /usr/src/sys/kern/vfs_mount.c:429 (struct mount mtx)
   475        62166       22651     2         1384          496 /usr/src/sys/kern/vfs_vnops.c:902 (struct mount mtx)
     5           22           8     2            0            0 /usr/src/sys/kern/kern_descrip.c:1653 (filedesc structure)
    10          448         127     3            0            0 /usr/src/sys/kern/kern_event.c:1643 (tty)
   833        60258       22565     2            1            8 /usr/src/sys/ufs/ufs/ufs_vnops.c:282 (vnode interlock)
   912         1536          44    34            1            2 /usr/src/sys/kern/kern_conf.c:317 (Giant)
     5           23           8     2            0            0 /usr/src/sys/kern/kern_descrip.c:1656 (fdesc)
     5           23           8     2            0            0 /usr/src/sys/kern/kern_descrip.c:1673 (filedesc structure)
     5           24           8     3            0            0 /usr/src/sys/kern/kern_descrip.c:1454 (fdesc)
   371        58195       22651     2          875         1016 /usr/src/sys/kern/vfs_vnops.c:1045 (struct mount mtx)
   192         7020        2283     3            0            0 /usr/src/sys/kern/sys_generic.c:698 (filedesc structure)
     5           23           8     2            0            0 /usr/src/sys/kern/kern_exit.c:285 (p_peers)
   502        20605        2283     9         1172          923 /usr/src/sys/kern/sys_generic.c:762 (sellck)
   101        98352       10938     8            0           19 /usr/src/sys/dev/em/if_em.c:1464 (em0)
    26        26048        7350     3          370          726 /usr/src/sys/net/if.c:2329 (ip_inq)
   480         2053           9   228            0            0 /usr/src/sys/amd64/amd64/pmap.c:2748 (pmap)
    94        44497       10927     4          148          658 /usr/src/sys/dev/em/if_em.c:1492 (em0)
   488         2124           9   236            4       107126 /usr/src/sys/amd64/amd64/pmap.c:2747 (vm page queue mutex)
    47        85817        7350    11            2            1 /usr/src/sys/dev/em/if_em.c:4546 (em0)
    99        10733         828    12            0            5 /usr/src/sys/vm/vm_map.c:2297 (vm object)
    25        41183       12051     3          282          384 /usr/src/sys/net/netisr.c:233 (ip_inq)
  1138        57777       18145     3            0            0 /usr/src/sys/vm/vm_object.c:446 (vm object)
   360        44497       13232     3           59          196 /usr/src/sys/net/pfil.c:63 (pfil_head_mtx)
   297        42979       13232     3           33          154 /usr/src/sys/netinet/ip_fw2.c:156 (IPFW static rules)
  1137        45016       13232     3           48           35 /usr/src/sys/netinet/ip_fw2.c:164 (IPFW static rules)
     5          268          92     2            0            6 /usr/src/sys/vm/vm_object.c:572 (vm object)
   122          730         135     5            2            3 /usr/src/sys/vm/vm_object.c:646 (vm page queue mutex)
   183        42700       13228     3            0            0 /usr/src/sys/contrib/ipfilter/netinet/fil.c:2255 (ipf cache rwlock)
     6          413         135     3            0          391 /usr/src/sys/vm/vm_object.c:669 (vm object_list)
   173        23927        7835     3            0            0 /usr/src/sys/contrib/ipfilter/netinet/fil.c:2282 (ipf cache rwlock)
   975       201344       13228    15            0            0 /usr/src/sys/contrib/ipfilter/netinet/fil.c:2562 (ipf filter rwlock)
   982       307062       13228    23          639          954 /usr/src/sys/contrib/ipfilter/netinet/fil.c:2432 (ipf filter load/unload mutex)
    62         7689        2507     3            0           37 /usr/src/sys/kern/uipc_socket.c:668 (so_snd)
    36        42097       13232     3           43           60 /usr/src/sys/net/pfil.c:71 (pfil_head_mtx)
    26        86698       27094     3            0            0 /usr/src/sys/netinet/ip_dummynet.c:743 (dummynet)
    11         9540        3060     3            0            0 /usr/src/sys/kern/uipc_socket2.c:770 (so_snd)
    94         6937         320    21            8           14 /usr/src/sys/vm/vm_object.c:1809 (vm page queue mutex)
   760        41669        3060    13           38         1025 /usr/src/sys/netinet/tcp_usrreq.c:630 (tcp)
   463        46791       13301     3           15           33 /usr/src/sys/netinet/tcp_output.c:253 (so_snd)
    25        10126        2874     3            2            4 /usr/src/sys/netinet/tcp_input.c:2145 (so_snd)
  1198        52186        7374     7            7           54 /usr/src/sys/net/route.c:147 (radix node head)
   458        52801        7374     7           30          158 /usr/src/sys/net/route.c:197 (rtentry)
   252        35852        2510    14            3           14 /usr/src/sys/netinet/tcp_input.c:2375 (so_rcv)
   282       220788        6888    32          190          100 /usr/src/sys/netinet/tcp_input.c:625 (tcp)
   545       453792        6888    65          701          672 /usr/src/sys/netinet/tcp_input.c:752 (inp)
    96        39388        6315     6           35           30 /usr/src/sys/net/route.c:1265 (rtentry)
  2461        49157        6315     7            1            4 /usr/src/sys/net/route.c:1281 (rtentry)
    72        19734        6315     3            3           36 /usr/src/sys/net/if_ethersubr.c:409 (em0)
     5           10           2     5            0            0 /usr/src/sys/kern/kern_proc.c:551 (process lock)
    48        18573        6315     2            0           10 /usr/src/sys/dev/em/if_em.c:943 (em0)
    19           46           4    11            0            0 /usr/src/sys/kern/kern_proc.c:473 (process group)
  1896        73387        6618    11          586          454 /usr/src/sys/dev/em/if_em.c:974 (em0)
    32           88           8    11            0            1 /usr/src/sys/kern/kern_exit.c:297 (Giant)
   524        20223        6315     3           27           51 /usr/src/sys/netinet/ip_output.c:835 (rtentry)
  2661       396213        3060   129            0          578 /usr/src/sys/netinet/tcp_usrreq.c:647 (inp)
     5           23           8     2            0            0 /usr/src/sys/kern/kern_exit.c:365 (ktrace)
   130         7625        2502     3            0            0 /usr/src/sys/kern/uipc_socket.c:864 (so_snd)
    23           84           8    10            0            0 /usr/src/sys/kern/kern_exit.c:364 (process lock)
     5          205          78     2            0            0 /usr/src/sys/kern/vfs_subr.c:2090 (vnode interlock)
     5          177          60     2            1            0 /usr/src/sys/kern/vfs_vnops.c:1008 (struct mount mtx)
   216         2641         374     7            0            3 /usr/src/sys/kern/vfs_bio.c:2387 (vnode interlock)
    24         2411         373     6            4            1 /usr/src/sys/sys/buf.h:292 (lockbuilder mtxpool)
     7          218          63     3            0          225 /usr/src/sys/ufs/ffs/ffs_softdep.c:4887 (Softdep Lock)
    19          388          57     6            2            2 /usr/src/sys/kern/vfs_subr.c:1818 (vnode interlock)
     6          497         162     3            0            3 /usr/src/sys/kern/vfs_bio.c:421 (buffer daemon lock)
    10          583         183     3            2            6 /usr/src/sys/kern/vfs_bio.c:2259 (vm object)
     8          535         145     3            2            3 /usr/src/sys/kern/vfs_bio.c:3403 (vm page queue mutex)
    26         1546         145    10            0            0 /usr/src/sys/kern/vfs_bio.c:3402 (vm object)
   476         1981         494     4            4            9 /usr/src/sys/kern/kern_lock.c:556 (lockbuilder mtxpool)
   352        14144        3973     3            0            0 /usr/src/sys/kern/subr_sleepqueue.c:391 (sigacts)
    50         3218         411     7            0          114 /usr/src/sys/kern/vfs_bio.c:1421 (buf queue lock)
   450        68483        3973    17            5           10 /usr/src/sys/kern/subr_sleepqueue.c:389 (process lock)
     5          182          60     3            0            0 /usr/src/sys/kern/vfs_vnops.c:1067 (struct mount mtx)
    12           36           8     4            0            0 /usr/src/sys/kern/kern_exit.c:394 (process lock)
     6           25           8     3            0            0 /usr/src/sys/kern/kern_resource.c:932 (sleep mtxpool)
     5           30           8     3            0            0 /usr/src/sys/kern/kern_exit.c:468 (sigacts)
     5          134          40     3            0            0 /usr/src/sys/kern/kern_sig.c:1719 (sigacts)
    41          230           8    28            0           11 /usr/src/sys/kern/kern_exit.c:467 (process lock)
    57          314           8    39            0            0 /usr/src/sys/kern/kern_exit.c:444 (process lock)
    85        11508        2415     4          254          300 /usr/src/sys/netinet/tcp_input.c:1303 (so_rcv)
   274        55363       22570     2            0          401 /usr/src/sys/vm/vnode_pager.c:131 (vm object)
   211        60598       24777     2            0            0 /usr/src/sys/kern/vfs_syscalls.c:1017 (filedesc structure)
   282        59815       24777     2            0            0 /usr/src/sys/kern/vfs_syscalls.c:1019 (filedesc structure)
   250        55202       22576     2            1           23 /usr/src/sys/kern/vfs_syscalls.c:1062 (sleep mtxpool)
  1323       189186       22576     8            0            0 /usr/src/sys/kern/vfs_syscalls.c:1061 (filedesc structure)
  1451        61760       22836     2            0           10 /usr/src/sys/kern/kern_prot.c:92 (process lock)
  1143        65390       23912     2            0            0 /usr/src/sys/kern/vfs_cache.c:720 (filedesc structure)
   233        72388       23912     3         2150         3714 /usr/src/sys/kern/vfs_cache.c:801 (Name Cache)
  1140        69010       23912     2            0            0 /usr/src/sys/kern/vfs_cache.c:723 (filedesc structure)
  4278       609427       23912    25          755          595 /usr/src/sys/kern/vfs_cache.c:719 (Giant)
  1016        34871        3676     9         1409          773 /usr/src/sys/kern/kern_condvar.c:301 (sellck)
   705        18904        5013     3            0            0 /usr/src/sys/kern/sys_generic.c:1019 (filedesc structure)
  1970        22990        5013     4            0            0 /usr/src/sys/kern/sys_generic.c:1043 (filedesc structure)
  3820        68563        5013    13           67           93 /usr/src/sys/kern/sys_generic.c:951 (sellck)
    17          255          31     8            0            0 /usr/src/sys/kern/subr_trap.c:268 (sigacts)
    74          572          31    18            0            0 /usr/src/sys/kern/subr_trap.c:267 (process lock)
   487        22678        6407     3            2            1 /usr/src/sys/kern/uipc_syscalls.c:128 (sleep mtxpool)
    11          116          31     3            0            0 /usr/src/sys/amd64/amd64/machdep.c:335 (sigacts)
   537        73109        6409    11            0            0 /usr/src/sys/kern/uipc_syscalls.c:120 (filedesc structure)
    19          344          31    11            0            0 /usr/src/sys/amd64/amd64/machdep.c:334 (process lock)
   309        16717        4650     3          107           77 /usr/src/sys/kern/uipc_socket.c:1018 (so_rcv)
   119         6216         894     6            4           35 /usr/src/sys/kern/kern_exit.c:598 (process lock)
  1318        26635        6040     4           77          139 /usr/src/sys/kern/uipc_socket.c:1265 (so_rcv)
  2446       249683        8954    27          780          853 /usr/src/sys/netinet/tcp_usrreq.c:599 (tcp)
    37        14088        4481     3           49            1 /usr/src/sys/kern/uipc_socket.c:1423 (so_rcv)
   232        11614        3381     3            1           14 /usr/src/sys/kern/sys_generic.c:911 (process lock)
  1469        31754        3381     9           19           26 /usr/src/sys/kern/sys_generic.c:942 (sellck)
    11           46           8     5            0            0 /usr/src/sys/kern/kern_proc.c:423 (process lock)
    17          110           8    13            0            0 /usr/src/sys/kern/kern_proc.c:422 (process group)
    29          172           8    21            0            1 /usr/src/sys/kern/kern_proc.c:421 (Giant)
     4           12           4     3            0            0 /usr/src/sys/kern/kern_proc.c:571 (session)
    18           51           4    12            0            0 /usr/src/sys/kern/kern_proc.c:454 (process group)
    29           88           4    22            0            0 /usr/src/sys/kern/kern_proc.c:453 (Giant)
     5           25           8     3            0            0 /usr/src/sys/kern/kern_exit.c:680 (process lock)
     5           25           8     3            0            0 /usr/src/sys/kern/kern_exit.c:683 (process lock)
     5           32          14     2            0           41 /usr/src/sys/kern/kern_resource.c:1149 (sleep mtxpool)
    12           64          17     3            0            0 /usr/src/sys/kern/kern_proc.c:1152 (struct pargs.ref)
    12          121          31     3            0            0 /usr/src/sys/amd64/amd64/machdep.c:426 (process lock)
     7           41          10     4            0            0 /usr/src/sys/kern/tty.c:850 (process lock)
     5           15           4     3            0            0 /usr/src/sys/kern/kern_proc.c:260 (process group)
  1173         1510          38    39            1            0 /usr/src/sys/kern/kern_conf.c:305 (Giant)
    20         1260         388     3            0            0 /usr/src/sys/vm/uma_core.c:2349 (mbuf)
    22         8389        2712     3            0            0 /usr/src/sys/nfsserver/nfs_srvsock.c:813 (nfsd_mtx)
    24         8009        2712     2           13           41 /usr/src/sys/netinet/tcp_subr.c:1483 (tcp)
     6           57          14     4            0            0 /usr/src/sys/kern/kern_time.c:581 (process lock)
    64         1914         612     3            0           18 /usr/src/sys/vm/vm_unix.c:81 (process lock)
    10         1028         343     2            0            6 /usr/src/sys/vm/vm_object.c:1874 (vm object)
    11          549         199     2            0            0 /usr/src/sys/vm/vm_mmap.c:274 (process lock)
   165          843         227     3            0            0 /usr/src/sys/vm/vm_mmap.c:1261 (process lock)
   109        50814       16766     3            0            6 /usr/src/sys/amd64/amd64/trap.c:552 (process lock)
    10          350         111     3            0            0 /usr/src/sys/vm/vm_object.c:229 (vm object_list)
   140        50738       17036     2          269          295 /usr/src/sys/vm/vm_fault.c:854 (vm page queue mutex)
  3163       202962       17181    11            0         3605 /usr/src/sys/vm/vm_fault.c:297 (vm object)
   950       110673       17181     6          372          372 /usr/src/sys/amd64/amd64/pmap.c:2054 (vm page queue mutex)
   957       122361       17181     7            0            0 /usr/src/sys/amd64/amd64/pmap.c:2055 (pmap)
  1112       120548       39135     3            0            0 /usr/src/sys/amd64/amd64/pmap.c:2856 (pmap)
  2069        90833       17789     5            0            0 /usr/src/sys/vm/vm_fault.c:989 (vm object)
   793        53945       17181     3          215          211 /usr/src/sys/vm/vm_fault.c:912 (vm page queue mutex)
   849       171876       17181    10            0            0 /usr/src/sys/vm/vm_fault.c:911 (vm object)
  1439        55321       17181     3            1            2 /usr/src/sys/vm/vm_fault.c:934 (process lock)
  1334        54611       16766     3            0            1 /usr/src/sys/amd64/amd64/trap.c:561 (process lock)
    15         4925         830     5            2           14 /usr/src/sys/netinet/tcp_timer.c:139 (tcp)
   256       103420         830   124            0           23 /usr/src/sys/netinet/tcp_timer.c:145 (inp)
    91        11925         504    23           16            6 /usr/src/sys/amd64/amd64/pmap.c:1755 (vm page queue mutex)
    92        12410         504    24            0            0 /usr/src/sys/amd64/amd64/pmap.c:1756 (pmap)
    14         1353         370     3            0            4 /usr/src/sys/vm/uma_core.c:1888 (mbuf)
    55          854          60    14            2            3 /usr/src/sys/netinet/tcp_input.c:373 (so_rcv)
   105        13067        1649     7           41           43 /usr/src/sys/kern/kern_timeout.c:258 (Giant)
   295        11605        3929     2            9           23 /usr/src/sys/kern/kern_resource.c:1075 (sleep mtxpool)
    22         2541         873     2            0           17 /usr/src/sys/kern/vfs_subr.c:2941 (vnode_free_list)
    91         2578         872     2            0            0 /usr/src/sys/kern/vfs_subr.c:2913 (vnode_free_list)
    53        10898        3931     2            7            7 /usr/src/sys/kern/kern_resource.c:1101 (sleep mtxpool)
    17          492         181     2            0            0 /usr/src/sys/kern/vfs_syscalls.c:787 (filedesc structure)
   448         4343         894     4            0            0 /usr/src/sys/kern/kern_sig.c:297 (sigacts)
   453        10221         894    11            0            0 /usr/src/sys/kern/kern_sig.c:295 (process lock)
   245         7085        1081     6           29         2370 /usr/src/sys/geom/geom_io.c:67 (bio queue)
    49         2184          56    39            0            0 /usr/src/sys/dev/random/yarrow.c:193 (random reseed)
    13         1307         429     3            0            0 /usr/src/sys/vm/vm_object.c:357 (vm object)
     8          202          60     3            0            0 /usr/src/sys/ufs/ffs/ffs_vnops.c:675 (process lock)
    10          204          60     3            0            2 /usr/src/sys/vm/vnode_pager.c:382 (vm object)
    62          912         120     7            0            0 /usr/src/sys/kern/kern_resource.c:855 (process lock)
     5          171          63     2            0            0 /usr/src/sys/kern/uipc_socket2.c:324 (so_snd)
   229        12029         128    93            2            1 /usr/src/sys/netinet/tcp_usrreq.c:580 (inp)
    14          302         100     3            0            1 /usr/src/sys/kern/uipc_socket2.c:192 (so_rcv)
    33          430         100     4            0            0 /usr/src/sys/kern/uipc_socket2.c:197 (so_snd)
     5          119          41     2            0            0 /usr/src/sys/netinet/in_pcb.c:708 (so_rcv)
    15          376          41     9            0            2 /usr/src/sys/netinet/in_pcb.c:707 (accept)
    16           54           5    10            0            0 /usr/src/sys/kern/sys_socket.c:121 (process lock)
    13          931         271     3            0            0 /usr/src/sys/geom/geom_event.c:185 (GEOM orphanage)
    12          914         271     3            0            0 /usr/src/sys/geom/geom_event.c:199 (GEOM orphanage)
     6           80          28     2            0            0 /usr/src/sys/net/if.c:1214 (ifnet)
    11          154          55     2            0            0 /usr/src/sys/contrib/ipfilter/netinet/fil.c:6587 (ipf token rwlock)
    12          153          55     2            0            0 /usr/src/sys/contrib/ipfilter/netinet/ip_frag.c:786 (ipf fragment rwlock)
     5          158          55     2            0            0 /usr/src/sys/contrib/ipfilter/netinet/ip_frag.c:799 (ipf IP NAT-Frag rwlock)
     6          245          55     4            0            0 /usr/src/sys/contrib/ipfilter/netinet/ip_state.c:3057 (ipf IP state rwlock)
     6          217          55     3            0            0 /usr/src/sys/contrib/ipfilter/netinet/ip_nat.c:4464 (ipf IP NAT rwlock)
     5          212          55     3            0            0 /usr/src/sys/contrib/ipfilter/netinet/ip_auth.c:563 (ipf IP User-Auth rwlock)
    78         2626          55    47            0            1 /usr/src/sys/contrib/ipfilter/netinet/ip_frag.c:855 (ipf filter load/unload mutex)
    61          471         142     3            0            0 /usr/src/sys/kern/kern_descrip.c:748 (sigio lock)
     5          319         113     2            0            0 /usr/src/sys/kern/uipc_socket.c:488 (so_rcv)
    61         1087         113     9            0            0 /usr/src/sys/kern/uipc_socket.c:487 (accept)
     5          316         113     2            0            0 /usr/src/sys/kern/uipc_socket.c:400 (so_snd)
    13         1656         610     2            2            0 /usr/src/sys/kern/kern_resource.c:1174 (sleep mtxpool)
    89         1174         113    10            0            0 /usr/src/sys/kern/uipc_socket.c:409 (so_snd)
   688         1042         123     8            0            0 /usr/src/sys/kern/uipc_socket.c:1477 (so_rcv)
    13          369         123     3            0            0 /usr/src/sys/kern/uipc_socket.c:1486 (so_rcv)
    21         1143         123     9            0            0 /usr/src/sys/kern/uipc_socket2.c:581 (so_rcv)
     5          315         113     2            0            2 /usr/src/sys/kern/uipc_socket.c:253 (so_glabel)
    10          324         113     2            0            0 /usr/src/sys/kern/uipc_socket.c:274 (so_glabel)
     7          237          65     3            0            1 /usr/src/sys/kern/sys_pipe.c:591 (pipe mutex)
    10          172          60     2            0            0 /usr/src/sys/kern/kern_descrip.c:2214 (sleep mtxpool)
    20         1490         120    12            0            6 /usr/src/sys/kern/kern_descrip.c:2193 (Giant)
     5          172          61     2            0            0 /usr/src/sys/kern/kern_descrip.c:2086 (so_rcv)
     5          176          61     2            0            0 /usr/src/sys/kern/kern_descrip.c:2090 (filedesc structure)
    11          179          61     2            0            0 /usr/src/sys/kern/uipc_syscalls.c:367 (so_rcv)
    19          599          61     9            0            0 /usr/src/sys/kern/uipc_syscalls.c:334 (accept)
     7          154          61     2            0            0 /usr/src/sys/kern/kern_descrip.c:951 (sigio lock)
     5          160          61     2            0            0 /usr/src/sys/kern/uipc_syscalls.c:389 (sleep mtxpool)
    11          762         277     2            0            0 /usr/src/sys/kern/sys_socket.c:144 (so_rcv)
    11          777         279     2            0            0 /usr/src/sys/kern/sys_socket.c:170 (so_rcv)
     6          777         279     2            0            0 /usr/src/sys/kern/sys_socket.c:173 (so_rcv)
    46          841         279     3            0            0 /usr/src/sys/kern/sys_socket.c:176 (so_snd)
     5          173          61     2            0            0 /usr/src/sys/kern/uipc_socket.c:524 (so_rcv)
    13          350          61     5            1            2 /usr/src/sys/netinet/tcp_usrreq.c:466 (tcp)
    15          384          61     6            0            0 /usr/src/sys/netinet/tcp_usrreq.c:472 (inp)
     5          153          61     2            0            0 /usr/src/sys/kern/kern_descrip.c:2104 (so_rcv)
    15          529          61     8            0            0 /usr/src/sys/kern/kern_descrip.c:2103 (accept)
    12          162          60     2            0            0 /usr/src/sys/kern/kern_descrip.c:2200 (sleep mtxpool)
     6          169          55     3            0            0 /usr/src/sys/netinet/ip_input.c:1215 (ipqlock)
   106         2119          55    38            1            0 /usr/src/sys/netinet/tcp_timer.c:115 (tcp)
     5          143          55     2            0            0 /usr/src/sys/netinet/igmp.c:443 (igmp_mtx)
    16          171          28     6            0            1 /usr/src/sys/kern/vfs_subr.c:1641 (Syncer mtx)
    11           82          28     2            0            0 /usr/src/sys/kern/vfs_subr.c:1717 (Syncer mtx)
 28832        48031          94   510           31            2 /usr/src/sys/kern/kern_synch.c:218 (Giant)
     6          372         131     2            0            0 /usr/src/sys/kern/uipc_socket2.c:346 (so_rcv)
    24          640         187     3            0            0 /usr/src/sys/netinet/tcp_hostcache.c:291 (tcp_hc_entry)
     5          184          66     2            0            0 /usr/src/sys/netinet/tcp_subr.c:1792 (so_rcv)
    20          616          66     9            0            0 /usr/src/sys/netinet/tcp_subr.c:1791 (accept)
    20         2261         368     6            4          360 /usr/src/sys/vm/vnode_pager.c:1199 (vm object)
   286         4186        1274     3           21           25 /usr/src/sys/vm/vm_fault.c:346 (vm page queue mutex)
    11          811         246     3            1            8 /usr/src/sys/vm/vm_fault.c:136 (vm page queue mutex)
   308         7178         314    22            2            3 /usr/src/sys/vm/vm_fault.c:688 (vm object)
    32         2582         246    10            0            0 /usr/src/sys/vm/vm_fault.c:792 (vm object)
    32         1000         120     8            0            0 /usr/src/sys/vm/vm_fault.c:996 (vm object)
     5           20           6     3            0            0 /usr/src/sys/vm/vm_pageout.c:1511 (vm page queue mutex)
    24          238          81     2            0            0 /usr/src/sys/kern/kern_kthread.c:181 (process lock)
     9          170          27     6            0            0 /usr/src/sys/kern/vfs_bio.c:2040 (buffer daemon lock)
    15          195          27     7            0            0 /usr/src/sys/kern/vfs_subr.c:719 (vnode_free_list)
    14         1138         264     4            0            0 /usr/src/sys/kern/vfs_subr.c:1977 (vnode interlock)
    10          493         185     2            0            0 /usr/src/sys/vm/vnode_pager.c:229 (vm object)
    10          498         195     2            0            0 /usr/src/sys/vm/vm_map.c:986 (vm object)
    21         1236         192     6            0            0 /usr/src/sys/amd64/amd64/pmap.c:2233 (pmap)
    34         2708         192    14            3            4 /usr/src/sys/vm/vm_map.c:1528 (vm page queue mutex)
    41         3977         195    20            0            0 /usr/src/sys/vm/vm_map.c:1472 (vm object)
     5          427         152     2            0            0 /usr/src/sys/netinet/tcp_subr.c:1649 (rtentry)
    22          175          60     2            0            0 /usr/src/sys/kern/uipc_socket2.c:222 (accept)
     7          280         108     2            0            0 /usr/src/sys/kern/uipc_socket.c:167 (so_glabel)
     5          585         216     2            0            0 /usr/src/sys/kern/uipc_socket2.c:529 (process lock)
    51         2961         108    27            0            0 /usr/src/sys/kern/uipc_socket2.c:468 (so_rcv)
    60         3576         108    33            0            0 /usr/src/sys/kern/uipc_socket2.c:467 (so_snd)
    31          505         102     4            0            0 /usr/src/sys/netinet/in_pcb.c:217 (inp)
     5          155          60     2            0            0 /usr/src/sys/kern/uipc_socket2.c:262 (accept)
    16          664          76     8            0            0 /usr/src/sys/netinet/tcp_input.c:2975 (so_snd)
    17          647          76     8            0            0 /usr/src/sys/netinet/tcp_input.c:2992 (so_rcv)
   112         3597          60    59            0            0 /usr/src/sys/netinet/tcp_syncache.c:564 (inp)
   548         1815         161    11            0            0 /usr/src/sys/kern/uipc_socket2.c:127 (accept)
    13          682         161     4            0            0 /usr/src/sys/kern/uipc_socket2.c:128 (so_rcv)
    53         2072          60    34            0            0 /usr/src/sys/netinet/tcp_input.c:867 (inp)
     4          149          59     2            0            0 /usr/src/sys/kern/uipc_socket2.c:142 (so_rcv)
   653         6607        2202     3            0            0 /usr/src/sys/kern/kern_descrip.c:1761 (filedesc structure)
   247         6505        2202     2            0            0 /usr/src/sys/kern/kern_descrip.c:1765 (filedesc structure)
     5           95          27     3            0            0 /usr/src/sys/ufs/ffs/ffs_softdep.c:735 (Softdep Lock)
    16          182          27     6            0            0 /usr/src/sys/ufs/ffs/ffs_softdep.c:754 (mountlist)
    10          446         162     2            0            0 /usr/src/sys/ufs/ffs/ffs_softdep.c:847 (Softdep Lock)
    42         2863         162    17            0            0 /usr/src/sys/ufs/ffs/ffs_softdep.c:767 (mountlist)
     5           75          27     2            0            0 /usr/src/sys/ufs/ffs/ffs_softdep.c:774 (Softdep Lock)
     3           24           8     3           10            5 /usr/src/sys/kern/kern_kse.c:965 (process lock)
     5           31           9     3            7            4 /usr/src/sys/kern/kern_kse.c:422 (process lock)
   513         7851        2242     3            0            0 /usr/src/sys/amd64/amd64/pmap.c:2255 (pmap)
  2063        25059        2242    11           32           40 /usr/src/sys/vm/vm_fault.c:1011 (vm page queue mutex)
     5            9           2     4            0            0 /usr/src/sys/vm/uma_core.c:988 (vm object)
     5           81          30     2            0            0 /usr/src/sys/vm/uma_core.c:891 (PV ENTRY)
   168          898          27    33            0            2 /usr/src/sys/kern/kern_time.c:627 (process lock)
     5          147          52     2            0            0 /usr/src/sys/kern/uipc_socket2.c:172 (so_rcv)
     5          148          52     2            0            0 /usr/src/sys/kern/uipc_socket2.c:177 (so_snd)
     5          146          52     2            0            0 /usr/src/sys/kern/uipc_socket2.c:1081 (so_rcv)
   215         3941          52    75            0            0 /usr/src/sys/netinet/tcp_usrreq.c:441 (inp)
    45          742          26    28            0            0 /usr/src/sys/netinet/tcp_usrreq.c:165 (inp)
    59          930          26    35            0            0 /usr/src/sys/netinet/tcp_usrreq.c:159 (tcp)
     5           14           4     3            0            0 /usr/src/sys/kern/uipc_socket2.c:1153 (so_snd)
     4           11           4     2            0            0 /usr/src/sys/netinet/tcp_input.c:1261 (so_snd)
    11          456         153     2            0            0 /usr/src/sys/libkern/arc4random.c:137 (arc4_mtx)
    68          222           6    37            0            0 /usr/src/sys/netinet/ip_fw2.c:4315 (IPFW dynamic rules)
    62          224          46     4            1            0 /usr/src/sys/sys/buf.h:272 (lockbuilder mtxpool)
    70          121           5    24            0            0 /usr/src/sys/kern/vfs_default.c:401 (vnode interlock)
     9          151          35     4            3            3 /usr/src/sys/ufs/ffs/ffs_vfsops.c:1671 (vnode interlock)
    11          162          38     4            0           16 /usr/src/sys/kern/vfs_bio.c:286 (needsbuffer lock)
     5          163          43     3            0            3 /usr/src/sys/kern/vfs_bio.c:3745 (vnode interlock)
     7          165          38     4            2            3 /usr/src/sys/kern/vfs_bio.c:3334 (vm page queue mutex)
    27          504          38    13            3            1 /usr/src/sys/kern/vfs_bio.c:3332 (vm object)
    16          339          31    10            0            1 /usr/src/sys/kern/vfs_default.c:433 (vnode interlock)
    15          307          42     7            4           22 /usr/src/sys/dev/mfi/mfi_disk.c:258 (MFI I/O lock)
     6          687         168     4            8          267 /usr/src/sys/kern/vfs_bio.c:2923 (bdone lock)
    38         1053          42    25            0            0 /usr/src/sys/geom/geom_disk.c:198 (g_disk_done)
    99         1933          40    48           10            4 /usr/src/sys/dev/mfi/mfi.c:912 (MFI I/O lock)
     7          165          41     4            0            0 /usr/src/sys/kern/vfs_bio.c:332 (runningbufspace lock)
     6          162          39     4            3            2 /usr/src/sys/kern/vfs_bio.c:3139 (vm page queue mutex)
    27          521          39    13            2            4 /usr/src/sys/kern/vfs_bio.c:3120 (vm object)
    11          785         265     2            4            3 /usr/src/sys/kern/vfs_bio.c:1437 (vnode interlock)
    53          864         267     3            1            0 /usr/src/sys/kern/vfs_bio.c:355 (needsbuffer lock)
     6          837         268     3            4            1 /usr/src/sys/kern/vfs_bio.c:313 (needsbuffer lock)
     5          155          44     3            5            1 /usr/src/sys/kern/vfs_bio.c:3755 (vnode interlock)
    12           45          10     4            0            0 /usr/src/sys/kern/vfs_subr.c:1846 (Syncer mtx)
    13           96          16     6            0            0 /usr/src/sys/kern/vfs_subr.c:1596 (vnode interlock)
    16          111          16     6            0            0 /usr/src/sys/kern/vfs_subr.c:1607 (Syncer mtx)
    14          200          54     3            0            0 /usr/src/sys/netinet/ip_fw2.c:1327 (IPFW dynamic rules)
   110          640          25    25            0            1 /usr/src/sys/netinet/udp_usrreq.c:510 (so_rcv)
   116          830          25    33            0            0 /usr/src/sys/netinet/udp_usrreq.c:425 (inp)
   123          996          25    39            0            6 /usr/src/sys/netinet/udp_usrreq.c:285 (udp)
     5          689         248     2            0            0 /usr/src/sys/kern/vfs_vnops.c:499 (sleep mtxpool)
    79          740         224     3            0            0 /usr/src/sys/ufs/ffs/ffs_vnops.c:597 (vnode interlock)
    11          709         248     2            0            0 /usr/src/sys/kern/vfs_vnops.c:520 (sleep mtxpool)
     5          701         414     1            0            0 /usr/src/sys/amd64/amd64/pmap.c:881 (pmap)
     5           21           6     3            0            7 /usr/src/sys/vm/vm_glue.c:150 (system map)
   905         2104           3   701            0            0 /usr/src/sys/vm/vm_meter.c:125 (vm object_list)
     7        27136       17853     1            0         9629 /usr/src/sys/vm/vm_meter.c:198 (vm object)
   132          337           3   112            0            0 /usr/src/sys/vm/vm_meter.c:212 (vm object_list)
     5           36           8     4            0            0 /usr/src/sys/vm/swap_pager.c:2243 (swapdev)
     5          112          41     2            0            0 /usr/src/sys/netinet/in_pcb.c:618 (rtentry)
    44          115           3    38            0            0 /usr/src/sys/netinet/udp_usrreq.c:801 (udp)
     8           97          23     4            0            0 /usr/src/sys/netinet/ip_fw2.c:1490 (IPFW dynamic rules)
   269         3673          25   146            0            0 /usr/src/sys/netinet/udp_usrreq.c:805 (inp)
     7           39           7     5            0            0 /usr/src/sys/netinet/tcp_timer.c:415 (tcp)
   129          837           7   119            0            0 /usr/src/sys/netinet/tcp_timer.c:422 (inp)
    33           33           1    33            0            0 /usr/src/sys/kern/uipc_socket2.c:292 (so_rcv)
    67          337          43     7            0            0 /usr/src/sys/kern/uipc_socket2.c:159 (so_rcv)
    97          257          43     5            0            0 /usr/src/sys/kern/uipc_socket2.c:160 (so_snd)
    11          724         280     2            0            0 /usr/src/sys/kern/kern_descrip.c:383 (filedesc structure)
    10           69          25     2            0            0 /usr/src/sys/kern/kern_descrip.c:423 (sleep mtxpool)
    12           72          25     2            0            0 /usr/src/sys/kern/kern_descrip.c:426 (filedesc structure)
   384          965         218     4            0            0 /usr/src/sys/kern/kern_descrip.c:431 (sleep mtxpool)
    10          602         218     2            0            0 /usr/src/sys/kern/kern_descrip.c:436 (filedesc structure)
   424        12200         218    55           11            6 /usr/src/sys/kern/kern_descrip.c:376 (Giant)
     3            3           1     3            0            0 /usr/src/sys/kern/sys_pipe.c:385 (sleep mtxpool)
     2            2           1     2            0            0 /usr/src/sys/kern/sys_pipe.c:400 (sleep mtxpool)
     3           15           6     2            0           32 /usr/src/sys/kern/uipc_usrreq.c:920 (unp)
    63          112           2    56            0            0 /usr/src/sys/kern/uipc_usrreq.c:399 (unp)
     3            4           2     2            0            0 /usr/src/sys/kern/uipc_syscalls.c:628 (sleep mtxpool)
     3            4           2     2            0            0 /usr/src/sys/kern/uipc_syscalls.c:633 (sleep mtxpool)
     3           11           4     2            0            0 /usr/src/sys/kern/kern_fork.c:400 (process lock)
    14           39           4     9            0           27 /usr/src/sys/kern/kern_fork.c:399 (process lock)
     3           10           4     2            0            0 /usr/src/sys/kern/kern_descrip.c:1411 (filedesc structure)
     5           12           4     3            0            0 /usr/src/sys/kern/kern_descrip.c:1421 (filedesc structure)
    12           91          26     3            0            0 /usr/src/sys/kern/kern_descrip.c:1527 (sleep mtxpool)
    76          208           4    52            0            0 /usr/src/sys/kern/kern_descrip.c:1511 (filedesc structure)
     5           13           4     3            0            0 /usr/src/sys/kern/kern_descrip.c:1535 (filedesc structure)
     5           13           4     3            0            0 /usr/src/sys/kern/kern_descrip.c:1539 (filedesc structure)
     7           17           4     4            0            0 /usr/src/sys/kern/kern_descrip.c:1540 (filedesc structure)
     7           28           7     4            0            0 /usr/src/sys/kern/kern_proc.c:1141 (struct pargs.ref)
     5           16           4     4            0            0 /usr/src/sys/kern/kern_sig.c:2798 (sigacts)
     5           10           4     2            0            0 /usr/src/sys/kern/kern_resource.c:921 (sleep mtxpool)
    41          113           4    28            0            0 /usr/src/sys/kern/kern_fork.c:470 (process lock)
    53          144           4    36            0            0 /usr/src/sys/kern/kern_fork.c:469 (process lock)
     5           16           4     4            0            0 /usr/src/sys/kern/kern_fork.c:582 (session)
    28           76           4    19            0            0 /usr/src/sys/kern/kern_fork.c:572 (process group)
     5           15           4     3            0            0 /usr/src/sys/kern/kern_fork.c:600 (ktrace)
    39          107           4    26            0            0 /usr/src/sys/kern/kern_fork.c:574 (process lock)
    51          139           4    34            0            0 /usr/src/sys/kern/kern_fork.c:573 (process lock)
    19         1419         144     9            0            0 /usr/src/sys/vm/vm_map.c:2508 (vm object)
   111         2272         154    14            0            0 /usr/src/sys/amd64/amd64/pmap.c:2528 (vm page queue mutex)
    95          958          76    12            0            0 /usr/src/sys/amd64/amd64/pmap.c:2531 (pmap)
   104         1562          76    20            0            0 /usr/src/sys/amd64/amd64/pmap.c:2530 (pmap)
   176         1262          82    15            0            0 /usr/src/sys/vm/vm_object.c:1627 (vm object)
    15          609          95     6            0            0 /usr/src/sys/amd64/amd64/pmap.c:1933 (vm page queue mutex)
    55          732          95     7            0            0 /usr/src/sys/amd64/amd64/pmap.c:1934 (pmap)
     5           15           4     3            0            0 /usr/src/sys/kern/kern_fork.c:700 (process lock)
     5           13           4     3            0            0 /usr/src/sys/kern/kern_fork.c:715 (process lock)
     6          278          90     3            1            1 /usr/src/sys/vm/vm_object.c:1218 (vm object)
     7          278          82     3            0            1 /usr/src/sys/vm/vm_object.c:1251 (vm object)
     5           10           4     2            0            0 /usr/src/sys/kern/kern_fork.c:794 (process lock)
   262         4189         329    12            0          240 /usr/src/sys/vm/vnode_pager.c:1211 (vnode interlock)
    31         2903         329     8            0            0 /usr/src/sys/vm/vnode_pager.c:1229 (vm object)
    60           88           4    22            0            0 /usr/src/sys/kern/uipc_usrreq.c:656 (so_rcv)
    20           55           4    13            0            0 /usr/src/sys/kern/uipc_usrreq.c:680 (so_snd)
    86          201           4    50            0            0 /usr/src/sys/kern/uipc_usrreq.c:564 (unp)
    13          149          22     6            0            0 /usr/src/sys/fs/devfs/devfs_vnops.c:177 (devfs interlock)
    31          288          22    13            0            0 /usr/src/sys/fs/devfs/devfs_vnops.c:180 (vnode interlock)
    21        31061       11101     2            0            0 /usr/src/sys/kern/kern_descrip.c:998 (filedesc structure)
    51           93           2    46            0            0 /usr/src/sys/kern/uipc_usrreq.c:433 (unp)
    29          105           6    17            0            0 /usr/src/sys/kern/uipc_usrreq.c:417 (unp)
    11           33           4     8            0            0 /usr/src/sys/dev/random/yarrow.c:280 (random reseed)
    15           82           8    10            0            0 /usr/src/sys/fs/devfs/devfs_vnops.c:337 (vnode interlock)
     3            6           4     1            0            0 /usr/src/sys/kern/vfs_subr.c:2192 (vnode interlock)
    25          276          26    10            0            0 /usr/src/sys/vm/vm_fault.c:670 (vm object)
    30         6812        2445     2            1            2 /usr/src/sys/kern/kern_proc.c:239 (process lock)
     4            8           3     2            0            0 /usr/src/sys/kern/kern_proc.c:1209 (process lock)
     1            1           1     1            0            0 /usr/src/sys/kern/kern_proc.c:302 (process lock)
     1            1           1     1            0            0 /usr/src/sys/kern/kern_proc.c:305 (process group)
    14           14           1    14            0            0 /usr/src/sys/kern/kern_proc.c:301 (Giant)
     4           11           3     3            0            0 /usr/src/sys/kern/kern_proc.c:398 (process lock)
    16           40           3    13            0            0 /usr/src/sys/kern/kern_proc.c:397 (process group)
    25           64           3    21            0            0 /usr/src/sys/kern/kern_proc.c:396 (process group)
    36           90           3    30            0            0 /usr/src/sys/kern/kern_proc.c:395 (Giant)
     5           37          14     2            0            0 /usr/src/sys/kern/kern_descrip.c:625 (process lock)
     5           44          14     3            0            0 /usr/src/sys/kern/kern_descrip.c:631 (filedesc structure)
    11           48          14     3            0            0 /usr/src/sys/kern/kern_descrip.c:642 (sleep mtxpool)
    10           21           5     4            0            0 /usr/src/sys/kern/kern_descrip.c:720 (filedesc structure)
     5           25           9     2            0            0 /usr/src/sys/kern/kern_descrip.c:733 (filedesc structure)
     5           24           7     3            0            0 /usr/src/sys/vm/vm_map.c:3105 (system map)
     4            9           3     3            0            0 /usr/src/sys/kern/kern_exec.c:331 (process lock)
    11           41          10     4            0            0 /usr/src/sys/vm/vm_page.c:1481 (vm page queue mutex)
     5           15           5     3            0            0 /usr/src/sys/kern/kern_exec.c:876 (vm page queue mutex)
    30          104           5    20            0            0 /usr/src/sys/kern/kern_exec.c:837 (vm object)
     6           90          24     3            2            0 /usr/src/sys/vm/vm_object.c:1551 (vm page queue mutex)
     5          334         106     3           12            6 /usr/src/sys/vm/vm_object.c:1570 (vm page queue mutex)
    12           58          16     3            0            0 /usr/src/sys/vm/vm_object.c:1714 (vm object_list)
     5           11           3     3            0            0 /usr/src/sys/vm/vm_map.c:2722 (process lock)
     5           15           5     3            0            0 /usr/src/sys/vm/vm_glue.c:273 (vm page queue mutex)
    26           93           5    18            0            0 /usr/src/sys/vm/vm_glue.c:256 (vm object)
     3           11           5     2            0            0 /usr/src/sys/vm/vm_glue.c:309 (vm page queue mutex)
     5           10           3     3            0            0 /usr/src/sys/kern/imgact_elf.c:762 (process lock)
     5           13           5     2            0            0 /usr/src/sys/kern/kern_exec.c:898 (vm page queue mutex)
     5           12           3     4            0            0 /usr/src/sys/kern/kern_descrip.c:1483 (filedesc structure)
    15          108          13     8            0            2 /usr/src/sys/kern/kern_resource.c:1041 (uidinfo hash)
     4           10           3     3            0            0 /usr/src/sys/kern/kern_descrip.c:1786 (filedesc structure)
     1            5           3     1            0            0 /usr/src/sys/kern/kern_descrip.c:1811 (filedesc structure)
     5           10           3     3            0            0 /usr/src/sys/kern/kern_sig.c:2808 (sigacts)
     5            9           3     3            0            0 /usr/src/sys/kern/kern_sig.c:595 (sigacts)
    26           63           3    21            0            0 /usr/src/sys/kern/kern_exec.c:518 (process lock)
     5           27          10     2            0            0 /usr/src/sys/kern/kern_prot.c:1257 (process lock)
    18           90           7    12            0            0 /usr/src/sys/kern/kern_prot.c:834 (process lock)
     5           56          19     2            0            0 /usr/src/sys/kern/kern_prot.c:1988 (process lock)
     2            2           1     2            0            0 /usr/src/sys/kern/kern_resource.c:689 (process lock)
     3            9           4     2            0            0 /usr/src/sys/fs/devfs/devfs_vnops.c:611 (dev_clone)
     4           11           4     2            0            0 /usr/src/sys/kern/uipc_usrreq.c:515 (so_rcv)
    24           63           4    15            0            0 /usr/src/sys/kern/uipc_usrreq.c:499 (unp)
    65         1180          26    45            0            0 /usr/src/sys/netinet/udp_usrreq.c:985 (udp)
     5          118          44     2            0            0 /usr/src/sys/kern/uipc_syscalls.c:179 (filedesc structure)
    26          441          26    16            0            0 /usr/src/sys/netinet/udp_usrreq.c:1070 (inp)
    36          629          26    24            0            0 /usr/src/sys/netinet/udp_usrreq.c:1064 (udp)
    17           85          14     6            0            0 /usr/src/sys/ufs/ffs/ffs_vnops.c:208 (vnode interlock)
     3            5           2     2            0            0 /usr/src/sys/ufs/ffs/ffs_softdep.c:6021 (Softdep Lock)
    29           54           3    18            0            0 /usr/src/sys/kern/vfs_bio.c:1600 (vnode interlock)
    12           12           1    12            0            0 /usr/src/sys/kern/vfs_cluster.c:753 (vnode interlock)
     1            1           1     1            0            0 /usr/src/sys/vm/vm_pager.c:324 (pbuf mutex)
     5            9           2     4            0            0 /usr/src/sys/kern/vfs_cluster.c:895 (vm object)
     6            6           1     6            0            0 /usr/src/sys/kern/vfs_cluster.c:835 (vnode interlock)
     5           46          13     3            0            0 /usr/src/sys/ufs/ffs/ffs_softdep.c:3740 (process lock)
     5           54          13     4            0            0 /usr/src/sys/ufs/ffs/ffs_softdep.c:3742 (Softdep Lock)
     5           55          13     4            0            0 /usr/src/sys/ufs/ffs/ffs_softdep.c:3813 (process lock)
     9           28           6     4            0            0 /usr/src/sys/ufs/ffs/ffs_vnops.c:283 (vnode interlock)
    10           67          20     3            0            0 /usr/src/sys/kern/vfs_subr.c:1527 (Syncer mtx)
    16           84           7    12            0            0 /usr/src/sys/kern/vfs_subr.c:3097 (vnode interlock)
    13           50           7     7            0            0 /usr/src/sys/kern/vfs_subr.c:3105 (mountlist)
    39          135          13    10            0            0 /usr/src/sys/ufs/ffs/ffs_softdep.c:4237 (Softdep Lock)
     4           17           7     2            0            0 /usr/src/sys/kern/vfs_subr.c:3114 (struct mount mtx)
     5           18           7     2            1            0 /usr/src/sys/kern/vfs_subr.c:2872 (struct mount mtx)
    11         7193        4957     1            1          109 /usr/src/sys/kern/vfs_subr.c:2874 (vnode interlock)
 14209        34629          12  2885            4            1 /usr/src/sys/kern/vfs_mount.c:1895 (struct mount mtx)
     5           31          12     2            2            2 /usr/src/sys/kern/vfs_mount.c:1933 (struct mount mtx)
     5           16           5     3            0            1 /usr/src/sys/ufs/ffs/ffs_vfsops.c:1139 (struct mount mtx)
     4           17           5     3            0            0 /usr/src/sys/ufs/ffs/ffs_softdep.c:6242 (Softdep Lock)
     3           13           5     2            0            0 /usr/src/sys/ufs/ffs/ffs_vfsops.c:1148 (struct mount mtx)
    13         7658        4930     1            1            0 /usr/src/sys/ufs/ffs/ffs_vfsops.c:1157 (vnode interlock)
     3            3           1     3            0            0 /usr/src/sys/vm/vm_pager.c:463 (vnode interlock)
     5            5           1     5            0            0 /usr/src/sys/vm/vm_pager.c:401 (pbuf mutex)
     5           13           5     2            0           67 /usr/src/sys/ufs/ffs/ffs_vfsops.c:1200 (vnode interlock)
     5           22           7     3            0            0 /usr/src/sys/kern/vfs_subr.c:3120 (struct mount mtx)
     5           97          37     2            0            0 /usr/src/sys/kern/kern_descrip.c:418 (filedesc structure)
     4            4           1     4            0            0 /usr/src/sys/kern/kern_descrip.c:256 (process lock)
     4           22          11     2            0            0 /usr/src/sys/kern/uipc_socket.c:1616 (so_rcv)
    14          196          38     5            0            0 /usr/src/sys/netinet/tcp_usrreq.c:1023 (tcp)
    15          239          38     6            0            0 /usr/src/sys/netinet/tcp_usrreq.c:1029 (inp)
     1            6           4     1            0            0 /usr/src/sys/netinet/in_pcb.c:788 (inp)
    10           27           4     6            0            0 /usr/src/sys/netinet/in_pcb.c:782 (tcp)
     9           22           7     3            0            0 /usr/src/sys/netinet/in_pcb.c:761 (inp)
    18           66           7     9            0            0 /usr/src/sys/netinet/in_pcb.c:755 (tcp)
   112         1090          78    13            0            0 /usr/src/sys/amd64/amd64/pmap.c:2533 (pmap)
   112         1142          78    14            0            0 /usr/src/sys/amd64/amd64/pmap.c:2534 (pmap)
     7           12           2     6            0            0 /usr/src/sys/vm/vm_object.c:1333 (vm page queue mutex)
    14           23           2    11            0            0 /usr/src/sys/vm/vm_object.c:1309 (vm object)
     3            5           2     2            0            0 /usr/src/sys/vm/vm_object.c:1370 (vm page queue mutex)
    23           44           2    22            0            5 /usr/src/sys/vm/vm_object.c:1308 (vm object)
     2            3           2     1            0            0 /usr/src/sys/vm/vm_object.c:1378 (vm object)
     3            5           2     2            0            0 /usr/src/sys/vm/vm_map.c:2644 (vm object)
     3            3           1     3            0            0 /usr/src/sys/kern/vfs_syscalls.c:924 (filedesc structure)
     4            4           1     4            0            0 /usr/src/sys/kern/vfs_syscalls.c:940 (filedesc structure)
    15           15           1    15            0            0 /usr/src/sys/kern/kern_prot.c:1130 (process lock)
     9            9           1     9            0            0 /usr/src/sys/kern/kern_resource.c:1046 (uidinfo hash)
    52           52           1    52            0            0 /usr/src/sys/kern/kern_prot.c:1049 (process lock)
    95          114           3    38            0            0 /usr/src/sys/kern/kern_prot.c:674 (process lock)
    32           43           3    14            0            0 /usr/src/sys/kern/kern_prot.c:775 (process lock)
    31           44           3    14            0            0 /usr/src/sys/kern/kern_prot.c:504 (process lock)
    35           81           5    16            0            0 /usr/src/sys/kern/kern_prot.c:618 (process lock)
     4           17           6     2            0            0 /usr/src/sys/kern/uipc_usrreq.c:382 (unp)
   110          566           6    94            1            1 /usr/src/sys/kern/uipc_usrreq.c:1037 (Giant)
     5           24           6     4            0            0 /usr/src/sys/kern/uipc_usrreq.c:1134 (unp)
     1            3           2     1            0            0 /usr/src/sys/vm/vm_object.c:1689 (vm object)
    26           50           7     7            0            1 /usr/src/sys/kern/sys_pipe.c:1479 (pipe mutex)
     4           21           7     3            0            0 /usr/src/sys/kern/sys_pipe.c:1519 (pipe mutex)
     3            6           2     3            0            0 /usr/src/sys/kern/kern_exit.c:350 (session)
     2            2           1     2            0            0 /usr/src/sys/kern/kern_exit.c:426 (process lock)
     9            9           1     9            0            0 /usr/src/sys/kern/kern_resource.c:1111 (uidinfo hash)
    10           10           1    10            0            0 /usr/src/sys/kern/kern_resource.c:1112 (sleep mtxpool)
     8           13           3     4            0            2 /usr/src/sys/kern/kern_exit.c:766 (process lock)
     5           22           5     4            0            0 /usr/src/sys/kern/sys_pipe.c:993 (pipe mutex)
    34           70           5    14            0            0 /usr/src/sys/kern/sys_pipe.c:1145 (pipe mutex)
     4           14           5     2            0            0 /usr/src/sys/kern/sys_pipe.c:628 (pipe mutex)
     5            5           1     5            0            0 /usr/src/sys/kern/kern_prot.c:135 (process lock)
     5            7           2     3            0            0 /usr/src/sys/kern/kern_proc.c:319 (session)
     6            9           2     4            0            0 /usr/src/sys/kern/kern_proc.c:322 (process group)
    27           45           2    22            0            1 /usr/src/sys/kern/kern_proc.c:317 (Giant)
     5           26          10     2            0            0 /usr/src/sys/kern/kern_descrip.c:1806 (filedesc structure)
     4           31          10     3            0            0 /usr/src/sys/kern/kern_descrip.c:1808 (filedesc structure)
     5            6           2     3            0            0 /usr/src/sys/kern/kern_sig.c:1164 (process lock)
    11         6608        2464     2            0            0 /usr/src/sys/kern/kern_proc.c:638 (ktrace)
    11         6671        2464     2            0            0 /usr/src/sys/kern/kern_proc.c:666 (sigacts)
    10         6572        2464     2            0            0 /usr/src/sys/kern/kern_proc.c:717 (session)
   361        62735        2464    25            3           24 /usr/src/sys/kern/kern_proc.c:1017 (process lock)
     5           47          12     3            0            0 /usr/src/sys/vm/vm_glue.c:204 (process lock)
     4          676         408     1            0            0 /usr/src/sys/amd64/amd64/pmap.c:2491 (pmap)
     4          682         408     1           11            5 /usr/src/sys/vm/vm_fault.c:1093 (vm page queue mutex)
     5           48          17     2            0            0 /usr/src/sys/ufs/ffs/ffs_alloc.c:1880 (FFS)
     5            9           3     3            0            0 /usr/src/sys/ufs/ffs/ffs_softdep.c:2765 (FFS)
     5           11           3     3            0            0 /usr/src/sys/ufs/ffs/ffs_softdep.c:2791 (Softdep Lock)
     5           29           8     3            0            0 /usr/src/sys/ufs/ffs/ffs_softdep.c:986 (Softdep Lock)
    11           19           3     6            0            0 /usr/src/sys/ufs/ffs/ffs_softdep.c:3669 (Softdep Lock)
     4           11           3     3            0            0 /usr/src/sys/ufs/ffs/ffs_softdep.c:3675 (FFS)
     5            9           3     3            0            0 /usr/src/sys/ufs/ffs/ffs_alloc.c:2072 (FFS)
     4           10           3     3            0            0 /usr/src/sys/ufs/ffs/ffs_softdep.c:3681 (Softdep Lock)
     3           11           5     2            0            0 /usr/src/sys/kern/subr_devstat.c:381 (devstat)
     4           12           5     2            0            0 /usr/src/sys/kern/subr_devstat.c:394 (devstat)
     5           60          22     2            0            0 /usr/src/sys/kern/kern_event.c:524 (filedesc structure)
     5           62          22     2            0            0 /usr/src/sys/kern/kern_event.c:528 (sleep mtxpool)
   596         1894          22    86            0            0 /usr/src/sys/netinet/udp_usrreq.c:1042 (inp)
   602         2032          22    92            0            0 /usr/src/sys/netinet/udp_usrreq.c:1036 (udp)
     5           69          22     3            0            0 /usr/src/sys/kern/uipc_syscalls.c:543 (so_rcv)
     5          119          44     2            0            0 /usr/src/sys/kern/kern_event.c:980 (kqueue)
    17          395          44     8            0            0 /usr/src/sys/kern/kern_event.c:972 (sleep mtxpool)
     5           63          22     2            0            0 /usr/src/sys/kern/kern_event.c:723 (protect sysfilt_ops)
     5           71          22     3            0            0 /usr/src/sys/kern/kern_event.c:779 (filedesc structure)
     5           75          22     3            0            0 /usr/src/sys/kern/kern_event.c:788 (sleep mtxpool)
     5           86          22     3            0            0 /usr/src/sys/kern/kern_event.c:1053 (kqueue)
    11           76          22     3            0            0 /usr/src/sys/kern/kern_event.c:819 (filedesc structure)
    15           86          22     3            0            0 /usr/src/sys/kern/kern_event.c:820 (kqueue)
     5           71          22     3            0            0 /usr/src/sys/kern/kern_event.c:1577 (kqueue)
   645          869          22    39            1            0 /usr/src/sys/kern/uipc_socket.c:2108 (so_rcv)
    12          171          22     7            0            0 /usr/src/sys/kern/kern_event.c:926 (kqueue)
     5           74          22     3            0            0 /usr/src/sys/kern/kern_event.c:1161 (kqueue)
    96          243          21    11            0            0 /usr/src/sys/kern/kern_event.c:1547 (kqueue)
     5           54          22     2            0            0 /usr/src/sys/kern/kern_event.c:1599 (kqueue)
    21          211          22     9            0            0 /usr/src/sys/kern/uipc_socket.c:2120 (so_rcv)
    12           80          22     3            0            0 /usr/src/sys/kern/kern_event.c:1847 (kqueue)
    11           72          22     3            0            0 /usr/src/sys/kern/kern_event.c:739 (protect sysfilt_ops)
     4           49          22     2            0            0 /usr/src/sys/kern/kern_event.c:1236 (kqueue)
     4           50          22     2            0            0 /usr/src/sys/kern/kern_event.c:1000 (kqueue)
     5          119          44     2            0            0 /usr/src/sys/kern/kern_event.c:1781 (kqueue)
     5           74          22     3            0            0 /usr/src/sys/netinet/udp_usrreq.c:1087 (inp)
    14          218          22     9            0            0 /usr/src/sys/netinet/udp_usrreq.c:1081 (udp)
     5           74          22     3            0            0 /usr/src/sys/kern/kern_event.c:1421 (kqueue)
    11           79          22     3            0            0 /usr/src/sys/kern/kern_event.c:1474 (filedesc structure)
    84          799          16    49            0            0 /usr/src/sys/netinet/tcp_usrreq.c:121 (tcp)
     4           41          16     2            0            0 /usr/src/sys/kern/uipc_socket2.c:115 (so_rcv)
  1232         8691          32   271            0            0 /usr/src/sys/netinet/tcp_usrreq.c:368 (inp)
     7           15           2     7            0            0 /usr/src/sys/kern/vfs_bio.c:1689 (buf queue lock)
     7            7           1     7            0            0 /usr/src/sys/kern/vfs_bio.c:3545 (vm object)
     3            3           1     3            0            0 /usr/src/sys/ufs/ffs/ffs_vfsops.c:1715 (vnode interlock)
     2            2           1     2            0            0 /usr/src/sys/ufs/ffs/ffs_softdep.c:1003 (Softdep Lock)
     5            5           1     5            0            0 /usr/src/sys/ufs/ffs/ffs_vfsops.c:1598 (vnode interlock)
     8           20           4     5            0            0 /usr/src/sys/kern/vfs_bio.c:3596 (vm page queue mutex)
    70           70           1    70            0            0 /usr/src/sys/kern/vfs_bio.c:3584 (vm object)
     2            2           1     2            0            0 /usr/src/sys/kern/vfs_subr.c:1500 (vnode interlock)
     3            5           2     2            0            0 /usr/src/sys/kern/vfs_bio.c:1321 (buf queue lock)
     4            4           1     4            0            0 /usr/src/sys/ufs/ffs/ffs_vfsops.c:1620 (vnode interlock)
  1102         2187          10   218            0            0 /usr/src/sys/ufs/ffs/ffs_vfsops.c:1181 (struct mount mtx)
     5            6           2     3            0            0 /usr/src/sys/ufs/ffs/ffs_softdep.c:1826 (Softdep Lock)
    10           15           2     7            0            0 /usr/src/sys/net/rtsock.c:1100 (ifnet)
     5           17           4     4            0            0 /usr/src/sys/net/if.c:1235 (ifnet)
  1579         3160           3  1053            0            0 /usr/src/sys/dev/em/if_em.c:1652 (em0)
    23          797         246     3            0          217 /usr/src/sys/netinet/tcp_timer.c:252 (inp)
     3           37          17     2            0            0 /usr/src/sys/vm/uma_core.c:2209 (UMA Slabs)
     4            7           2     3            0            0 /usr/src/sys/ufs/ffs/ffs_balloc.c:654 (FFS)
     2            3           2     1            0            0 /usr/src/sys/ufs/ffs/ffs_alloc.c:307 (FFS)
     1            3           2     1            0            0 /usr/src/sys/ufs/ffs/ffs_alloc.c:1367 (FFS)
     2            4           2     2            0            0 /usr/src/sys/ufs/ffs/ffs_softdep.c:1556 (Softdep Lock)
     2            4           2     2            0            0 /usr/src/sys/ufs/ffs/ffs_softdep.c:1368 (Softdep Lock)
     3           10           4     2            0            0 /usr/src/sys/ufs/ffs/ffs_softdep.c:653 (Softdep Lock)
     3            3           1     3            0            0 /usr/src/sys/ufs/ffs/ffs_softdep.c:1591 (Softdep Lock)
    26           33           3    11            0            0 /usr/src/sys/kern/vfs_bio.c:2793 (vm object)
     5           10           2     5            0            0 /usr/src/sys/kern/vfs_bio.c:3483 (vm object)
     6            9           2     4            0            0 /usr/src/sys/ufs/ffs/ffs_softdep.c:1659 (Softdep Lock)
     2            2           1     2            0            0 /usr/src/sys/ufs/ffs/ffs_softdep.c:1291 (Softdep Lock)
     4           22           8     2            0            0 /usr/src/sys/vm/uma_core.c:2408 (2048)
    14           53          10     5            0            0 /usr/src/sys/netinet/ip_output.c:1240 (tcp)
    15           80          10     8            0            0 /usr/src/sys/netinet/ip_output.c:1246 (inp)
     4            5           2     2            0            0 /usr/src/sys/fs/fifofs/fifo_vnops.c:224 (fifo mutex)
  1874         1922           2   961            2            0 /usr/src/sys/fs/fifofs/fifo_vnops.c:733 (Giant)
     4            6           2     3            0            0 /usr/src/sys/ufs/ufs/ufs_vnops.c:2014 (vnode interlock)
     9           18           2     9            0            0 /usr/src/sys/kern/uipc_usrreq.c:522 (so_snd)
    58          109           2    54            0            0 /usr/src/sys/fs/fifofs/fifo_vnops.c:711 (Giant)
     5           22           6     3            0            0 /usr/src/sys/kern/vfs_syscalls.c:3883 (filedesc structure)
     5           23           6     3            0            0 /usr/src/sys/kern/vfs_syscalls.c:3891 (sleep mtxpool)
     4           19           6     3            0            0 /usr/src/sys/kern/vfs_syscalls.c:3894 (filedesc structure)
     5           10           2     5            0            0 /usr/src/sys/ufs/ffs/ffs_vfsops.c:1080 (FFS)
    70          130           2    65            0            0 /usr/src/sys/kern/vfs_syscalls.c:334 (Giant)
     5            5           1     5            0            0 /usr/src/sys/kern/sys_pipe.c:1270 (pipe mutex)
     5          224          73     3            0            0 /usr/src/sys/vm/uma_core.c:416 (FFS2 dinode)
   506          506           1   506            0            0 /usr/src/sys/vm/uma_core.c:1494 (UMA lock)
     1            1           1     1            0            5 /usr/src/sys/vm/vnode_pager.c:157 (vm object)
     1            1           1     1            0            0 /usr/src/sys/kern/vfs_bio.c:2535 (vnode interlock)
     1            1           1     1            0            0 /usr/src/sys/kern/vfs_subr.c:2170 (vnode interlock)
     1            1           1     1            0            0 /usr/src/sys/kern/vfs_bio.c:3704 (bdone lock)
     3            3           1     3            0            0 /usr/src/sys/kern/vfs_bio.c:3694 (bdone lock)
     2            2           1     2            0            0 /usr/src/sys/kern/vfs_bio.c:1248 (vm object)
     2            2           1     2            0            0 /usr/src/sys/kern/vfs_cluster.c:133 (vnode interlock)
     3            3           1     3            0            0 /usr/src/sys/dev/mfi/mfi.c:2497 (MFI I/O lock)



--------------060705080807060306020005
Content-Type: text/plain;
 name="dual.txt"
Content-Transfer-Encoding: 7bit
Content-Disposition: inline;
 filename="dual.txt"

Copyright (c) 1992-2007 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 6.2-STABLE #1: Wed Oct  3 16:49:23 MSD 2007
    llp@cover.xxx.ru:/usr/obj/usr/src/sys/xxxSMP-amd64
module_register: module accf_http already exists!
Module accf_http failed to register: 17
module_register: module mfi_linux already exists!
Module mfi_linux failed to register: 17
ACPI APIC Table: <INTEL  S5000PAL>
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(R) CPU            5120  @ 1.86GHz (1871.23-MHz K8-class CPU)
  Origin = "GenuineIntel"  Id = 0x6f6  Stepping = 6
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x4e3bd<SSE3,RSVD2,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA>
  AMD Features=0x20100800<SYSCALL,NX,LM>
  AMD Features2=0x1<LAHF>
  Cores per package: 2
real memory  = 5905580032 (5632 MB)
avail memory = 4096319488 (3906 MB)
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  1
 cpu2 (AP): APIC ID:  6
 cpu3 (AP): APIC ID:  7
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 24-47 on motherboard
lapic0: Forcing LINT1 to edge trigger
kbd1 at kbdmux0
module_register_init: MOD_LOAD (accf_http, 0xffffffff80340ea0, 0xffffffff807b4720) error 17
acpi0: <INTEL S5000PAL> on motherboard
acpi_hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 2000
acpi0: Power Button (fixed)
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
cpu0: <ACPI CPU> on acpi0
acpi_throttle0: <ACPI CPU Throttling> on cpu0
cpu1: <ACPI CPU> on acpi0
acpi_throttle1: <ACPI CPU Throttling> on cpu1
acpi_throttle1: failed to attach P_CNT
device_attach: acpi_throttle1 attach returned 6
cpu2: <ACPI CPU> on acpi0
acpi_throttle2: <ACPI CPU Throttling> on cpu2
acpi_throttle2: failed to attach P_CNT
device_attach: acpi_throttle2 attach returned 6
cpu3: <ACPI CPU> on acpi0
acpi_throttle3: <ACPI CPU Throttling> on cpu3
acpi_throttle3: failed to attach P_CNT
device_attach: acpi_throttle3 attach returned 6
acpi_button0: <Power Button> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xca2,0xca3,0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0
pci1: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> irq 16 at device 0.0 on pci1
pci2: <ACPI PCI bus> on pcib2
pcib3: <ACPI PCI-PCI bridge> irq 16 at device 0.0 on pci2
pci3: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> irq 16 at device 1.0 on pci2
pci4: <ACPI PCI bus> on pcib4
pcib5: <ACPI PCI-PCI bridge> irq 16 at device 2.0 on pci2
pci5: <ACPI PCI bus> on pcib5
em0: <Intel(R) PRO/1000 Network Connection Version - 6.2.9> port 0x2020-0x203f mem 0xb8820000-0xb883ffff,0xb8400000-0xb87fffff irq 18 at device 0.0 on pci5
em0: Ethernet address: 00:04:23:dd:5a:26
em1: <Intel(R) PRO/1000 Network Connection Version - 6.2.9> port 0x2000-0x201f mem 0xb8800000-0xb881ffff,0xb8000000-0xb83fffff irq 19 at device 0.1 on pci5
em1: Ethernet address: 00:04:23:dd:5a:27
pcib6: <ACPI PCI-PCI bridge> at device 0.3 on pci1
pci6: <ACPI PCI bus> on pcib6
pcib7: <PCI-PCI bridge> at device 3.0 on pci0
pci7: <PCI bus> on pcib7
pcib8: <ACPI PCI-PCI bridge> at device 4.0 on pci0
pci8: <ACPI PCI bus> on pcib8
pcib9: <ACPI PCI-PCI bridge> at device 5.0 on pci0
pci9: <ACPI PCI bus> on pcib9
pcib10: <ACPI PCI-PCI bridge> at device 6.0 on pci0
pci10: <ACPI PCI bus> on pcib10
pcib11: <PCI-PCI bridge> at device 0.0 on pci10
pci11: <PCI bus> on pcib11
mfi0: <LSI MegaSAS 1064R> mem 0xb8a00000-0xb8a0ffff,0xb8c00000-0xb8c1ffff irq 18 at device 14.0 on pci11
mfi0: Megaraid SAS driver Ver 2.00 
mfi0: 593 (245173707s/0x0020/0) - Shutdown command received from host
mfi0: 594 (4278190080s/0x0020/0) - PCI 0x041000 0x04411 0x041000 0x041004: Firmware initialization started (PCI ID 0411/1000/1004/1000)
mfi0: 595 (4278190080s/0x0020/0) - Type 18: Firmware version 1.03.60-0255
mfi0: 596 (4278190080s/0x0020/0) - PCI 0x041000 0x04411 0x041000 0x041004: Firmware initialization started (PCI ID 0411/1000/1004/1000)
mfi0: 597 (4278190080s/0x0020/0) - Type 18: Firmware version 1.03.60-0255
mfi0: 598 (4278190080s/0x0020/0) - PCI 0x041000 0x04411 0x041000 0x041004: Firmware initialization started (PCI ID 0411/1000/1004/1000)
mfi0: 599 (4278190080s/0x0020/0) - Type 18: Firmware version 1.03.60-0255
mfi0: 600 (4278190080s/0x0020/0) - PCI 0x041000 0x04411 0x041000 0x041004: Firmware initialization started (PCI ID 0411/1000/1004/1000)
mfi0: 601 (4278190080s/0x0020/0) - Type 18: Firmware version 1.03.60-0255
mfi0: 602 (4278190126s/0x0008/0) - Battery temperature is normal
mfi0: 603 (4278190126s/0x0008/0) - Battery Present
mfi0: 604 (4278190161s/0x0002/0) - PD 08(e0/s8) event: Inserted: PD 08(e0/s8)
mfi0: 605 (4278190161s/0x0002/0) - Type 29: Inserted: PD 08(e0/s8) Info: enclPd=ffff, scsiType=0, portMap=01, sasAddr=500000e0158537c2,0000000000000000
mfi0: 606 (4278190161s/0x0002/0) - PD 09(e0/s9) event: Inserted: PD 09(e0/s9)
mfi0: 607 (4278190161s/0x0002/0) - Type 29: Inserted: PD 09(e0/s9) Info: enclPd=ffff, scsiType=0, portMap=02, sasAddr=500000e0158539f2,0000000000000000
mfi0: 608 (245173902s/0x0020/0) - Adapter ticks 245173902 elapsed 82s: Time established as 10/08/07 15:51:42; (82 seconds since power on)
pcib12: <PCI-PCI bridge> at device 0.2 on pci10
pci12: <PCI bus> on pcib12
pcib13: <ACPI PCI-PCI bridge> at device 7.0 on pci0
pci13: <ACPI PCI bus> on pcib13
pci0: <base peripheral> at device 8.0 (no driver attached)
uhci0: <UHCI (generic) USB controller> port 0x3080-0x309f irq 23 at device 29.0 on pci0
uhci0: [GIANT-LOCKED]
usb0: <UHCI (generic) USB controller> on uhci0
usb0: USB revision 1.0
uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
uhci1: <UHCI (generic) USB controller> port 0x3060-0x307f irq 22 at device 29.1 on pci0
uhci1: [GIANT-LOCKED]
usb1: <UHCI (generic) USB controller> on uhci1
usb1: USB revision 1.0
uhub1: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub1: 2 ports with 2 removable, self powered
uhci2: <UHCI (generic) USB controller> port 0x3040-0x305f irq 23 at device 29.2 on pci0
uhci2: [GIANT-LOCKED]
usb2: <UHCI (generic) USB controller> on uhci2
usb2: USB revision 1.0
uhub2: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub2: 2 ports with 2 removable, self powered
uhci3: <UHCI (generic) USB controller> port 0x3020-0x303f irq 22 at device 29.3 on pci0
uhci3: [GIANT-LOCKED]
usb3: <UHCI (generic) USB controller> on uhci3
usb3: USB revision 1.0
uhub3: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub3: 2 ports with 2 removable, self powered
ehci0: <EHCI (generic) USB 2.0 controller> mem 0xb8d00400-0xb8d007ff irq 23 at device 29.7 on pci0
ehci0: [GIANT-LOCKED]
usb4: EHCI version 1.0
usb4: companion controllers, 2 ports each: usb0 usb1 usb2 usb3
usb4: <EHCI (generic) USB 2.0 controller> on ehci0
usb4: USB revision 2.0
uhub4: Intel EHCI root hub, class 9/0, rev 2.00/1.00, addr 1
uhub4: 8 ports with 8 removable, self powered
pcib14: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci14: <ACPI PCI bus> on pcib14
pci14: <display, VGA> at device 12.0 (no driver attached)
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel 63XXESB2 UDMA100 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x30b0-0x30bf irq 20 at device 31.1 on pci0
ata0: <ATA channel 0> on atapci0
ata1: <ATA channel 1> on atapci0
atapci1: <Intel 63XXESB2 SATA300 controller> port 0x30c8-0x30cf,0x30e4-0x30e7,0x30c0-0x30c7,0x30e0-0x30e3,0x30a0-0x30af mem 0xb8d00000-0xb8d003ff irq 20 at device 31.2 on pci0
ata2: <ATA channel 0> on atapci1
ata3: <ATA channel 1> on atapci1
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0: port may not be enabled
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
sio0: type 16550A, console
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc8fff,0xc9000-0xcdfff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounters tick every 1.000 msec
IP Filter: v4.1.13 initialized.  Default = pass all, Logging = enabled
ipfw2 initialized, divert enabled, rule-based forwarding disabled, default to accept, logging unlimited
acd0: DVDR <Slimtype DVDRW SSM-8515S/GS06> at ata0-slave UDMA33
mfid0: <MFI Logical Disk> on mfi0
mfid0: 139236MB (285155328 sectors) RAID volume '' is optimal
lapic1: Forcing LINT1 to edge trigger
SMP: AP CPU #1 Launched!
lapic7: Forcing LINT1 to edge trigger
SMP: AP CPU #3 Launched!
lapic6: Forcing LINT1 to edge trigger
SMP: AP CPU #2 Launched!
Trying to mount root from ufs:/dev/mfid0s1a
em0: link state changed to UP


    1 users    Load  5.27  7.25  6.15                  Nov 19 16:22

Mem:KB    REAL            VIRTUAL                       VN PAGER   SWAP PAGER
        Tot   Share      Tot    Share    Free           in   out     in   out
Act 2309932   13812  2385372    32628  880612  count
All 2387968   14912  6766444    36300          pages
Proc:                                                            Interrupts
  r   p   d   s   w   Csw  Trp  Sys  Int  Sof  Flt      1 cow   13149 total
             38   4   30k 6327 117k  15k  233 3596   3525 zfod        sio0 irq4
                                                     3523 ozfod       ata0 irq14
17.9%Sys   3.5%Intr 41.5%User  0.0%Nice 37.1%Idle      99%ozfod  5148 em0 mfi0 1
|    |    |    |    |    |    |    |    |    |    |       daefr       uhci0 uhci
=========++>>>>>>>>>>>>>>>>>>>>                           prcfr  1993 cpu0: time
                                        36 dtbuf     3933 totfr  1993 cpu1: time
Namei     Name-cache   Dir-cache    100000 desvn          react  2007 cpu3: time
   Calls    hits   %    hits   %     27886 numvn          pdwak  2008 cpu2: time
  169660  169660 100                 24717 frevn          pdpgs
                                                          intrn
Disks mfid0                                        278668 wire
KB/t   0.00                                       2318668 act
tps       0                                        426152 inact
MB/s   0.00                                        190808 cache
%busy     0                                        689804 free





--------------060705080807060306020005--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4741905E.8050300>