Date: Tue, 10 Apr 2007 18:19:42 -0500 From: Scott Lambert <lambert@lambertfam.org> To: FreeBSD STABLE <freebsd-stable@freebsd.org> Subject: uid/gid lookups slower on 6.2 than 4.x? Message-ID: <20070410231942.GB13500@sysmon.tcworks.net>
next in thread | raw e-mail | index | archive | help
--3MwIy2ne0vdjdPXF
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
I've run into an interesting performance "issue" with ls on a 6.2-STABLE
box, web1. This box is going to replace my current 4.11 box, ns,
and is not currently active. It's running all the daemons it will be in
production, but traffic is not pointed at it yet.
I don't think the gmirror vs. adaptec RAID disk subsystem would explain
the performance differences. I could be wrong. If I am, I'm going to
have to get a RAID card for the new box.
root@web1 /home
17:58:57 Tue Apr 10 # time ls -l | wc -l
3135
real 0m35.224s
user 0m6.748s
sys 0m28.482s
root@web1 /home
17:59:48 Tue Apr 10 # time ls -l | wc -l
3135
real 0m35.279s
user 0m6.939s
sys 0m28.348s
root@web1 /home
18:00:37 Tue Apr 10 # time ls -l | wc -l
3135
real 0m35.203s
user 0m6.640s
sys 0m28.569s
root@web1 /home
18:01:13 Tue Apr 10 # uname -a
FreeBSD web1.hosting.tcworks.net 6.2-STABLE-200702 FreeBSD 6.2-STABLE-200702 #0: Sun Feb 4 13:35:09 UTC 2007 root@dessler.cse.buffalo.edu:/usr/obj/usr/src/sys/SMP i386
root@web1 /home
18:03:38 Tue Apr 10 # time ls -ln | wc -l
3135
real 0m0.054s
user 0m0.030s
sys 0m0.031s
root@web1 /home
18:04:53 Tue Apr 10 # time ls -ln | wc -l
3135
real 0m0.054s
user 0m0.046s
sys 0m0.014s
root@web1 /home
18:04:54 Tue Apr 10 # time ls -ln | wc -l
3135
real 0m0.054s
user 0m0.037s
sys 0m0.024s
The difference in the number of home directories is due to my rsync
script not using the --delete option, yet.
Here are the same statistics from my 4.11 box. This box is in
production with the same daemons as the web1 box. :
root@ns /home
18:04:38 Tue Apr 10 # time ls -l | wc -l
3070
real 0m0.113s
user 0m0.041s
sys 0m0.050s
root@ns /home
18:04:41 Tue Apr 10 # time ls -l | wc -l
3070
real 0m0.096s
user 0m0.037s
sys 0m0.053s
root@ns /home
18:04:41 Tue Apr 10 # time ls -l | wc -l
3070
real 0m0.099s
user 0m0.046s
sys 0m0.046s
root@ns /home
18:04:44 Tue Apr 10 # uname -a
FreeBSD ns 4.11-RELEASE-p21 FreeBSD 4.11-RELEASE-p21 #2: Thu Sep 21 00:53:20 CDT 2006 root@sysmon:/usr/obj/usr/src/sys/NS i386
root@ns /home
18:09:38 Tue Apr 10 # time ls -ln | wc -l
3070
real 0m0.055s
user 0m0.030s
sys 0m0.023s
root@ns /home
18:10:20 Tue Apr 10 # time ls -ln | wc -l
3070
real 0m0.055s
user 0m0.031s
sys 0m0.022s
root@ns /home
18:10:21 Tue Apr 10 # time ls -ln | wc -l
3070
real 0m0.059s
user 0m0.041s
sys 0m0.012s
--
Scott Lambert KC5MLE Unix SysAdmin
lambert@lambertfam.org
--3MwIy2ne0vdjdPXF
Content-Type: text/plain; charset=us-ascii
Content-Disposition: attachment; filename="web1.dmesg.boot"
Copyright (c) 1992-2007 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 6.2-STABLE-200702 #0: Sun Feb 4 13:35:09 UTC 2007
root@dessler.cse.buffalo.edu:/usr/obj/usr/src/sys/SMP
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(TM) CPU 2.40GHz (2392.29-MHz 686-class CPU)
Origin = "GenuineIntel" Id = 0xf27 Stepping = 7
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Features2=0x4400<CNTX-ID,<b14>>
Logical CPUs per core: 2
real memory = 1073676288 (1023 MB)
avail memory = 1041481728 (993 MB)
ACPI APIC Table: <INTEL SWV25 >
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
cpu0 (BSP): APIC ID: 0
cpu1 (AP): APIC ID: 1
ACPI-0698: *** Warning: Type override - [DEB_] had invalid type (Integer) for Scope operator, changed to (Scope)
ACPI-0698: *** Warning: Type override - [MLIB] had invalid type (Integer) for Scope operator, changed to (Scope)
ACPI-0698: *** Warning: Type override - [DATA] had invalid type (String) for Scope operator, changed to (Scope)
ACPI-0698: *** Warning: Type override - [SIO_] had invalid type (String) for Scope operator, changed to (Scope)
ACPI-0698: *** Warning: Type override - [LEDP] had invalid type (String) for Scope operator, changed to (Scope)
ACPI-0698: *** Warning: Type override - [GPEN] had invalid type (String) for Scope operator, changed to (Scope)
ACPI-0698: *** Warning: Type override - [GPST] had invalid type (String) for Scope operator, changed to (Scope)
ACPI-0698: *** Warning: Type override - [WUES] had invalid type (String) for Scope operator, changed to (Scope)
ACPI-0698: *** Warning: Type override - [WUSE] had invalid type (String) for Scope operator, changed to (Scope)
ACPI-0698: *** Warning: Type override - [SBID] had invalid type (String) for Scope operator, changed to (Scope)
ACPI-0698: *** Warning: Type override - [SWCE] had invalid type (String) for Scope operator, changed to (Scope)
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 24-47 on motherboard
ioapic2 <Version 2.0> irqs 48-71 on motherboard
lapic0: Forcing LINT1 to edge trigger
kbd1 at kbdmux0
ath_hal: 0.9.20.3 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413)
acpi0: <INTEL SWV25> on motherboard
acpi0: Power Button (fixed)
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
acpi_ec0: <Embedded Controller: GPE 0x8> port 0xca6,0xca7 on acpi0
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pci0: <unknown> at device 0.1 (no driver attached)
pcib1: <ACPI PCI-PCI bridge> at device 3.0 on pci0
pci2: <ACPI PCI bus> on pcib1
pci2: <base peripheral, interrupt controller> at device 28.0 (no driver attached)
pcib2: <ACPI PCI-PCI bridge> at device 29.0 on pci2
pci4: <ACPI PCI bus> on pcib2
ahd0: <Adaptec AIC7902 Ultra320 SCSI adapter> port 0x3800-0x38ff,0x4000-0x40ff mem 0xfe9e0000-0xfe9e1fff irq 50 at device 7.0 on pci4
ahd0: [GIANT-LOCKED]
aic7902: Ultra320 Wide Channel A, SCSI Id=7, PCI-X 67-100Mhz, 512 SCBs
ahd1: <Adaptec AIC7902 Ultra320 SCSI adapter> port 0x3000-0x30ff,0x3400-0x34ff mem 0xfe9f0000-0xfe9f1fff irq 49 at device 7.1 on pci4
ahd1: [GIANT-LOCKED]
aic7902: Ultra320 Wide Channel B, SCSI Id=7, PCI-X 67-100Mhz, 512 SCBs
pci2: <base peripheral, interrupt controller> at device 30.0 (no driver attached)
pcib3: <ACPI PCI-PCI bridge> at device 31.0 on pci2
pci3: <ACPI PCI bus> on pcib3
em0: <Intel(R) PRO/1000 Network Connection Version - 6.2.9> port 0x2040-0x207f mem 0xfe6c0000-0xfe6dffff irq 30 at device 7.0 on pci3
em0: Ethernet address: 00:07:e9:05:61:0a
em1: <Intel(R) PRO/1000 Network Connection Version - 6.2.9> port 0x2000-0x203f mem 0xfe6e0000-0xfe6fffff irq 31 at device 7.1 on pci3
em1: Ethernet address: 00:07:e9:05:61:0b
pci0: <unknown> at device 3.1 (no driver attached)
uhci0: <Intel 82801CA/CAM (ICH3) USB controller USB-A> port 0x5020-0x503f irq 16 at device 29.0 on pci0
uhci0: [GIANT-LOCKED]
usb0: <Intel 82801CA/CAM (ICH3) USB controller USB-A> on uhci0
usb0: USB revision 1.0
uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
uhci1: <Intel 82801CA/CAM (ICH3) USB controller USB-B> port 0x5000-0x501f irq 19 at device 29.1 on pci0
uhci1: [GIANT-LOCKED]
usb1: <Intel 82801CA/CAM (ICH3) USB controller USB-B> on uhci1
usb1: USB revision 1.0
uhub1: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub1: 2 ports with 2 removable, self powered
pcib4: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci1: <ACPI PCI bus> on pcib4
pci1: <display, VGA> at device 12.0 (no driver attached)
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel ICH3 UDMA100 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x3a0-0x3af at device 31.1 on pci0
ata0: <ATA channel 0> on atapci0
ata1: <ATA channel 1> on atapci0
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
fdc0: <floppy drive controller (FDE)> port 0x3f2-0x3f3,0x3f4-0x3f5,0x3f7 irq 6 drq 2 on acpi0
fdc0: [FAST]
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
sio0: type 16550A
sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 on acpi0
sio1: type 16550A
pmtimer0 on isa0
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xc97ff,0xc9800-0xcafff on isa0
ppc0: parallel port not found.
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounters tick every 1.000 msec
Waiting 5 seconds for SCSI devices to settle
acd0: CDROM <SAMSUNG CD-ROM SN-124/N101> at ata1-master UDMA33
ses0 at ahd1 bus 0 target 6 lun 0
ses0: <ESG-SHV SCA HSBP M16 0.05> Fixed Processor SCSI-2 device
ses0: 3.300MB/s transfers
ses0: SAF-TE Compliant Device
lapic1: Forcing LINT1 to edge trigger
SMP: AP CPU #1 Launched!
da0 at ahd1 bus 0 target 0 lun 0
da0: <SEAGATE ST3146707LC 0003> Fixed Direct Access SCSI-3 device
da0: 320.000MB/s transfers (160.000MHz, offset 63, 16bit), Tagged Queueing Enabled
da0: 140014MB (286749488 512 byte sectors: 255H 63S/T 17849C)
da1 at ahd1 bus 0 target 3 lun 0
da1: <SEAGATE ST3146707LC 0003> Fixed Direct Access SCSI-3 device
da1: 320.000MB/s transfers (160.000MHz, offset 63, 16bit), Tagged Queueing Enabled
da1: 140014MB (286749488 512 byte sectors: 255H 63S/T 17849C)
GEOM_MIRROR: Device gm0 created (id=149269652).
GEOM_MIRROR: Device gm0: provider da0 detected.
GEOM_MIRROR: Device gm0: provider da1 detected.
GEOM_MIRROR: Device gm0: provider da1 activated.
GEOM_MIRROR: Device gm0: provider da0 activated.
GEOM_MIRROR: Device gm0: provider mirror/gm0 launched.
Trying to mount root from ufs:/dev/mirror/gm0s1a
--3MwIy2ne0vdjdPXF
Content-Type: text/plain; charset=us-ascii
Content-Disposition: attachment; filename="ns.dmesg.boot"
Copyright (c) 1992-2005 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD 4.11-RELEASE-p21 #2: Thu Sep 21 00:53:20 CDT 2006
root@sysmon:/usr/obj/usr/src/sys/NS
Timecounter "i8254" frequency 1193182 Hz
CPU: Intel(R) Pentium(R) III CPU family 1400MHz (1393.31-MHz 686-class CPU)
Origin = "GenuineIntel" Id = 0x6b1 Stepping = 1
Features=0x383fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE>
real memory = 1610612736 (1572864K bytes)
avail memory = 1564065792 (1527408K bytes)
Preloaded elf kernel "kernel" at 0xc0305000.
Pentium Pro MTRR support enabled
md0: Malloc disk
Using $PIR table, 14 entries at 0xc00fdee0
npx0: <math processor> on motherboard
npx0: INT 16 interface
pcib1: <ServerWorks host to PCI bridge> on motherboard
pci1: <PCI bus> on pcib1
pcib0: <ServerWorks host to PCI bridge> on motherboard
pci0: <PCI bus> on pcib0
pci0: <ATI Mach64-GR graphics accelerator> at 2.0 irq 5
fxp0: <Intel 82550 Pro/100 Ethernet> port 0x2400-0x243f mem 0xf8000000-0xf801ffff,0xf8041000-0xf8041fff irq 9 at device 3.0 on pci0
fxp0: Ethernet address 00:02:b3:50:18:29
inphy0: <i82555 10/100 media interface> on miibus0
inphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
fxp1: <Intel 82550 Pro/100 Ethernet> port 0x2440-0x247f mem 0xf8020000-0xf803ffff,0xf8042000-0xf8042fff irq 10 at device 4.0 on pci0
fxp1: Ethernet address 00:02:b3:50:18:2a
inphy1: <i82555 10/100 media interface> on miibus1
inphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
isab0: <PCI to ISA bridge (vendor=1166 device=0201)> at device 15.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <ServerWorks CSB5 ATA100 controller> port 0x2490-0x2493,0x2480-0x248f,0x374-0x377,0x170-0x177,0x3f4-0x3f7,0x1f0-0x1f7 at device 15.1 on pci0
ata0: at 0x1f0 irq 14 on atapci0
ata1: at 0x170 irq 15 on atapci0
ohci0: <OHCI (generic) USB controller> mem 0xf8043000-0xf8043fff irq 10 at device 15.2 on pci0
usb0: OHCI version 1.0, legacy support
usb0: <OHCI (generic) USB controller> on ohci0
usb0: USB revision 1.0
uhub0: (0x1166) OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 4 ports with 4 removable, self powered
pcib2: <ServerWorks host to PCI bridge> on motherboard
pci2: <PCI bus> on pcib2
asr0: <Adaptec Caching SCSI RAID> mem 0xfc000000-0xfdffffff,0xfb000000-0xfbffffff,0xfa000000-0xfa0fffff irq 9 at device 9.0 on pci2
asr0: major=154
asr0: ADAPTEC 2000S FW Rev. 380E, 2 channel, 256 CCBs, Protocol I2O
pcib3: <ServerWorks host to PCI bridge> on motherboard
pci3: <PCI bus> on pcib3
pcib4: <Host to PCI bridge> on motherboard
pci4: <PCI bus> on pcib4
orm0: <Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xc97ff,0xc9800-0xcafff,0xcb000-0xd0fff,0xde000-0xdffff on isa0
pmtimer0 on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> flags 0x1 irq 1 on atkbdc0
kbd0 at atkbd0
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0
sio0: type 16550A
sio1 at port 0x2f8-0x2ff irq 3 on isa0
sio1: type 16550A
ppc0: <Parallel port> at port 0x378-0x37f irq 7 on isa0
ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode
ppc0: FIFO with 16/16/8 bytes threshold
lpt0: <Printer> on ppbus0
lpt0: Interrupt-driven port
acd0: CDROM <FX54++M> at ata0-master PIO4
pass1 at asr0 bus 0 target 6 lun 0
pass1: <ESG-SHV SCA HSBP M15 0.07> Fixed Processor SCSI-2 device
da0 at asr0 bus 0 target 0 lun 0
da0: <ADAPTEC RAID-1 380E> Fixed Direct Access SCSI-2 device
da0: Tagged Queueing Enabled
da0: 35003MB (71686144 512 byte sectors: 255H 63S/T 4462C)
Mounting root from ufs:/dev/da0s1a
WARNING: / was not properly dismounted
--3MwIy2ne0vdjdPXF--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20070410231942.GB13500>