From owner-freebsd-stable@FreeBSD.ORG Tue Apr 10 23:30:04 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id D49C116A401 for ; Tue, 10 Apr 2007 23:30:04 +0000 (UTC) (envelope-from lambert@lambertfam.org) Received: from sysmon.tcworks.net (sysmon.tcworks.net [65.66.76.4]) by mx1.freebsd.org (Postfix) with ESMTP id 7C5C513C469 for ; Tue, 10 Apr 2007 23:30:04 +0000 (UTC) (envelope-from lambert@lambertfam.org) Received: from sysmon.tcworks.net (localhost [127.0.0.1]) by sysmon.tcworks.net (8.13.1/8.13.1) with ESMTP id l3ANJgdv035237 for ; Tue, 10 Apr 2007 18:19:42 -0500 (CDT) (envelope-from lambert@lambertfam.org) Received: (from lambert@localhost) by sysmon.tcworks.net (8.13.1/8.13.1/Submit) id l3ANJgFf035236 for freebsd-stable@freebsd.org; Tue, 10 Apr 2007 18:19:42 -0500 (CDT) (envelope-from lambert@lambertfam.org) X-Authentication-Warning: sysmon.tcworks.net: lambert set sender to lambert@lambertfam.org using -f Date: Tue, 10 Apr 2007 18:19:42 -0500 From: Scott Lambert To: FreeBSD STABLE Message-ID: <20070410231942.GB13500@sysmon.tcworks.net> Mail-Followup-To: FreeBSD STABLE Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="3MwIy2ne0vdjdPXF" Content-Disposition: inline User-Agent: Mutt/1.4.2.2i Subject: uid/gid lookups slower on 6.2 than 4.x? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 10 Apr 2007 23:30:05 -0000 --3MwIy2ne0vdjdPXF Content-Type: text/plain; charset=us-ascii Content-Disposition: inline I've run into an interesting performance "issue" with ls on a 6.2-STABLE box, web1. This box is going to replace my current 4.11 box, ns, and is not currently active. It's running all the daemons it will be in production, but traffic is not pointed at it yet. I don't think the gmirror vs. adaptec RAID disk subsystem would explain the performance differences. I could be wrong. If I am, I'm going to have to get a RAID card for the new box. root@web1 /home 17:58:57 Tue Apr 10 # time ls -l | wc -l 3135 real 0m35.224s user 0m6.748s sys 0m28.482s root@web1 /home 17:59:48 Tue Apr 10 # time ls -l | wc -l 3135 real 0m35.279s user 0m6.939s sys 0m28.348s root@web1 /home 18:00:37 Tue Apr 10 # time ls -l | wc -l 3135 real 0m35.203s user 0m6.640s sys 0m28.569s root@web1 /home 18:01:13 Tue Apr 10 # uname -a FreeBSD web1.hosting.tcworks.net 6.2-STABLE-200702 FreeBSD 6.2-STABLE-200702 #0: Sun Feb 4 13:35:09 UTC 2007 root@dessler.cse.buffalo.edu:/usr/obj/usr/src/sys/SMP i386 root@web1 /home 18:03:38 Tue Apr 10 # time ls -ln | wc -l 3135 real 0m0.054s user 0m0.030s sys 0m0.031s root@web1 /home 18:04:53 Tue Apr 10 # time ls -ln | wc -l 3135 real 0m0.054s user 0m0.046s sys 0m0.014s root@web1 /home 18:04:54 Tue Apr 10 # time ls -ln | wc -l 3135 real 0m0.054s user 0m0.037s sys 0m0.024s The difference in the number of home directories is due to my rsync script not using the --delete option, yet. Here are the same statistics from my 4.11 box. This box is in production with the same daemons as the web1 box. : root@ns /home 18:04:38 Tue Apr 10 # time ls -l | wc -l 3070 real 0m0.113s user 0m0.041s sys 0m0.050s root@ns /home 18:04:41 Tue Apr 10 # time ls -l | wc -l 3070 real 0m0.096s user 0m0.037s sys 0m0.053s root@ns /home 18:04:41 Tue Apr 10 # time ls -l | wc -l 3070 real 0m0.099s user 0m0.046s sys 0m0.046s root@ns /home 18:04:44 Tue Apr 10 # uname -a FreeBSD ns 4.11-RELEASE-p21 FreeBSD 4.11-RELEASE-p21 #2: Thu Sep 21 00:53:20 CDT 2006 root@sysmon:/usr/obj/usr/src/sys/NS i386 root@ns /home 18:09:38 Tue Apr 10 # time ls -ln | wc -l 3070 real 0m0.055s user 0m0.030s sys 0m0.023s root@ns /home 18:10:20 Tue Apr 10 # time ls -ln | wc -l 3070 real 0m0.055s user 0m0.031s sys 0m0.022s root@ns /home 18:10:21 Tue Apr 10 # time ls -ln | wc -l 3070 real 0m0.059s user 0m0.041s sys 0m0.012s -- Scott Lambert KC5MLE Unix SysAdmin lambert@lambertfam.org --3MwIy2ne0vdjdPXF Content-Type: text/plain; charset=us-ascii Content-Disposition: attachment; filename="web1.dmesg.boot" Copyright (c) 1992-2007 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 6.2-STABLE-200702 #0: Sun Feb 4 13:35:09 UTC 2007 root@dessler.cse.buffalo.edu:/usr/obj/usr/src/sys/SMP Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Xeon(TM) CPU 2.40GHz (2392.29-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0xf27 Stepping = 7 Features=0xbfebfbff Features2=0x4400> Logical CPUs per core: 2 real memory = 1073676288 (1023 MB) avail memory = 1041481728 (993 MB) ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 ACPI-0698: *** Warning: Type override - [DEB_] had invalid type (Integer) for Scope operator, changed to (Scope) ACPI-0698: *** Warning: Type override - [MLIB] had invalid type (Integer) for Scope operator, changed to (Scope) ACPI-0698: *** Warning: Type override - [DATA] had invalid type (String) for Scope operator, changed to (Scope) ACPI-0698: *** Warning: Type override - [SIO_] had invalid type (String) for Scope operator, changed to (Scope) ACPI-0698: *** Warning: Type override - [LEDP] had invalid type (String) for Scope operator, changed to (Scope) ACPI-0698: *** Warning: Type override - [GPEN] had invalid type (String) for Scope operator, changed to (Scope) ACPI-0698: *** Warning: Type override - [GPST] had invalid type (String) for Scope operator, changed to (Scope) ACPI-0698: *** Warning: Type override - [WUES] had invalid type (String) for Scope operator, changed to (Scope) ACPI-0698: *** Warning: Type override - [WUSE] had invalid type (String) for Scope operator, changed to (Scope) ACPI-0698: *** Warning: Type override - [SBID] had invalid type (String) for Scope operator, changed to (Scope) ACPI-0698: *** Warning: Type override - [SWCE] had invalid type (String) for Scope operator, changed to (Scope) ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-47 on motherboard ioapic2 irqs 48-71 on motherboard lapic0: Forcing LINT1 to edge trigger kbd1 at kbdmux0 ath_hal: 0.9.20.3 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413) acpi0: on motherboard acpi0: Power Button (fixed) Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 acpi_ec0: port 0xca6,0xca7 on acpi0 cpu0: on acpi0 cpu1: on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pci0: at device 0.1 (no driver attached) pcib1: at device 3.0 on pci0 pci2: on pcib1 pci2: at device 28.0 (no driver attached) pcib2: at device 29.0 on pci2 pci4: on pcib2 ahd0: port 0x3800-0x38ff,0x4000-0x40ff mem 0xfe9e0000-0xfe9e1fff irq 50 at device 7.0 on pci4 ahd0: [GIANT-LOCKED] aic7902: Ultra320 Wide Channel A, SCSI Id=7, PCI-X 67-100Mhz, 512 SCBs ahd1: port 0x3000-0x30ff,0x3400-0x34ff mem 0xfe9f0000-0xfe9f1fff irq 49 at device 7.1 on pci4 ahd1: [GIANT-LOCKED] aic7902: Ultra320 Wide Channel B, SCSI Id=7, PCI-X 67-100Mhz, 512 SCBs pci2: at device 30.0 (no driver attached) pcib3: at device 31.0 on pci2 pci3: on pcib3 em0: port 0x2040-0x207f mem 0xfe6c0000-0xfe6dffff irq 30 at device 7.0 on pci3 em0: Ethernet address: 00:07:e9:05:61:0a em1: port 0x2000-0x203f mem 0xfe6e0000-0xfe6fffff irq 31 at device 7.1 on pci3 em1: Ethernet address: 00:07:e9:05:61:0b pci0: at device 3.1 (no driver attached) uhci0: port 0x5020-0x503f irq 16 at device 29.0 on pci0 uhci0: [GIANT-LOCKED] usb0: on uhci0 usb0: USB revision 1.0 uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub0: 2 ports with 2 removable, self powered uhci1: port 0x5000-0x501f irq 19 at device 29.1 on pci0 uhci1: [GIANT-LOCKED] usb1: on uhci1 usb1: USB revision 1.0 uhub1: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub1: 2 ports with 2 removable, self powered pcib4: at device 30.0 on pci0 pci1: on pcib4 pci1: at device 12.0 (no driver attached) isab0: at device 31.0 on pci0 isa0: on isab0 atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x3a0-0x3af at device 31.1 on pci0 ata0: on atapci0 ata1: on atapci0 pci0: at device 31.3 (no driver attached) atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] fdc0: port 0x3f2-0x3f3,0x3f4-0x3f5,0x3f7 irq 6 drq 2 on acpi0 fdc0: [FAST] fd0: <1440-KB 3.5" drive> on fdc0 drive 0 sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 sio0: type 16550A sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 on acpi0 sio1: type 16550A pmtimer0 on isa0 orm0: at iomem 0xc0000-0xc7fff,0xc8000-0xc97ff,0xc9800-0xcafff on isa0 ppc0: parallel port not found. sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 Timecounters tick every 1.000 msec Waiting 5 seconds for SCSI devices to settle acd0: CDROM at ata1-master UDMA33 ses0 at ahd1 bus 0 target 6 lun 0 ses0: Fixed Processor SCSI-2 device ses0: 3.300MB/s transfers ses0: SAF-TE Compliant Device lapic1: Forcing LINT1 to edge trigger SMP: AP CPU #1 Launched! da0 at ahd1 bus 0 target 0 lun 0 da0: Fixed Direct Access SCSI-3 device da0: 320.000MB/s transfers (160.000MHz, offset 63, 16bit), Tagged Queueing Enabled da0: 140014MB (286749488 512 byte sectors: 255H 63S/T 17849C) da1 at ahd1 bus 0 target 3 lun 0 da1: Fixed Direct Access SCSI-3 device da1: 320.000MB/s transfers (160.000MHz, offset 63, 16bit), Tagged Queueing Enabled da1: 140014MB (286749488 512 byte sectors: 255H 63S/T 17849C) GEOM_MIRROR: Device gm0 created (id=149269652). GEOM_MIRROR: Device gm0: provider da0 detected. GEOM_MIRROR: Device gm0: provider da1 detected. GEOM_MIRROR: Device gm0: provider da1 activated. GEOM_MIRROR: Device gm0: provider da0 activated. GEOM_MIRROR: Device gm0: provider mirror/gm0 launched. Trying to mount root from ufs:/dev/mirror/gm0s1a --3MwIy2ne0vdjdPXF Content-Type: text/plain; charset=us-ascii Content-Disposition: attachment; filename="ns.dmesg.boot" Copyright (c) 1992-2005 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD 4.11-RELEASE-p21 #2: Thu Sep 21 00:53:20 CDT 2006 root@sysmon:/usr/obj/usr/src/sys/NS Timecounter "i8254" frequency 1193182 Hz CPU: Intel(R) Pentium(R) III CPU family 1400MHz (1393.31-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0x6b1 Stepping = 1 Features=0x383fbff real memory = 1610612736 (1572864K bytes) avail memory = 1564065792 (1527408K bytes) Preloaded elf kernel "kernel" at 0xc0305000. Pentium Pro MTRR support enabled md0: Malloc disk Using $PIR table, 14 entries at 0xc00fdee0 npx0: on motherboard npx0: INT 16 interface pcib1: on motherboard pci1: on pcib1 pcib0: on motherboard pci0: on pcib0 pci0: at 2.0 irq 5 fxp0: port 0x2400-0x243f mem 0xf8000000-0xf801ffff,0xf8041000-0xf8041fff irq 9 at device 3.0 on pci0 fxp0: Ethernet address 00:02:b3:50:18:29 inphy0: on miibus0 inphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto fxp1: port 0x2440-0x247f mem 0xf8020000-0xf803ffff,0xf8042000-0xf8042fff irq 10 at device 4.0 on pci0 fxp1: Ethernet address 00:02:b3:50:18:2a inphy1: on miibus1 inphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto isab0: at device 15.0 on pci0 isa0: on isab0 atapci0: port 0x2490-0x2493,0x2480-0x248f,0x374-0x377,0x170-0x177,0x3f4-0x3f7,0x1f0-0x1f7 at device 15.1 on pci0 ata0: at 0x1f0 irq 14 on atapci0 ata1: at 0x170 irq 15 on atapci0 ohci0: mem 0xf8043000-0xf8043fff irq 10 at device 15.2 on pci0 usb0: OHCI version 1.0, legacy support usb0: on ohci0 usb0: USB revision 1.0 uhub0: (0x1166) OHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub0: 4 ports with 4 removable, self powered pcib2: on motherboard pci2: on pcib2 asr0: mem 0xfc000000-0xfdffffff,0xfb000000-0xfbffffff,0xfa000000-0xfa0fffff irq 9 at device 9.0 on pci2 asr0: major=154 asr0: ADAPTEC 2000S FW Rev. 380E, 2 channel, 256 CCBs, Protocol I2O pcib3: on motherboard pci3: on pcib3 pcib4: on motherboard pci4: on pcib4 orm0: