From owner-freebsd-performance@FreeBSD.ORG Mon Jun 13 11:25:41 2005 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3B73E16A41C for ; Mon, 13 Jun 2005 11:25:41 +0000 (GMT) (envelope-from joseph.koshy@gmail.com) Received: from rproxy.gmail.com (rproxy.gmail.com [64.233.170.206]) by mx1.FreeBSD.org (Postfix) with ESMTP id E0A6E43D1D for ; Mon, 13 Jun 2005 11:25:40 +0000 (GMT) (envelope-from joseph.koshy@gmail.com) Received: by rproxy.gmail.com with SMTP id i8so1128447rne for ; Mon, 13 Jun 2005 04:25:40 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:reply-to:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition; b=IT5cUzD5GjUvN596GIJuO/Ijq3ofpRb2HQp2XNH/y8dFEWiQJwC1KDOvh5CsqlWZX3sRrB7K0HyBuvV/jghqRemdpHZ/u3kFiMzzI6vBuwG4xwx4eJpihO7yb4AXsJ6cX9xwUNv5wWlNuwpjz6/6xwF7NicQGk1BIE8208XkZYw= Received: by 10.38.66.68 with SMTP id o68mr934094rna; Mon, 13 Jun 2005 04:25:40 -0700 (PDT) Received: by 10.38.209.73 with HTTP; Mon, 13 Jun 2005 04:25:40 -0700 (PDT) Message-ID: <84dead7205061304254350869b@mail.gmail.com> Date: Mon, 13 Jun 2005 16:55:40 +0530 From: Joseph Koshy To: freebsd-performance@freebsd.org Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Subject: Do we have a copy of SpecWeb for FreeBSD project use? X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Joseph Koshy List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 13 Jun 2005 11:25:41 -0000 Question in $subject, thanks. --=20 FreeBSD Volunteer, http://people.freebsd.org/~jkoshy From owner-freebsd-performance@FreeBSD.ORG Tue Jun 14 12:20:14 2005 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6F16116A41C for ; Tue, 14 Jun 2005 12:20:14 +0000 (GMT) (envelope-from bde@zeta.org.au) Received: from mailout2.pacific.net.au (mailout2.pacific.net.au [61.8.0.85]) by mx1.FreeBSD.org (Postfix) with ESMTP id 81BE343D53 for ; Tue, 14 Jun 2005 12:20:13 +0000 (GMT) (envelope-from bde@zeta.org.au) Received: from mailproxy2.pacific.net.au (mailproxy2.pacific.net.au [61.8.0.87]) by mailout2.pacific.net.au (8.13.4/8.13.4/Debian-1) with ESMTP id j5ECK4AC028216; Tue, 14 Jun 2005 22:20:04 +1000 Received: from katana.zip.com.au (katana.zip.com.au [61.8.7.246]) by mailproxy2.pacific.net.au (8.13.4/8.13.4/Debian-1) with ESMTP id j5ECK2M9021015; Tue, 14 Jun 2005 22:20:02 +1000 Date: Tue, 14 Jun 2005 22:20:03 +1000 (EST) From: Bruce Evans X-X-Sender: bde@delplex.bde.org To: Glenn Dawson In-Reply-To: <6.1.0.6.2.20050604230636.01bf68c0@cobalt.antimatter.net> Message-ID: <20050614213135.K38258@delplex.bde.org> References: <6.1.0.6.2.20050604230636.01bf68c0@cobalt.antimatter.net> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-performance@freebsd.org Subject: Re: vn(4) performance on 4.11 versus md(4) on 5.4 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 14 Jun 2005 12:20:14 -0000 On Sat, 4 Jun 2005, Glenn Dawson wrote: > I have a number of systems running 4.11 that have file backed virtual disks, > each of which contains a jail. I need to start using 5.4 for new servers. > The catch is, file backed virtual disks using md(4) seem to be much slower > than similar virtual disks on 4.11 using vn(4). vn(4) on 4.11 is about 2.24 > times faster than the equivalent setup using md(4) on 5.4. > > I've posted the results of some tests that I ran at > http://www.antimatter.net/md-versus-vn.txt > > Is this decrease in performance known? Is there something I can do in order > to come close to the performance that 4.11 has? I've tried changing some of > the parameters of the filesystem on the virtual disk, but the performance > didn't change. Writes by md are now synchronous. Try turning this off using "mdconfig -o async ...", though this is probably too dangerous to use in production -- the sync writes are a hack to work around hangs, and my system hung almost instantly while testing this. For copying a cached copy of /usr/src/sys/ (~100MB) on an old de-GEOMed version of -current, with all filesystems mounted -async -noatime, I got the following times: # ffs1 fs on ad2s2d 6.21 real 0.52 user 3.39 sys # ffs2 fs on md2 (default) on file zz on previous fs 63.83 real 0.56 user 3.34 sys # ffs2 fs on md3 (-o async) on same file (after mdconfig -u 2) 16.10 real 0.50 user 3.40 sys Syncing of the last fs deadlocked the file systems on md3 and ad2s2d :-( but not others. For dd'ing /dev/zero to large file, the sync writes gave a loss of performance of almost exactly your factor of 2.24 relative to the non-md fs: the raw disk speed is about 55MB/sec and writing to the native ffs gave 54MB/sec by mostly writing with a physical block size of 64K and writing via md2 gave 25MB/sec by writing always with a physical block size of 16K. The size of 64K results from clustering and the size of 16K results from sync writes breaking clustering (md always writes the fs block size which is 16K in my tests, and since the writes are sync they must be done individually so they cannot be clustered). >From mdconfig(1): % -o [no]option % Set or reset options. % % [no]async % For vnode backed devices: avoid IO_SYNC for increased % performance but at the risk of deadlocking the entire % kernel. % ... % [no]cluster % Enable clustering on this disk. A nearby bug in md is that "-o cluster" has always been silently ignored. I think we decided that it is the user's responsibility to mount md-backed (and other file systems on non-physical or memory-like devices) with -o noclusterw -o noclusterr to prevent wasteful clustering). This is easy to forget, however. vn used to turn off clustering non-optionally to avoid some deadlock problems but this was removed long before 4.11 when the deadlock problems were supposed to be fixed, so turning off clustering was supposed to be only a small optimization. Try turning it off to see if it reduces deadlocks. >From md.c's cvs history: % RCS file: /home/ncvs/src/sys/dev/md/md.c,v % Working file: md.c % head: 1.124 % ... % ---------------------------- % revision 1.115 % date: 2004/03/10 20:41:08; author: phk; state: Exp; lines: +5 -3 % Fix a long-standing deadlock issue with vnode backed md(4) devices: % % On vnode backed md(4) devices over a certain, currently undetermined % size relative to the buffer cache our "lemming-syncer" can provoke % a buffer starvation which puts the md thread to sleep on wdrain. % % This generally tends to grind the entire system to a stop because the % event that is supposed to wake up the thread will not happen until a fair % bit of the piled up I/O requests in the system finish, and since a lot % of those are on a md(4) vnode backed device which is currently waiting % on wdrain until a fair amount of the piled up ... you get the picture. % % The cure is to issue all VOP_WRITES on the vnode backing the device % with IO_SYNC. % % In addition to more closely emulating a real disk device with a % non-lying write-cache, this makes the writes exempt from rate-limited % (there to avoid starving the buffer cache) and consequently prevents % the deadlock. % % Unfortunately performance takes a hit. % % Add "async" option to give people who know what they are doing the % old behaviour. % ---------------------------- Bruce From owner-freebsd-performance@FreeBSD.ORG Wed Jun 15 02:11:51 2005 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 592CD16A41C for ; Wed, 15 Jun 2005 02:11:51 +0000 (GMT) (envelope-from tspencer@hungry.com) Received: from terror.hungry.com (terror.hungry.com [199.181.107.40]) by mx1.FreeBSD.org (Postfix) with ESMTP id D750F43D48 for ; Wed, 15 Jun 2005 02:11:50 +0000 (GMT) (envelope-from tspencer@hungry.com) Received: from [10.250.7.154] (nat2.ironport.com [63.251.108.10]) (AUTH: LOGIN tspencer, TLS: TLSv1/SSLv3,128bits,RC4-SHA) by terror.hungry.com with esmtp; Tue, 14 Jun 2005 19:11:49 -0700 Mime-Version: 1.0 (Apple Message framework v730) Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed Message-Id: <43DB0180-8478-47E9-91BC-3AE5AA10D913@hungry.com> Content-Transfer-Encoding: 7bit From: Tim Spencer Date: Tue, 14 Jun 2005 19:11:16 -0700 To: freebsd-performance@freebsd.org X-Mailer: Apple Mail (2.730) Subject: mysql performance? X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 15 Jun 2005 02:11:51 -0000 Hey there! We've got a couple of fairly beefy mysql servers that just aren't operating as fast as they should be. For instance, we have a slave that is falling behind just with replication going on, even though it doesn't seem to be constrained by any system parameter that I've looked at. The systems in question are a pair of dual proc 2.8ghz Xeons with 3GB of memory. They are running 4.11-stable from maybe a month or so ago, with machdep.hyperthreading_allowed=0. They are running mysql-server-4.1.11_1 which was built with "WITH_LINUXTHREADS=1 BUILD_OPTIMIZED=1 BUILD_STATIC=1" on a 4.10 box. They are mounting a NetApp 940c volume over an isp0 Fibre-Channel card (as da0, as you'll see in the output of stuff below). The NetApp is doing nothing right now but handling the I/O of these hosts, and it's pretty much unloaded. For instance, here's the result of iostat -x for a minute on the NetApp: CPU NFS CIFS HTTP Total Net kB/s Disk kB/s Tape kB/s Cache Cache CP CP Disk DAFS FCP iSCSI FCP kB/s in out read write read write age hit time ty util in out 27% 0 0 0 703 0 0 11931 12091 0 0 3 98% 65% Ff 47% 0 703 0 11123 3154 25% 0 0 0 670 0 0 10779 9102 0 0 3 98% 49% Fn 45% 0 670 0 10547 3212 27% 0 0 0 680 0 0 12219 11833 0 0 3 98% 62% Ff 49% 0 680 0 10610 2959 31% 0 0 0 765 0 0 13478 12889 0 0 3 98% 62% Ff 51% 0 765 0 12343 3356 There's stuff going on, but it's by no means loaded. I can easily push it to 100MB/s and 3000+ I/O ops/sec with iozone and untarring /usr/ports, etc. So I don't believe this is the disk subsystem. Neither does "iostat 2" on the slave show the system as loaded: tty aacd0 da0 acd0 cpu tin tout KB/t tps MB/s KB/t tps MB/s KB/t tps MB/s us ni sy in id 0 5 0.00 0 0.00 0.00 0 0.00 0.00 0 0.00 0 3 4 0 93 0 19 0.00 0 0.00 19.51 177 3.38 0.00 0 0.00 0 9 4 0 87 0 19 0.00 0 0.00 18.72 158 2.89 0.00 0 0.00 0 5 2 0 93 0 19 0.00 0 0.00 17.93 161 2.81 0.00 0 0.00 0 1 2 0 97 0 19 0.00 0 0.00 18.08 161 2.84 0.00 0 0.00 0 1 2 0 97 0 19 0.00 0 0.00 19.04 236 4.38 0.00 0 0.00 0 7 7 0 86 0 19 16.00 1 0.02 19.69 177 3.41 0.00 0 0.00 0 5 2 0 92 We can certainly do better than that. As you can also see, the CPU isn't loaded either. So it's not CPU bound. Here's the result of a representative "systat -vm 30": -------------------------------------------- 3 users Load 0.11 0.10 0.04 Jun 14 18:38 Mem:KB REAL VIRTUAL VN PAGER SWAP PAGER Tot Share Tot Share Free in out in out Act 1199336 848 1235180 1064 127076 count All 3083500 4904 763152 8500 pages zfod Interrupts Proc:r p d s w Csw Trp Sys Int Sof Flt cow 1022 total 1 12 4614 122837482 1022 2257 331528 wire ata0 irq14 1216680 act 265 isp0 irq13 4.2%Sys 0.3%Intr 0.0%User 2.8%Nice 92.7%Idl 1412564 inact 301 bge0 irq16 | | | | | | | | | | 122728 cache aac0 irq18 ==-- 4348 free fdc0 irq6 daefr sio0 irq4 Namei Name-cache Dir-cache prcfr 200 clk irq0 Calls hits % hits % react 256 rtc irq8 6 6 100 pdwake 1074 pdpgs Disks aacd0 da0 acd0 fd0 md0 intrn KB/t 16.00 19.21 0.00 0.00 0.00 204096 buf tps 0 184 0 0 0 11 dirtybuf MB/s 0.00 3.45 0.00 0.00 0.00 197106 desiredvnodes % busy 0 92 0 0 0 92387 numvnodes 72260 freevnodes -------------------------------------------- And yes, I see that %busy for da0 is 92, but again, I can easily start up an iozone benchmark and cause it to scream for a while, so I suspect that this measurement is not really measuring the how busy the disk is. :-) This only seems to leave mysql as the thing that is slow. Has anybody else seen this sort of thing, and can anybody suggest either a solution, or more stuff to look at or test? I have pasted my dmesg and my.cnf for the slave (the master is pretty much the same) below in case that helps. Thanks, and have fun! -tspencer Copyright (c) 1992-2005 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD 4.11-STABLE #0: Wed May 25 05:39:38 GMT 2005 root@:/usr/src/sys/compile/BSD4.11.GODSPEED-SMP Timecounter "i8254" frequency 1193182 Hz CPU: Intel(R) Xeon(TM) CPU 2.80GHz (2786.13-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0xf29 Stepping = 9 Features=0xbfebfbff Hyperthreading: 2 logical CPUs real memory = 3221094400 (3145600K bytes) avail memory = 3134447616 (3060984K bytes) Changing APIC ID for IO APIC #0 from 0 to 8 on chip Changing APIC ID for IO APIC #1 from 0 to 9 on chip Changing APIC ID for IO APIC #2 from 0 to 10 on chip Programming 16 pins in IOAPIC #0 IOAPIC #0 intpin 2 -> irq 0 Programming 16 pins in IOAPIC #1 Programming 16 pins in IOAPIC #2 FreeBSD/SMP: Multiprocessor motherboard: 4 CPUs cpu0 (BSP): apic id: 0, version: 0x00050014, at 0xfee00000 cpu1 (AP): apic id: 1, version: 0x00050014, at 0xfee00000 cpu2 (AP): apic id: 6, version: 0x00050014, at 0xfee00000 cpu3 (AP): apic id: 7, version: 0x00050014, at 0xfee00000 io0 (APIC): apic id: 8, version: 0x000f0011, at 0xfec00000 io1 (APIC): apic id: 9, version: 0x000f0011, at 0xfec01000 io2 (APIC): apic id: 10, version: 0x000f0011, at 0xfec02000 Preloaded elf kernel "kernel" at 0x9f3d2000. Warning: Pentium 4 CPU: PSE disabled Pentium Pro MTRR support enabled md0: Malloc disk Using $PIR table, 9 entries at 0x9f0fc410 npx0: on motherboard npx0: INT 16 interface pcib0: on motherboard IOAPIC #1 intpin 3 -> irq 2 IOAPIC #1 intpin 7 -> irq 7 IOAPIC #1 intpin 11 -> irq 10 pci0: on pcib0 pci0: (vendor=0x1028, dev=0x000c) at 4.0 irq 2 pci0: (vendor=0x1028, dev=0x0008) at 4.1 irq 7 pci0: (vendor=0x1028, dev=0x000d) at 4.2 irq 10 pci0: at 14.0 atapci0: port 0x8b0-0x8bf, 0x8d8-0x8db,0x8d0-0x8d7,0x8c8-0x8cb,0x8c0-0x8c7 at device 15.1 on pci0 ata0: at 0x1f0 irq 14 on atapci0 ata1: at 0x170 irq 15 on atapci0 pci0: at 15.2 irq 5 isab0: at device 15.3 on pci0 isa0: on isab0 pcib1: on motherboard IOAPIC #1 intpin 4 -> irq 11 pci1: on pcib1 fxp0: port 0xdcc0-0xdcff mem 0xfcf00000-0xfcf1ffff,0xfcf20000-0xfcf20fff irq 11 at device 8.0 on pci1 fxp0: Ethernet address 00:0e:0c:62:9e:17 inphy0: on miibus0 inphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto pcib2: on motherboard IOAPIC #1 intpin 8 -> irq 13 pci2: on pcib2 isp0: port 0xcc00-0xccff mem 0xfcd00000-0xfcd00fff irq 13 at device 6.0 on pci2 isp0: bad execution throttle of 0- using 16 pcib3: on motherboard IOAPIC #1 intpin 12 -> irq 16 IOAPIC #1 intpin 13 -> irq 17 pci3: on pcib3 bge0: mem 0xfcb10000-0xfcb1ffff irq 16 at device 6.0 on pci3 bge0: Ethernet address: 00:11:43:34:7b:3f miibus1: on bge0 brgphy0: on miibus1 brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX, 1000baseTX-FDX, auto bge1: mem 0xfcb00000-0xfcb0ffff irq 17 at device 8.0 on pci3 bge1: Ethernet address: 00:11:43:34:7b:40 miibus2: on bge1 brgphy1: on miibus2 brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX, 1000baseTX-FDX, auto pcib4: on motherboard IOAPIC #1 intpin 14 -> irq 18 pci4: on pcib4 pcib8: at device 8.0 on pci4 pci5: on pcib8 aac0: mem 0xf0000000-0xf7ffffff irq 18 at device 8.1 on pci4 aac0: i960RX 100MHz, 118MB cache memory, optional battery present aac0: Kernel 2.8-0, Build 6089, S/N 74a1d3 aac0: Supported Options=275c pcib5: on motherboard pci6: on pcib5 pcib6: on motherboard pci7: on pcib6 pcib7: on motherboard pci8: on pcib7 orm0: mem: Pentium Pro MTRR support enabled null: npx0: [FAST] npx0: on motherboard npx0: INT 16 interface acpi0: on motherboard acpi0: [MPSAFE] pci_open(1):=09mode 1 addr port (0x0cf8) is 0x80000090 pci_open(1a):=09mode1res=3D0x80000000 (0x80000000) pci_cfgcheck:=09device 0 [class=3D060000] [hdr=3D00] is there (id=3D2570808= 6) pcibios: BIOS version 2.10 Found $PIR table, 14 entries at 0xc00f5db0 PCI-Only Interrupts: none Location Bus Device Pin Link IRQs embedded 2 8 A 0x68 3 4 5 6 7 10 11 12 14 15 embedded 0 31 A 0x62 3 4 5 6 7 10 11 12 14 15 embedded 0 31 B 0x61 3 4 5 6 7 10 11 12 14 15 embedded 0 29 A 0x60 3 4 5 6 7 10 11 12 14 15 embedded 0 29 B 0x63 3 4 5 6 7 10 11 12 14 15 embedded 0 29 C 0x62 3 4 5 6 7 10 11 12 14 15 embedded 0 29 D 0x6b 3 4 5 6 7 10 11 12 14 15 embedded 0 1 A 0x60 3 4 5 6 7 10 11 12 14 15 embedded 0 1 B 0x61 3 4 5 6 7 10 11 12 14 15 embedded 0 3 D 0x63 3 4 5 6 7 10 11 12 14 15 embedded 0 1 A 0x62 3 4 5 6 7 10 11 12 14 15 slot 1 2 9 A 0x69 3 4 5 6 7 10 11 12 14 15 slot 1 2 9 B 0x6a 3 4 5 6 7 10 11 12 14 15 slot 1 2 9 C 0x6b 3 4 5 6 7 10 11 12 14 15 slot 1 2 9 D 0x68 3 4 5 6 7 10 11 12 14 15 slot 2 2 10 A 0x6a 3 4 5 6 7 10 11 12 14 15 slot 2 2 10 B 0x6b 3 4 5 6 7 10 11 12 14 15 slot 2 2 10 C 0x68 3 4 5 6 7 10 11 12 14 15 slot 2 2 10 D 0x69 3 4 5 6 7 10 11 12 14 15 slot 3 2 11 A 0x6b 3 4 5 6 7 10 11 12 14 15 slot 3 2 11 B 0x68 3 4 5 6 7 10 11 12 14 15 slot 3 2 11 C 0x69 3 4 5 6 7 10 11 12 14 15 slot 3 2 11 D 0x6a 3 4 5 6 7 10 11 12 14 15 slot 4 2 12 A 0x68 3 4 5 6 7 10 11 12 14 15 slot 4 2 12 B 0x69 3 4 5 6 7 10 11 12 14 15 slot 4 2 12 C 0x6a 3 4 5 6 7 10 11 12 14 15 slot 4 2 12 D 0x6b 3 4 5 6 7 10 11 12 14 15 slot 5 2 13 A 0x69 3 4 5 6 7 10 11 12 14 15 slot 5 2 13 B 0x6a 3 4 5 6 7 10 11 12 14 15 slot 5 2 13 C 0x6b 3 4 5 6 7 10 11 12 14 15 slot 5 2 13 D 0x68 3 4 5 6 7 10 11 12 14 15 embedded 2 3 A 0x68 3 4 5 6 7 10 11 12 14 15 embedded 2 4 A 0x6b 3 4 5 6 7 10 11 12 14 15 embedded 2 5 A 0x6a 3 4 5 6 7 10 11 12 14 15 AcpiOsDerivePciId: bus 0 dev 31 func 1 AcpiOsDerivePciId: bus 0 dev 31 func 2 AcpiOsDerivePciId: bus 0 dev 31 func 0 acpi0: Power Button (fixed) ACPI timer looks GOOD min =3D 3, max =3D 3, width =3D 0 ACPI timer looks GOOD min =3D 3, max =3D 3, width =3D 0 ACPI timer looks GOOD min =3D 3, max =3D 3, width =3D 0 ACPI timer looks GOOD min =3D 3, max =3D 3, width =3D 0 ACPI timer looks GOOD min =3D 3, max =3D 3, width =3D 0 ACPI timer looks GOOD min =3D 3, max =3D 3, width =3D 0 ACPI timer looks GOOD min =3D 3, max =3D 3, width =3D 0 ACPI timer looks GOOD min =3D 3, max =3D 3, width =3D 0 ACPI timer looks GOOD min =3D 3, max =3D 3, width =3D 0 ACPI timer looks GOOD min =3D 3, max =3D 3, width =3D 0 Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 unknown: not probed (disabled) cpu0: on acpi0 pcib0: port 0xcf8-0xcff on acpi0 ACPI PCI link initial configuration: pci0: on pcib0 pci0: physical bus=3D0 =09map[10]: type 3, range 32, base f8000000, size 26, enabled found->=09vendor=3D0x8086, dev=3D0x2570, revid=3D0x02 =09bus=3D0, slot=3D0, func=3D0 =09class=3D06-00-00, hdrtype=3D0x00, mfdev=3D0 =09cmdreg=3D0x0006, statreg=3D0x2090, cachelnsz=3D0 (dwords) =09lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns) found->=09vendor=3D0x8086, dev=3D0x2571, revid=3D0x02 =09bus=3D0, slot=3D1, func=3D0 =09class=3D06-04-00, hdrtype=3D0x01, mfdev=3D0 =09cmdreg=3D0x0106, statreg=3D0x00a0, cachelnsz=3D0 (dwords) =09lattimer=3D0x40 (1920 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns) =09map[20]: type 4, range 32, base 0000ef00, size 5, enabled pcib0: matched entry for 0.29.INTA pcib0: slot 29 INTA hardwired to IRQ 16 found->=09vendor=3D0x8086, dev=3D0x24d2, revid=3D0x02 =09bus=3D0, slot=3D29, func=3D0 =09class=3D0c-03-00, hdrtype=3D0x00, mfdev=3D1 =09cmdreg=3D0x0005, statreg=3D0x0280, cachelnsz=3D0 (dwords) =09lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns) =09intpin=3Da, irq=3D16 =09map[20]: type 4, range 32, base 0000ef20, size 5, enabled pcib0: matched entry for 0.29.INTB pcib0: slot 29 INTB hardwired to IRQ 19 found->=09vendor=3D0x8086, dev=3D0x24d4, revid=3D0x02 =09bus=3D0, slot=3D29, func=3D1 =09class=3D0c-03-00, hdrtype=3D0x00, mfdev=3D0 =09cmdreg=3D0x0005, statreg=3D0x0280, cachelnsz=3D0 (dwords) =09lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns) =09intpin=3Db, irq=3D19 =09map[20]: type 4, range 32, base 0000ef40, size 5, enabled pcib0: matched entry for 0.29.INTC pcib0: slot 29 INTC hardwired to IRQ 18 found->=09vendor=3D0x8086, dev=3D0x24d7, revid=3D0x02 =09bus=3D0, slot=3D29, func=3D2 =09class=3D0c-03-00, hdrtype=3D0x00, mfdev=3D0 =09cmdreg=3D0x0005, statreg=3D0x0280, cachelnsz=3D0 (dwords) =09lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns) =09intpin=3Dc, irq=3D18 =09map[20]: type 4, range 32, base 0000ef80, size 5, enabled pcib0: matched entry for 0.29.INTA pcib0: slot 29 INTA hardwired to IRQ 16 found->=09vendor=3D0x8086, dev=3D0x24de, revid=3D0x02 =09bus=3D0, slot=3D29, func=3D3 =09class=3D0c-03-00, hdrtype=3D0x00, mfdev=3D0 =09cmdreg=3D0x0005, statreg=3D0x0280, cachelnsz=3D0 (dwords) =09lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns) =09intpin=3Da, irq=3D16 =09map[10]: type 1, range 32, base febffc00, size 10, enabled pcib0: matched entry for 0.29.INTD pcib0: slot 29 INTD hardwired to IRQ 23 found->=09vendor=3D0x8086, dev=3D0x24dd, revid=3D0x02 =09bus=3D0, slot=3D29, func=3D7 =09class=3D0c-03-20, hdrtype=3D0x00, mfdev=3D0 =09cmdreg=3D0x0106, statreg=3D0x0290, cachelnsz=3D0 (dwords) =09lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns) =09intpin=3Dd, irq=3D23 =09powerspec 2 supports D0 D3 current D0 found->=09vendor=3D0x8086, dev=3D0x244e, revid=3D0xc2 =09bus=3D0, slot=3D30, func=3D0 =09class=3D06-04-00, hdrtype=3D0x01, mfdev=3D0 =09cmdreg=3D0x0107, statreg=3D0x0080, cachelnsz=3D0 (dwords) =09lattimer=3D0x00 (0 ns), mingnt=3D0x0a (2500 ns), maxlat=3D0x00 (0 ns) found->=09vendor=3D0x8086, dev=3D0x24d0, revid=3D0x02 =09bus=3D0, slot=3D31, func=3D0 =09class=3D06-01-00, hdrtype=3D0x00, mfdev=3D1 =09cmdreg=3D0x000f, statreg=3D0x0280, cachelnsz=3D0 (dwords) =09lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns) =09map[20]: type 4, range 32, base 0000fc00, size 4, enabled found->=09vendor=3D0x8086, dev=3D0x24db, revid=3D0x02 =09bus=3D0, slot=3D31, func=3D1 =09class=3D01-01-8a, hdrtype=3D0x00, mfdev=3D0 =09cmdreg=3D0x0005, statreg=3D0x0280, cachelnsz=3D0 (dwords) =09lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns) =09intpin=3Da, irq=3D255 =09map[20]: type 4, range 32, base 00000400, size 5, enabled pcib0: matched entry for 0.31.INTB pcib0: slot 31 INTB hardwired to IRQ 17 found->=09vendor=3D0x8086, dev=3D0x24d3, revid=3D0x02 =09bus=3D0, slot=3D31, func=3D3 =09class=3D0c-05-00, hdrtype=3D0x00, mfdev=3D0 =09cmdreg=3D0x0001, statreg=3D0x0280, cachelnsz=3D0 (dwords) =09lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns) =09intpin=3Db, irq=3D17 =09map[10]: type 4, range 32, base 0000e800, size 8, enabled =09map[14]: type 4, range 32, base 0000ee80, size 6, enabled =09map[18]: type 1, range 32, base febff800, size 9, enabled =09map[1c]: type 1, range 32, base febff400, size 8, enabled pcib0: matched entry for 0.31.INTB pcib0: slot 31 INTB hardwired to IRQ 17 found->=09vendor=3D0x8086, dev=3D0x24d5, revid=3D0x02 =09bus=3D0, slot=3D31, func=3D5 =09class=3D04-01-00, hdrtype=3D0x00, mfdev=3D0 =09cmdreg=3D0x0007, statreg=3D0x0290, cachelnsz=3D0 (dwords) =09lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns) =09intpin=3Db, irq=3D17 =09powerspec 2 supports D0 D3 current D0 agp0: mem 0xf8000000-0xfbffffff at device = 0.0 on pci0 agp0: Reserved 0x4000000 bytes for rid 0x10 type 3 at 0xf8000000 agp0: allocating GATT for aperture of size 64M pcib1: at device 1.0 on pci0 pcib1: secondary bus 1 pcib1: subordinate bus 1 pcib1: I/O decode 0x0-0x0 pcib1: memory decode 0xfff00000-0xfffff pcib1: prefetched decode 0xfff00000-0xfffff pcib1: could not get PCI interrupt routing table for \\_SB_.PCI0.P0P1 - AE_= NOT_FOUND pci1: on pcib1 pci1: physical bus=3D1 uhci0: port 0xef00-0xef1f irq 1= 6 at device 29.0 on pci0 uhci0: Reserved 0x20 bytes for rid 0x20 type 4 at 0xef00 uhci0: [GIANT-LOCKED] usb0: on uhci0 usb0: USB revision 1.0 uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub0: 2 ports with 2 removable, self powered uhci1: port 0xef20-0xef3f irq 1= 9 at device 29.1 on pci0 uhci1: Reserved 0x20 bytes for rid 0x20 type 4 at 0xef20 uhci1: [GIANT-LOCKED] usb1: on uhci1 usb1: USB revision 1.0 uhub1: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub1: 2 ports with 2 removable, self powered uhci2: port 0xef40-0xef5f irq 1= 8 at device 29.2 on pci0 uhci2: Reserved 0x20 bytes for rid 0x20 type 4 at 0xef40 uhci2: [GIANT-LOCKED] usb2: on uhci2 usb2: USB revision 1.0 uhub2: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub2: 2 ports with 2 removable, self powered uhci3: port 0xef80-0xef9f irq 1= 6 at device 29.3 on pci0 uhci3: Reserved 0x20 bytes for rid 0x20 type 4 at 0xef80 uhci3: [GIANT-LOCKED] usb3: on uhci3 usb3: USB revision 1.0 uhub3: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub3: 2 ports with 2 removable, self powered pci0: at device 29.7 (no driver attached) pcib2: at device 30.0 on pci0 pcib2: secondary bus 2 pcib2: subordinate bus 2 pcib2: I/O decode 0xd000-0xdfff pcib2: memory decode 0xfea00000-0xfeafffff pcib2: prefetched decode 0xfd900000-0xfe8fffff pcib2: Subtractively decoded bridge. ACPI PCI link initial configuration: pci2: on pcib2 pci2: physical bus=3D2 =09map[10]: type 1, range 32, base feadc000, size 14, enabled pcib2: device (null) requested decoded memory range 0xfeadc000-0xfeadffff =09map[14]: type 4, range 32, base 0000d800, size 8, enabled pcib2: device (null) requested decoded I/O range 0xd800-0xd8ff pcib2: matched entry for 2.5.INTA pcib2: slot 5 INTA hardwired to IRQ 22 found->=09vendor=3D0x11ab, dev=3D0x4320, revid=3D0x13 =09bus=3D2, slot=3D5, func=3D0 =09class=3D02-00-00, hdrtype=3D0x00, mfdev=3D0 =09cmdreg=3D0x0117, statreg=3D0x02b0, cachelnsz=3D4 (dwords) =09lattimer=3D0x40 (1920 ns), mingnt=3D0x17 (5750 ns), maxlat=3D0x1f (7750 = ns) =09intpin=3Da, irq=3D22 =09powerspec 2 supports D0 D1 D2 D3 current D0 =09map[10]: type 3, range 32, base fe000000, size 23, enabled pcib2: device (null) requested decoded memory range 0xfe000000-0xfe7fffff =09map[14]: type 1, range 32, base feaf0000, size 16, enabled pcib2: device (null) requested decoded memory range 0xfeaf0000-0xfeafffff =09map[18]: type 4, range 32, base 0000dc00, size 7, enabled pcib2: device (null) requested decoded I/O range 0xdc00-0xdc7f found->=09vendor=3D0x1039, dev=3D0x6326, revid=3D0x0b =09bus=3D2, slot=3D13, func=3D0 =09class=3D03-00-00, hdrtype=3D0x00, mfdev=3D0 =09cmdreg=3D0x0007, statreg=3D0x0230, cachelnsz=3D0 (dwords) =09lattimer=3D0x40 (1920 ns), mingnt=3D0x02 (500 ns), maxlat=3D0x00 (0 ns) =09powerspec 1 supports D0 D2 D3 current D0 skc0: port 0xd800-0xd8ff mem 0xfeadc000-0xfeadff= ff irq 22 at device 5.0 on pci2 skc0: Reserved 0x4000 bytes for rid 0x10 type 3 at 0xfeadc000 skc0: Yukon Gigabit Ethernet 10/100/1000Base-T Adapter sk0: on skc0 sk0: bpf attached sk0: Ethernet address: 00:11:d8:86:8f:7d miibus0: on sk0 e1000phy0: on miibus0 e1000phy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX-FDX,= auto skc0: [MPSAFE] pci2: at device 13.0 (no driver attached) isab0: at device 31.0 on pci0 isa0: on isab0 atapci0: port 0xfc00-0xfc0f,0x376,0x170-0x1= 77,0x3f6,0x1f0-0x1f7 at device 31.1 on pci0 atapci0: Reserved 0x10 bytes for rid 0x20 type 4 at 0xfc00 ata0: channel #0 on atapci0 atapci0: Reserved 0x8 bytes for rid 0x10 type 4 at 0x1f0 atapci0: Reserved 0x1 bytes for rid 0x14 type 4 at 0x3f6 ata0: reset tp1 mask=3D03 ostat0=3D50 ostat1=3D50 ata0-master: stat=3D0x50 err=3D0x01 lsb=3D0x00 msb=3D0x00 ata0-slave: stat=3D0x50 err=3D0x01 lsb=3D0x00 msb=3D0x00 ata0: reset tp2 stat0=3D50 stat1=3D50 devices=3D0x3 ata0: [MPSAFE] ata1: channel #1 on atapci0 atapci0: Reserved 0x8 bytes for rid 0x18 type 4 at 0x170 atapci0: Reserved 0x1 bytes for rid 0x1c type 4 at 0x376 ata1: reset tp1 mask=3D03 ostat0=3D50 ostat1=3D00 ata1-master: stat=3D0x00 err=3D0x01 lsb=3D0x14 msb=3D0xeb ata1-slave: stat=3D0x00 err=3D0x04 lsb=3D0x00 msb=3D0x00 ata1: reset tp2 stat0=3D00 stat1=3D00 devices=3D0x4 ata1: [MPSAFE] pci0: at device 31.3 (no driver attached) pci0: at device 31.5 (no driver attached) acpi_button0: on acpi0 atkbdc0: port 0x64,0x60 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 atkbd: the current kbd controller command byte 0065 atkbd: keyboard ID 0x41ab (2) kbd0 at atkbd0 kbd0: atkbd0, AT 101/102 (2), config:0x0, flags:0x3d0000 atkbd0: [GIANT-LOCKED] psm0: unable to allocate IRQ unknown: not probed (disabled) sio0: irq maps: 0x4001 0x4011 0x4001 0x4001 sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acp= i0 sio0: type 16550A sio1: irq maps: 0x4001 0x4009 0x4001 0x4001 sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 on acpi0 sio1: type 16550A fdc0: port 0x3f7,0x3f0-0x3f5 irq 6 drq 2 on= acpi0 fdc0: ic_type 90 part_id 80 fdc0: [MPSAFE] fdc0: [FAST] fd0: <1440-KB 3.5" drive> on fdc0 drive 0 unknown: not probed (disabled) unknown: not probed (disabled) unknown: not probed (disabled) unknown: not probed (disabled) unknown: not probed (disabled) unknown: not probed (disabled) unknown: not probed (disabled) unknown: not probed (disabled) ata: ata0 already exists; skipping it ata: ata1 already exists; skipping it atkbdc: atkbdc0 already exists; skipping it fdc: fdc0 already exists; skipping it sio: sio0 already exists; skipping it sio: sio1 already exists; skipping it Trying Read_Port at 203 Trying Read_Port at 243 Trying Read_Port at 283 Trying Read_Port at 2c3 Trying Read_Port at 303 Trying Read_Port at 343 Trying Read_Port at 383 Trying Read_Port at 3c3 ex_isa_identify() unknown: status reg test failed ff unknown: status reg test failed ff unknown: status reg test failed ff unknown: status reg test failed ff unknown: status reg test failed ff unknown: status reg test failed ff ahc_isa_probe 13: ioport 0xdc00 alloc failed sc: sc0 already exists; skipping it vga: vga0 already exists; skipping it isa_probe_children: disabling PnP devices isa_probe_children: probing non-PnP devices orm0: at iomem 0xc0000-0xc7fff on isa0 pmtimer0 on isa0 adv0: not probed (disabled) aha0: not probed (disabled) aic0: not probed (disabled) bt0: not probed (disabled) cs0: not probed (disabled) ed0: not probed (disabled) fe0: not probed (disabled) ie0: not probed (disabled) lnc0: not probed (disabled) pcic0 failed to probe at port 0x3e0 iomem 0xd0000 on isa0 pcic1: not probed (disabled) ppc0: parallel port not found. ppc0: failed to probe at irq 7 on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=3D0x300> sc0: fb0, kbd0, terminal emulator: sc (syscons terminal) sio2: not probed (disabled) sio3: not probed (disabled) sn0: not probed (disabled) vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 fb0: vga0, vga, type:VGA (5), flags:0x7007f fb0: port:0x3c0-0x3df, crtc:0x3d4, mem:0xa0000 0x20000 fb0: init mode:24, bios mode:3, current mode:24 fb0: window:0xc00b8000 size:32k gran:32k, buf:0 size:32k VGA parameters upon power-up 50 18 10 00 00 00 03 00 02 67 5f 4f 50 82 53 9f bf 1f 00 4f 0d 0e 00 00 07 80 9b 8d 8f 28 1f 96 b9 a3 ff 00 01 02 03 04 05 14 07 38 39 3a 3b 3c 3d 3e 3f 0c 00 0f 08 00 00 00 00 00 10 0e 00 ff VGA parameters in BIOS for mode 24 50 18 10 00 10 00 03 00 02 67 5f 4f 50 82 53 9f bf 1f 00 4f 0d 0e 00 00 00 00 9b 8d 8f 28 1f 96 b9 a3 ff 00 01 02 03 04 05 14 07 38 39 3a 3b 3c 3d 3e 3f 0c 00 0f 08 00 00 00 00 00 10 0e 00 ff EGA/VGA parameters to be used for mode 24 50 18 10 00 10 00 03 00 02 67 5f 4f 50 82 53 9f bf 1f 00 4f 0d 0e 00 00 00 00 9b 8d 8f 28 1f 96 b9 a3 ff 00 01 02 03 04 05 14 07 38 39 3a 3b 3c 3d 3e 3f 0c 00 0f 08 00 00 00 00 00 10 0e 00 ff vt0: not probed (disabled) isa_probe_children: probing PnP devices Device configuration finished. Reducing kern.maxvnodes 134354 -> 100000 procfs registered Timecounter "TSC" frequency 3006830917 Hz quality 800 Timecounters tick every 10.000 msec lo0: bpf attached ata0-slave: pio=3D0x0c wdma=3D0x22 udma=3D0x46 cable=3D80pin ata0-master: pio=3D0x0c wdma=3D0x22 udma=3D0x46 cable=3D80pin ata0-master: setting PIO4 on Intel ICH5 chip ata0-master: setting UDMA100 on Intel ICH5 chip ata0-slave: setting PIO4 on Intel ICH5 chip ata0-slave: setting UDMA100 on Intel ICH5 chip ad0: ATA-7 disk at ata0-master ad0: 76351MB (156368016 sectors), 155127 C, 16 H, 63 S, 512 B ad0: 16 secs/int, 1 depth queue, UDMA100 ar: FreeBSD check1 failed ad1: ATA-7 disk at ata0-slave ad1: 76351MB (156368016 sectors), 155127 C, 16 H, 63 S, 512 B ad1: 16 secs/int, 1 depth queue, UDMA100 ar: FreeBSD check1 failed ata1-master: pio=3D0x0c wdma=3D0x22 udma=3D0xffffffff cable=3D40pin ata1-master: setting PIO4 on Intel ICH5 chip acd0: CDROM drive at ata1 as master acd0: read 8937KB/s (8937KB/s), 128KB buffer, PIO4 acd0: Reads: CDR, CDRW, CDDA stream, packet acd0: Writes: acd0: Audio: play, 255 volume levels acd0: Mechanism: ejectable tray, unlocked, lock protected acd0: Medium: no/blank disc ioapic0: routing intpin 1 (ISA IRQ 1) to cluster 0 ioapic0: routing intpin 3 (ISA IRQ 3) to cluster 0 ioapic0: routing intpin 4 (ISA IRQ 4) to cluster 0 ioapic0: routing intpin 6 (ISA IRQ 6) to cluster 0 ioapic0: routing intpin 8 (ISA IRQ 8) to cluster 0 ioapic0: routing intpin 9 (ISA IRQ 9) to cluster 0 ioapic0: routing intpin 13 (ISA IRQ 13) to cluster 0 ioapic0: routing intpin 14 (ISA IRQ 14) to cluster 0 ioapic0: routing intpin 15 (ISA IRQ 15) to cluster 0 ioapic0: routing intpin 16 (PCI IRQ 16) to cluster 0 ioapic0: routing intpin 18 (PCI IRQ 18) to cluster 0 ioapic0: routing intpin 19 (PCI IRQ 19) to cluster 0 ioapic0: routing intpin 22 (PCI IRQ 22) to cluster 0 GEOM: new disk ad0 GEOM: new disk ad1 [0] f:80 typ:165 s(CHS):0/1/1 e(CHS):1023/254/63 s:63 l:156360582 [1] f:00 typ:0 s(CHS):0/0/0 e(CHS):0/0/0 s:0 l:0 [2] f:00 typ:0 s(CHS):0/0/0 e(CHS):0/0/0 s:0 l:0 [3] f:00 typ:0 s(CHS):0/0/0 e(CHS):0/0/0 s:0 l:0 GEOM: Configure ad0s1, start 32256 length 80056617984 end 80056650239 [0] f:80 typ:165 s(CHS):0/1/1 e(CHS):1023/254/63 s:63 l:156360582 [1] f:00 typ:0 s(CHS):0/0/0 e(CHS):0/0/0 s:0 l:0 [2] f:00 typ:0 s(CHS):0/0/0 e(CHS):0/0/0 s:0 l:0 [3] f:00 typ:0 s(CHS):0/0/0 e(CHS):0/0/0 s:0 l:0 GEOM: Configure ad1s1, start 32256 length 80056617984 end 80056650239 GEOM: Configure ad0s1a, start 0 length 268435456 end 268435455 GEOM: Configure ad0s1b, start 268435456 length 4268032000 end 4536467455 GEOM: Configure ad0s1c, start 0 length 80056617984 end 80056617983 GEOM: Configure ad0s1d, start 4536467456 length 268435456 end 4804902911 GEOM: Configure ad0s1e, start 4804902912 length 268435456 end 5073338367 GEOM: Configure ad0s1f, start 5073338368 length 74983279616 end 80056617983 GEOM: Configure ad1s1c, start 0 length 80056617984 end 80056617983 GEOM: Configure ad1s1d, start 0 length 80056617984 end 80056617983 Mounting root from ufs:/dev/ad0s1a start_init: trying /sbin/init From owner-freebsd-performance@FreeBSD.ORG Fri Jun 17 14:57:52 2005 Return-Path: X-Original-To: performance@freebsd.org Delivered-To: freebsd-performance@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 81BFB16A41C for ; Fri, 17 Jun 2005 14:57:52 +0000 (GMT) (envelope-from steve@lonres.com) Received: from anchor-post-32.mail.demon.net (anchor-post-32.mail.demon.net [194.217.242.90]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2445043D1D for ; Fri, 17 Jun 2005 14:57:52 +0000 (GMT) (envelope-from steve@lonres.com) Received: from mail.lonres.com ([194.70.153.187]) by anchor-post-32.mail.demon.net with esmtp (Exim 4.42) id 1DjII2-0008th-7E; Fri, 17 Jun 2005 14:57:50 +0000 Received: from bibipentium.lonres.com (bibipentium.lonres.com [10.10.10.225]) by mail.lonres.com (Postfix) with SMTP id F242E2E06C; Fri, 17 Jun 2005 15:57:49 +0100 (BST) Received: by bibipentium.lonres.com (sSMTP sendmail emulation); Fri, 17 Jun 2005 15:57:57 +0100 Date: Fri, 17 Jun 2005 15:57:57 +0100 From: Steve Roome To: David Sze Message-ID: <20050617145757.GD34777@bibipentium.lonres.com> References: <746fd037f6ca8131a8fb8938f1e346e9@lonres.com> <20050610170537.GA67849@bibipentium.lonres.com> <20050611085604.J75625@fledge.watson.org> <20050616161506.GB28794@bibipentium.lonres.com> <6.2.1.2.2.20050617091736.05949298@mail.distrust.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <6.2.1.2.2.20050617091736.05949298@mail.distrust.net> User-Agent: Mutt/1.4.2.1i X-Mailman-Approved-At: Sat, 18 Jun 2005 12:37:27 +0000 Cc: performance@freebsd.org Subject: Re: FreeBSD MySQL still WAY slower than Linux X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 17 Jun 2005 14:57:52 -0000 I moved this thread to -performance as that's entirely what it's about now and we seem not to care which version of freebsd we'll try out. Thanks for your comments on this, rather than write you an essay (I just deleted that) here's the results I've just got from trying this with vmstat and iostat running at the same time. They're all running at the same time so it's a pain to read, but it looks to me like there's only very minimal filesystem activity either at the end or start of the query run. If that is the slow part then surely it must be VERY VERY slow for us to get twice the figures on Linux. (i.e. there's only disk access in the last second, and the rest of the query takes 4+ seconds to run.) It could be an issue, it could even be THE issue we have, but I'm not sure that it looks like it could be responsible for all of it. Also, note that the CPU is at 100% usage pretty much all the way through, and Linux still goes twice as fast ? There's got to be something else wrong. Or hopefully I'm just interpreting the figures (below) wrong. So, still getting about 15k qps. Anyway, I'll try and get this all configured properly async, but mounting async,noatime just sets noatime for me (async is noneffective and doesn't appear in the mount list) and that's how it was mounted for the test results below. root@lithium 21 130 # mount /dev/amrd0s1a on / (ufs, local) devfs on /dev (devfs, local) /dev/amrd0s1g on /data (ufs, local, noatime, soft-updates) /dev/amrd0s1e on /usr (ufs, local, soft-updates) /dev/amrd0s1f on /var (ufs, local, soft-updates) Here's even more results then: vmstat 1 & iostat 1 & foreach f (1 2 3 4 5) {/data/supersmack-1.3/bin/super-smack select-key.smack 50 1000|grep select_index} procs memory page disks faults cpu r b w avm fre flt re pi po fr sr am0 pa0 in sy cs us sy id tty amrd0 pass0 cpu 2 1 0 1499072 2699820 6 0 0 0 6 0 0 0 328 494 420 0 0 100 tin tout KB/t tps MB/s KB/t tps MB/s us ni sy in id 0 1 10.16 0 0.00 0.14 0 0.00 0 0 0 0 100 0 262 0.00 0 0.00 0.00 0 0.00 46 0 51 0 3 3 1 0 1539380 2692080 2091 0 0 0 166 0 0 0 342 426991 59315 45 52 3 0 143 0.00 0 0.00 0.00 0 0.00 42 0 57 0 0 3 1 0 1539380 2692080 0 0 0 0 0 0 0 0 338 461227 64672 43 57 0 0 143 0.00 0 0.00 0.00 0 0.00 46 0 53 0 1 4 1 0 1539380 2692080 0 0 0 0 0 0 0 0 335 449944 62900 45 54 1 0 143 0.00 0 0.00 0.00 0 0.00 43 0 56 0 1 4 1 0 1539380 2692080 1 0 0 0 0 0 0 0 334 456473 64005 43 56 1 0 143 0.00 0 0.00 0.00 0 0.00 40 0 57 0 3 3 1 0 1539380 2692080 0 0 0 0 0 0 0 0 334 456581 63700 40 57 3 0 143 0.00 0 0.00 0.00 0 0.00 39 0 60 0 1 3 1 0 1539380 2692080 0 0 0 0 0 0 0 0 335 456716 63878 39 60 1 0 143 0.00 0 0.00 0.00 0 0.00 42 0 56 0 2 3 1 0 1530740 2693724 166 0 0 0 469 0 0 0 334 454858 63687 41 57 2 select_index 100000 27 1 14175.41 0 177 0.00 0 0.00 0.00 0 0.00 47 0 50 0 3 3 1 0 1539380 2692080 2754 0 0 0 2457 0 0 0 347 470893 43658 47 50 3 0 144 0.00 0 0.00 0.00 0 0.00 44 0 53 0 3 4 1 0 1539380 2692080 0 0 0 0 0 0 0 0 336 451858 62920 44 53 3 0 143 0.00 0 0.00 0.00 0 0.00 45 0 53 0 1 3 1 0 1539380 2692080 1 0 0 0 0 0 0 0 335 457440 63747 45 54 1 0 143 0.00 0 0.00 0.00 0 0.00 45 0 53 0 2 3 1 0 1539380 2692080 0 0 0 0 0 0 0 0 334 457705 63865 45 53 2 0 143 0.00 0 0.00 0.00 0 0.00 47 0 52 0 2 4 1 0 1539380 2692080 0 0 0 0 0 0 0 0 335 457634 63799 47 51 2 0 143 0.00 0 0.00 0.00 0 0.00 51 0 47 0 2 3 1 0 1539380 2692080 0 0 0 0 0 0 0 0 338 462670 64419 51 48 2 select_index 100000 10 3 14441.46 0 177 16.00 5 0.08 0.00 0 0.00 42 0 55 0 3 51 1 0 1537044 2692708 2758 0 0 0 2926 0 5 0 341 415206 57104 42 55 3 0 144 0.00 0 0.00 0.00 0 0.00 53 0 46 0 1 50 1 0 1539380 2692064 162 0 0 0 0 0 0 0 335 564638 33688 54 46 0 0 143 0.00 0 0.00 0.00 0 0.00 55 0 45 0 0 50 1 0 1539380 2692064 0 0 0 0 0 0 0 0 335 565593 33753 55 45 0 0 143 0.00 0 0.00 0.00 0 0.00 43 0 56 0 2 3 1 0 1539380 2692064 0 0 0 0 0 0 0 0 337 498784 51893 42 56 2 0 143 0.00 0 0.00 0.00 0 0.00 42 0 56 0 2 3 1 0 1539380 2692064 0 0 0 0 0 0 0 0 334 457060 63578 42 56 2 0 143 0.00 0 0.00 0.00 0 0.00 45 0 54 0 0 3 1 0 1539380 2692064 0 0 0 0 0 0 0 0 336 457381 63928 46 53 0 tty amrd0 pass0 cpu tin tout KB/t tps MB/s KB/t tps MB/s us ni sy in id 0 142 0.00 0 0.00 0.00 0 0.00 44 0 55 0 2 4 1 0 1539380 2692064 0 0 0 0 0 0 0 0 338 456654 63909 41 57 2 select_index 100000 10 0 14852.39 0 296 0.00 0 0.00 0.00 0 0.00 41 0 55 0 5 50 1 0 1539380 2692080 2920 0 0 0 2930 0 0 0 337 444283 48341 42 54 4 0 144 0.00 0 0.00 0.00 0 0.00 52 0 48 0 0 50 1 0 1539380 2692080 0 0 0 0 0 0 0 0 336 565342 33734 52 48 0 0 143 0.00 0 0.00 0.00 0 0.00 50 0 50 0 0 50 1 0 1539380 2692080 0 0 0 0 0 0 0 0 335 564739 33736 50 50 0 0 143 0.00 0 0.00 0.00 0 0.00 50 0 50 0 0 50 1 0 1539380 2692080 0 0 0 0 0 0 0 0 334 565227 33760 50 50 0 0 143 0.00 0 0.00 0.00 0 0.00 59 0 41 0 0 50 1 0 1539380 2692080 0 0 0 0 0 0 0 0 334 564694 33663 61 39 0 0 143 0.00 0 0.00 0.00 0 0.00 52 0 48 0 0 50 1 0 1539380 2692080 0 0 0 0 0 0 0 0 338 570659 34101 51 49 0 0 143 0.00 0 0.00 0.00 0 0.00 51 0 49 0 0 select_index 100000 6 0 15800.56 40 1 0 1518496 2696768 1694 0 0 0 2916 0 0 0 339 524302 31026 49 48 3 0 177 0.00 0 0.00 0.00 0 0.00 46 0 51 0 3 51 1 0 1539380 2692064 1226 0 0 0 10 0 0 0 336 556488 33533 47 53 0 0 143 0.00 0 0.00 0.00 0 0.00 50 0 50 0 0 50 1 0 1539380 2692064 0 0 0 0 0 0 0 0 335 566623 33760 50 50 0 0 143 0.00 0 0.00 0.00 0 0.00 52 0 48 0 0 50 1 0 1539380 2692064 0 0 0 0 0 0 0 0 334 569522 33964 52 48 0 0 143 0.00 0 0.00 0.00 0 0.00 50 0 50 0 0 50 1 0 1539380 2692064 0 0 0 0 0 0 0 0 336 568597 33894 51 49 0 0 143 16.00 2 0.03 0.00 0 0.00 49 0 51 0 0 50 1 0 1539380 2692064 0 0 0 0 0 0 2 0 336 567234 33929 48 52 0 0 143 0.00 0 0.00 0.00 0 0.00 50 0 50 0 0 19 1 0 1517060 2696428 528 0 0 0 1619 0 0 0 334 570948 34320 49 51 0 select_index 100000 3 0 15928.08 root@lithium 20 0 # 0 226 0.00 0 0.00 0.00 0 0.00 13 0 17 0 71 0 0 0 1498948 2699796 371 0 0 0 1173 0 0 0 339 114112 7520 9 13 78 0 143 0.00 0 0.00 0.00 0 0.00 0 0 0 0 100 Ta, Steve Roome