From owner-freebsd-smp Wed Jun 13 13: 9:36 2001 Delivered-To: freebsd-smp@freebsd.org Received: from pynchon.icsi.berkeley.edu (katje.aciri.org [192.150.187.51]) by hub.freebsd.org (Postfix) with ESMTP id BB63737B40A for ; Wed, 13 Jun 2001 13:09:33 -0700 (PDT) (envelope-from bkarp@icsi.berkeley.edu) Received: (from karp@localhost) by pynchon.icsi.berkeley.edu (8.11.3/8.11.3) id f5DK41a00672 for freebsd-smp@freebsd.org; Wed, 13 Jun 2001 13:04:01 -0700 (PDT) (envelope-from karp) Date: Wed, 13 Jun 2001 13:04:01 -0700 (PDT) From: Brad Karp Message-Id: <200106132004.f5DK41a00672@pynchon.icsi.berkeley.edu> To: freebsd-smp@freebsd.org Subject: clock speedup on 4.3 SMP boxes Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org I've been experiencing clock speedup (that is, FreeBSD's notion of the current time of day advances faster than real time) on two SMP boxes that run 4.3-RELEASE. The two motherboards: - Tyan S2567, with ServerWorks HEsl chipset - Intel STL2 On both motherboards, I use dual 1 GHz P-IIIs. The clock acceleration appears to be directly proportional to the CPU load on the machine. When I run large simulations that drive one or both CPUs to 100% utilization, the clock gain approaches one hour gain (or more!) per 24 hours real time! Though I run ntpd, ntpd quits once the clock drifts so far so fast, of course. I scoured the -smp archives, assuming that I'd see other reports if this is a kernel SMP code bug. But I found no such reports. At that point, I'd only seen the behavior on the Tyan S2567. So I sent the board to Tyan for repair! Then, I began observing the same behavior on the Intel STL2 board. I now fear that this is an SMP kernel bug. Has anyone seen such clock gains under 4.3, or earlier releases? Many thanks, -Brad, bkarp@icsi.berkeley.edu To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Thu Jun 14 0:42:20 2001 Delivered-To: freebsd-smp@freebsd.org Received: from lorca.tdx.co.uk (uk1.hood.co.uk [195.188.177.10]) by hub.freebsd.org (Postfix) with ESMTP id 83C1437B408 for ; Thu, 14 Jun 2001 00:42:10 -0700 (PDT) (envelope-from kpielorz@lorca.tdx.co.uk) Received: (from kpielorz@localhost) by lorca.tdx.co.uk (8.11.3/8.11.1) id f5E7eAD06435; Thu, 14 Jun 2001 08:40:10 +0100 (BST) (envelope-from kpielorz) Content-Type: text/plain; charset="iso-8859-1" From: Karl Pielorz Reply-To: kpielorz@tdx.co.uk To: Brad Karp , freebsd-smp@FreeBSD.ORG Subject: Re: clock speedup on 4.3 SMP boxes Date: Thu, 14 Jun 2001 08:40:10 +0100 X-Mailer: KMail [version 1.2] References: <200106132004.f5DK41a00672@pynchon.icsi.berkeley.edu> In-Reply-To: <200106132004.f5DK41a00672@pynchon.icsi.berkeley.edu> MIME-Version: 1.0 Message-Id: <01061408401004.02487@lorca.tdx.co.uk> Content-Transfer-Encoding: 8bit Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org On Wednesday 13 June 2001 9:04 pm, Brad Karp wrote: > I've been experiencing clock speedup (that is, FreeBSD's notion of the > current time of day advances faster than real time) on two SMP boxes that > run 4.3-RELEASE. > [snip] > I scoured the -smp archives, assuming that I'd see other reports if this is > a kernel SMP code bug. But I found no such reports. At that point, I'd only > seen the behavior on the Tyan S2567. So I sent the board to Tyan for > repair! Then, I began observing the same behavior on the Intel STL2 board. > I now fear that this is an SMP kernel bug. > Has anyone seen such clock gains under 4.3, or earlier releases? Hi, I've got 4.3-R running on a SuperMicro P6DGU board here, with 2 x Pentium-Pro 200's... I think I've seen the same thing, and not realised it... The machine is normally lightly loaded, with occasional 'busy' patches... I noticed the clock had drifted the other day on it (by about 20 minutes) - which I thought was odd, as the machine also runs NTP, which had actually quit, looking at the logs for ntpd, it's littered with stuff like: Apr 22 19:21:26 host ntpd[275]: time reset -3.527853 s Apr 22 19:21:26 host ntpd[275]: synchronisation lost Apr 23 03:03:13 host ntpd[275]: time reset -2.456250 s Apr 23 03:03:13 host ntpd[275]: synchronisation lost Apr 23 10:13:34 host ntpd[275]: time reset -2.181482 s Apr 23 10:13:34 host ntpd[275]: synchronisation lost I can't catigorically say I've seen what you've seen, but I'll try busying the machine out for a day, see what happens, and let you know... Regards, -Karl Pielorz To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Thu Jun 14 0:55:14 2001 Delivered-To: freebsd-smp@freebsd.org Received: from verdi.nethelp.no (verdi.nethelp.no [158.36.41.162]) by hub.freebsd.org (Postfix) with SMTP id C98E137B401 for ; Thu, 14 Jun 2001 00:55:03 -0700 (PDT) (envelope-from sthaug@nethelp.no) Received: (qmail 39354 invoked by uid 1001); 14 Jun 2001 07:55:01 +0000 (GMT) To: kpielorz@tdx.co.uk Cc: bkarp@icsi.berkeley.edu, freebsd-smp@FreeBSD.ORG Subject: Re: clock speedup on 4.3 SMP boxes From: sthaug@nethelp.no In-Reply-To: Your message of "Thu, 14 Jun 2001 08:40:10 +0100" References: <01061408401004.02487@lorca.tdx.co.uk> X-Mailer: Mew version 1.05+ on Emacs 19.34.2 Mime-Version: 1.0 Content-Type: Text/Plain; charset=us-ascii Date: Thu, 14 Jun 2001 09:55:01 +0200 Message-ID: <39352.992505301@verdi.nethelp.no> Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org > I think I've seen the same thing, and not realised it... The machine is > normally lightly loaded, with occasional 'busy' patches... I noticed the > clock had drifted the other day on it (by about 20 minutes) - which I thought > was odd, as the machine also runs NTP, which had actually quit, looking at > the logs for ntpd, it's littered with stuff like: > > Apr 22 19:21:26 host ntpd[275]: time reset -3.527853 s > Apr 22 19:21:26 host ntpd[275]: synchronisation lost > Apr 23 03:03:13 host ntpd[275]: time reset -2.456250 s > Apr 23 03:03:13 host ntpd[275]: synchronisation lost > Apr 23 10:13:34 host ntpd[275]: time reset -2.181482 s > Apr 23 10:13:34 host ntpd[275]: synchronisation lost We're seeing the same thing on an IBM Netfinity 5600 server (Serverworks LE chipset) running 4.3-STABLE (dmesg included at the end): Jun 13 01:34:12 mail ntpd[88656]: time reset 0.209762 s Jun 13 03:33:11 mail ntpd[88656]: time reset -0.179529 s Jun 13 06:37:46 mail ntpd[88656]: time reset 0.189002 s Jun 13 08:55:34 mail ntpd[88656]: time reset -0.184713 s Jun 13 10:44:48 mail ntpd[88656]: time reset -0.197186 s Jun 13 19:29:21 mail ntpd[88656]: time reset 0.200083 s Jun 13 22:01:07 mail ntpd[88656]: time reset -0.211034 s Jun 14 02:18:40 mail ntpd[88656]: time reset 0.161246 s Jun 14 03:51:36 mail ntpd[88656]: time reset 0.159329 s Jun 14 08:25:08 mail ntpd[88656]: time reset -0.188393 s This is not 4.3 specific, we've had the same thing happen with 4.2. A similar server with only one processor runs NTP extremely stable. Steinar Haug, Nethelp consulting, sthaug@nethelp.no ---------------------------------------------------------------------- Copyright (c) 1992-2001 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD 4.3-STABLE #0: Mon May 7 00:12:43 CEST 2001 sthaug@mail.enitel.no:/local/freebsd/stable4/src/sys/compile/MAIL1_SMP Timecounter "i8254" frequency 1193182 Hz CPU: Pentium III/Pentium III Xeon/Celeron (599.72-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0x681 Stepping = 1 Features=0x387fbff real memory = 939503616 (917484K bytes) avail memory = 911310848 (889952K bytes) Programming 16 pins in IOAPIC #0 IOAPIC #0 intpin 2 -> irq 0 Programming 16 pins in IOAPIC #1 IOAPIC #1 intpin 10 -> irq 5 FreeBSD/SMP: Multiprocessor motherboard cpu0 (BSP): apic id: 1, version: 0x00040011, at 0xfee00000 cpu1 (AP): apic id: 0, version: 0x00040011, at 0xfee00000 io0 (APIC): apic id: 14, version: 0x000f0011, at 0xfec00000 io1 (APIC): apic id: 15, version: 0x000f0011, at 0xfec01000 Preloaded elf kernel "kernel" at 0xc0318000. Pentium Pro MTRR support enabled npx0: on motherboard npx0: INT 16 interface pcib0: on motherboard IOAPIC #1 intpin 11 -> irq 2 IOAPIC #1 intpin 0 -> irq 9 IOAPIC #0 intpin 9 -> irq 16 pci0: on pcib0 pci0: at 1.0 pci0: (vendor=0x1022, dev=0x2000) at 2.0 irq 2 ahc0: port 0x2200-0x22ff mem 0xfebfe000-0xfebfefff irq 9 at device 9.0 on pci0 aic7890/91: Wide Channel A, SCSI Id=7, 32/255 SCBs pcib1: at device 10.0 on pci0 IOAPIC #1 intpin 2 -> irq 17 IOAPIC #1 intpin 3 -> irq 18 pci1: on pcib1 fxp0: port 0x3100-0x311f mem 0xfe800000-0xfe8fffff,0xfea00000-0xfea00fff irq 17 at device 4.0 on pci1 fxp0: Ethernet address 00:d0:b7:5f:b7:a8 fxp1: port 0x3120-0x313f mem 0xfe900000-0xfe9fffff,0xfea01000-0xfea01fff irq 18 at device 5.0 on pci1 fxp1: Ethernet address 00:d0:b7:5f:b7:a9 isab0: at device 15.0 on pci0 isa0: on isab0 atapci0: port 0x840-0x84f at device 15.1 on pci0 ata0: at 0x1f0 irq 14 on atapci0 ata1: at 0x170 irq 15 on atapci0 pci0: at 15.2 irq 16 pcib2: on motherboard IOAPIC #1 intpin 12 -> irq 19 pci2: on pcib2 ahc1: port 0x4b00-0x4bff mem 0xf6fff000-0xf6ffffff irq 19 at device 3.0 on pci2 aic7896/97: Wide Channel A, SCSI Id=7, 32/255 SCBs ahc2: port 0x4c00-0x4cff mem 0xf6ffe000-0xf6ffefff irq 19 at device 3.1 on pci2 aic7896/97: Wide Channel B, SCSI Id=7, 32/255 SCBs fdc0: at port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on isa0 fdc0: FIFO enabled, 8 bytes threshold fd0: <1440-KB 3.5" drive> on fdc0 drive 0 atkbdc0: at port 0x60,0x64 on isa0 atkbd0: flags 0x1 irq 1 on atkbdc0 kbd0 at atkbd0 psm0: irq 12 on atkbdc0 psm0: model Generic PS/2 mouse, device ID 0 vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0 sio0: type 16550A sio1 at port 0x2f8-0x2ff irq 3 on isa0 sio1: type 16550A APIC_IO: Testing 8254 interrupt delivery APIC_IO: Broken MP table detected: 8254 is not connected to IOAPIC #0 intpin 2 APIC_IO: routing 8254 via 8259 and IOAPIC #0 intpin 0 IP packet filtering initialized, divert disabled, rule-based forwarding disabled, default to accept, logging limited to 100 packets/entry by default SMP: AP CPU #1 Launched! acd0: CDROM at ata0-master using PIO4 Waiting 3 seconds for SCSI devices to settle sa0 at ahc0 bus 0 target 0 lun 0 sa0: Removable Sequential Access SCSI-2 device sa0: 40.000MB/s transfers (20.000MHz, offset 15, 16bit) pass4 at ahc1 bus 0 target 15 lun 0 pass4: Fixed Processor SCSI-2 device pass4: 3.300MB/s transfers pass9 at ahc2 bus 0 target 8 lun 0 pass9: Fixed Processor SCSI-2 device pass9: 3.300MB/s transfers da2 at ahc2 bus 0 target 0 lun 0 da2: Fixed Direct Access SCSI-3 device da2: 40.000MB/s transfers (20.000MHz, offset 31, 16bit), Tagged Queueing Enabled da2: 35003MB (71687340 512 byte sectors: 255H 63S/T 4462C) da5 at ahc2 bus 0 target 3 lun 0 da5: Fixed Direct Access SCSI-3 device da5: 80.000MB/s transfers (40.000MHz, offset 31, 16bit), Tagged Queueing Enabled da5: 35003MB (71687340 512 byte sectors: 255H 63S/T 4462C) da4 at ahc2 bus 0 target 2 lun 0 da4: Fixed Direct Access SCSI-3 device da4: 80.000MB/s transfers (40.000MHz, offset 31, 16bit), Tagged Queueing Enabled da4: 35003MB (71687340 512 byte sectors: 255H 63S/T 4462C) da3 at ahc2 bus 0 target 1 lun 0 da3: Fixed Direct Access SCSI-3 device da3: 80.000MB/s transfers (40.000MHz, offset 31, 16bit), Tagged Queueing Enabled da3: 35003MB (71687340 512 byte sectors: 255H 63S/T 4462C) da9 at ahc2 bus 0 target 12 lun 0 da9: Fixed Direct Access SCSI-3 device da9: 80.000MB/s transfers (40.000MHz, offset 31, 16bit), Tagged Queueing Enabled da9: 35003MB (71687340 512 byte sectors: 255H 63S/T 4462C) da8 at ahc2 bus 0 target 11 lun 0 da8: Fixed Direct Access SCSI-3 device da8: 80.000MB/s transfers (40.000MHz, offset 31, 16bit), Tagged Queueing Enabled da8: 35003MB (71687340 512 byte sectors: 255H 63S/T 4462C) da7 at ahc2 bus 0 target 10 lun 0 da7: Fixed Direct Access SCSI-3 device da7: 80.000MB/s transfers (40.000MHz, offset 31, 16bit), Tagged Queueing Enabled da7: 35003MB (71687340 512 byte sectors: 255H 63S/T 4462C) da6 at ahc2 bus 0 target 9 lun 0 da6: Fixed Direct Access SCSI-3 device da6: 80.000MB/s transfers (40.000MHz, offset 31, 16bit), Tagged Queueing Enabled da6: 35003MB (71687340 512 byte sectors: 255H 63S/T 4462C) da0 at ahc1 bus 0 target 0 lun 0 da0: Fixed Direct Access SCSI-2 device da0: 80.000MB/s transfers (40.000MHz, offset 15, 16bit), Tagged Queueing Enabled da0: 8678MB (17774160 512 byte sectors: 255H 63S/T 1106C) da1 at ahc1 bus 0 target 1 lun 0 da1: Fixed Direct Access SCSI-2 device da1: 80.000MB/s transfers (40.000MHz, offset 15, 16bit), Tagged Queueing Enabled da1: 8678MB (17774160 512 byte sectors: 255H 63S/T 1106C) ch0 at ahc0 bus 0 target 0 lun 1 ch0: Removable Changer SCSI-2 device ch0: 40.000MB/s transfers (20.000MHz, offset 15, 16bit) ch0: 4 slots, 1 drive, 1 picker, 0 portals Mounting root from ufs:/dev/da0s1a To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Thu Jun 14 17:25:10 2001 Delivered-To: freebsd-smp@freebsd.org Received: from ska.bsn (CPE-144-132-209-248.nsw.bigpond.net.au [144.132.209.248]) by hub.freebsd.org (Postfix) with ESMTP id 0C97437B405 for ; Thu, 14 Jun 2001 17:25:07 -0700 (PDT) (envelope-from atrn@zeta.org.au) Received: from hiphop.bsn (hiphop.bsn [192.168.1.8]) by ska.bsn (8.9.3/8.9.3) with ESMTP id KAA79258 for ; Fri, 15 Jun 2001 10:25:05 +1000 (EST) (envelope-from atrn@zeta.org.au) Message-Id: <200106150025.KAA79258@ska.bsn> Date: Fri, 15 Jun 2001 10:25:04 +1000 Content-Type: text/plain; format=flowed; charset=us-ascii X-Mailer: Apple Mail (2.388) From: Andy Newman To: freebsd-smp@FreeBSD.org Mime-Version: 1.0 (Apple Message framework v388) In-Reply-To: <39352.992505301@verdi.nethelp.no> Subject: Re: clock speedup on 4.3 SMP boxes Content-Transfer-Encoding: 7bit Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org > This is not 4.3 specific, we've had the same thing happen with 4.2. A > similar server with only one processor runs NTP extremely stable. > > Steinar Haug, Nethelp consulting, sthaug@nethelp.no I just checked a couple of old Intergraph dual PII machines running 4.2-STABLE and they show it too. They too are mostly lightly loaded with high load on occasions. -- Andy Newman To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message From owner-freebsd-smp Sat Jun 16 8:43:54 2001 Delivered-To: freebsd-smp@freebsd.org Received: from peorth.iteration.net (peorth.iteration.net [208.190.180.178]) by hub.freebsd.org (Postfix) with ESMTP id E475437B403 for ; Sat, 16 Jun 2001 08:43:50 -0700 (PDT) (envelope-from keichii@iteration.net) Received: by peorth.iteration.net (Postfix, from userid 1001) id 29A615945C; Sat, 16 Jun 2001 10:43:43 -0500 (CDT) Date: Sat, 16 Jun 2001 10:43:43 -0500 From: "Michael C . Wu" To: smp@freebsd.org Subject: New books on parallel processes and IPC Message-ID: <20010616104343.A74215@peorth.iteration.net> Reply-To: "Michael C . Wu" Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2.5i X-PGP-Fingerprint: 5025 F691 F943 8128 48A8 5025 77CE 29C5 8FA1 2E20 X-PGP-Key-ID: 0x8FA12E20 Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Hi guys, Just wanted to let you know that these books are on sale at computer.org... http://www.computer.org/cspress/CATALOG/bp07521.htm http://www.computer.org/cspress/CATALOG/bp06587.htm Anyway, it seems that a lot of the IEEE-CS publications are on sale. http://www.computer.org/cspress/CATALOG/rs00173.htm Michael, -- +-----------------------------------------------------------+ | keichii@iteration.net | keichii@freebsd.org | | http://iteration.net/~keichii | Yes, BSD is a conspiracy. | +-----------------------------------------------------------+ To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message