From owner-freebsd-hackers@FreeBSD.ORG Sun Sep 21 07:57:46 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F0BA91065671; Sun, 21 Sep 2008 07:57:45 +0000 (UTC) (envelope-from remko@FreeBSD.org) Received: from websrv01.jr-hosting.nl (websrv01.jr-hosting.nl [78.47.69.233]) by mx1.freebsd.org (Postfix) with ESMTP id 95CAB8FC13; Sun, 21 Sep 2008 07:57:45 +0000 (UTC) (envelope-from remko@FreeBSD.org) Received: from [195.64.94.120] (helo=axantucar.local) by websrv01.jr-hosting.nl with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.69 (FreeBSD)) (envelope-from ) id 1KhJCW-000CHy-Vb; Sun, 21 Sep 2008 09:17:49 +0200 Message-ID: <48D5F518.4040904@FreeBSD.org> Date: Sun, 21 Sep 2008 09:17:44 +0200 From: Remko Lodder User-Agent: Thunderbird 2.0.0.16 (Macintosh/20080707) MIME-Version: 1.0 To: Volker References: <48D51FAF.70603@vwsoft.com> In-Reply-To: <48D51FAF.70603@vwsoft.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: "Carlos A. M. dos Santos" , freebsd-hackers@freebsd.org, Benjie Chen , "freebsd-hardware@freebsd.org" Subject: Re: Interrupts issues X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 21 Sep 2008 07:57:46 -0000 Volker wrote: > On 12/23/-58 20:59, Carlos A. M. dos Santos wrote: >> On Fri, Sep 19, 2008 at 12:04 PM, Benjie Chen wrote: >>> Hi FreeBSD hackers: >>> >>> I have two Dell workstations that I recently added FreeBSD 6.2 on. One >>> is a Precision T3400, one is an Inspiron 530. Nothing fancy. Installed >>> FBsd. Everything else is fine except both machines have interrupt >>> storm issues: one core (both dual core) is 100% servicing interrupts. >>> On the Precision, it's irq20 atapci, on Inspiron it's irq19 uhci. The >>> other core is fine and both machines run well otherwise. >>> >>> I saw several recent posts on the net about some of these issues and >>> did not find a resolution. It seems unlikely that it's just a ata or >>> usb issue since both machines happen to have the same problem. >>> >>> Any thoughts? >> Please provide the output of "dmesg" after a boot in verbose mode. >> This may help the maintainers to understand your problem and give you >> additional instructions. >> >> Do you have any special reason to use FreeBSD 6.2? It is a rather old >> version, ... > > 6.2 has already been EOL'd in May. > _______________________________________________ I need to join the club, my machine starts doing interrupt storms after an uptime of ${random} on the IRQ19 (atapci0) thingy. Next time I'll boot the machine I'll try to make it a verbose boot. It's a production machine which cannot restart on demand ofcourse :) Note: First the problems occured much more, this was because the usb interfaces on the machine co-existed with the atapci0 interface, after disabling usb on the system, it took a lot longer to trigger the interrupt storm (50 days if I recall correctly). Cheers remko Regular dmesg: Copyright (c) 1992-2008 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 7.1-PRERELEASE #7: Thu Sep 18 09:53:16 CEST 2008 root@xxxxx.elvandar.org:/usr/obj/usr/src/sys/xxxxx Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: AMD Athlon(tm) 64 X2 Dual Core Processor 5600+ (2799.99-MHz K8-class CPU) Origin = "AuthenticAMD" Id = 0x40f33 Stepping = 3 Features=0x178bfbff Features2=0x2001 AMD Features=0xea500800 AMD Features2=0x1f Cores per package: 2 usable memory = 2103840768 (2006 MB) avail memory = 2028867584 (1934 MB) ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 This module (opensolaris) contains code covered by the Common Development and Distribution License (CDDL) see http://opensolaris.org/os/licensing/opensolaris_license/ ioapic0 irqs 0-23 on motherboard kbd1 at kbdmux0 acpi0: on motherboard acpi0: [ITHREAD] acpi0: Power Button (fixed) acpi0: reservation of 0, a0000 (3) failed acpi0: reservation of 100000, 7df00000 (3) failed Timecounter "ACPI-safe" frequency 3579545 Hz quality 850 acpi_timer0: <32-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib1: at device 1.0 on pci0 pci1: on pcib1 vgapci0: port 0xc000-0xc0ff mem 0xfc000000-0xfdffffff,0xfe9f0000-0xfe9fffff,0xfe800000-0xfe8fffff irq 18 at device 5.0 on pci1 pci1: at device 5.2 (no driver attached) pcib2: at device 7.0 on pci0 pci2: on pcib2 re0: port 0xd800-0xd8ff mem 0xfeaff000-0xfeafffff irq 19 at device 0.0 on pci2 re0: turning off MSI enable bit. re0: Chip rev. 0x38000000 re0: MAC rev. 0x00000000 miibus0: on re0 rgephy0: PHY 1 on miibus0 rgephy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto re0: Ethernet address: 00:1d:92:b1:a3:2f re0: [FILTER] atapci0: port 0xb000-0xb007,0xa000-0xa003,0x9000-0x9007,0x8000-0x8003,0x7000-0x700f mem 0xfe7ff800-0xfe7ffbff irq 22 at device 18.0 on pci0 atapci0: [ITHREAD] atapci0: AHCI Version 01.10 controller with 4 ports detected ata2: on atapci0 ata2: [ITHREAD] ata3: on atapci0 ata3: [ITHREAD] ata4: on atapci0 ata4: [ITHREAD] ata5: on atapci0 ata5: [ITHREAD] pci0: at device 19.0 (no driver attached) pci0: at device 19.1 (no driver attached) pci0: at device 19.2 (no driver attached) pci0: at device 19.3 (no driver attached) pci0: at device 19.4 (no driver attached) pci0: at device 19.5 (no driver attached) pci0: at device 20.0 (no driver attached) atapci1: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xff00-0xff0f at device 20.1 on pci0 ata0: on atapci1 ata0: [ITHREAD] isab0: at device 20.3 on pci0 isa0: on isab0 pcib3: at device 20.4 on pci0 pci3: on pcib3 acpi_button0: on acpi0 sio0: configured irq 3 not in bitmap of probed irqs 0 sio0: port may not be enabled sio0: configured irq 3 not in bitmap of probed irqs 0 sio0: port may not be enabled sio0: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 flags 0x10 on acpi0 sio0: type 16550A sio0: [FILTER] atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] atkbd0: [ITHREAD] cpu0: on acpi0 acpi_throttle0: on cpu0 acpi_throttle0: CLK_VAL field overlaps THT_EN bit device_attach: acpi_throttle0 attach returned 6 powernow0: on cpu0 cpu1: on acpi0 powernow1: on cpu1 orm0: at iomem 0xcd800-0xce7ff on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 WARNING: ZFS is considered to be an experimental feature in FreeBSD. Timecounters tick every 1.000 msec ZFS filesystem version 6 ZFS storage pool version 6 ad4: 381554MB at ata2-master SATA300 ad6: 381554MB at ata3-master SATA300 SMP: AP CPU #1 Launched! Trying to mount root from zfs:tank/root -- /"\ Best regards, | remko@FreeBSD.org \ / Remko Lodder | remko@EFnet X http://www.evilcoder.org/ | / \ ASCII Ribbon Campaign | Against HTML Mail and News From owner-freebsd-hackers@FreeBSD.ORG Sun Sep 21 12:15:57 2008 Return-Path: Delivered-To: freebsd-hackers@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 93AAA106564A for ; Sun, 21 Sep 2008 12:15:57 +0000 (UTC) (envelope-from piso@southcross.wired.org) Received: from mail.oltrelinux.com (krisma.oltrelinux.com [194.242.226.43]) by mx1.freebsd.org (Postfix) with ESMTP id 56F9B8FC14 for ; Sun, 21 Sep 2008 12:15:56 +0000 (UTC) (envelope-from piso@southcross.wired.org) Received: from southcross.wired.org (unknown [94.36.140.190]) by mail.oltrelinux.com (Postfix) with SMTP id F2F1911AE45 for ; Sun, 21 Sep 2008 13:52:57 +0200 (CEST) Received: (qmail 61617 invoked by uid 1001); 21 Sep 2008 13:55:45 +0200 Date: Sun, 21 Sep 2008 13:55:45 +0200 From: Paolo Pisati To: freebsd-hackers@FreeBSD.org Message-ID: <20080921115545.GA61452@tin.it> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.17 (2007-11-01) X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at krisma.oltrelinux.com Cc: Subject: smbus & i2c: why i2c is not enabled on ich? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 21 Sep 2008 12:15:57 -0000 Any reason why i2c mode in not enable in ichsmb? ichsmb0@pci0:0:31:3: class=0x0c0500 card=0x82d81043 chip=0x266a8086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = '82801FB (ICH6) SMBus Controller' class = serial bus subclass = SMBus piso@nano:~/eeebsd >sudo pciconf -rb pci0:0:31:3: 0x40 01 piso@nano:~/eeebsd >sudo ./scan_smbus res: 0 slave = 0x44 data = res: 0 slave = 0x50 data = res: 0 slave = 0x69 data = res: 0 slave = 0xC4 data = res: 0 slave = 0xD0 data = res: 0 slave = 0xE9 data = piso@nano:~/eeebsd >sudo pciconf -wb pci0:0:31:3: 0x40 5 piso@nano:~/eeebsd >sudo pciconf -rb pci0:0:31:3: 0x40 05 piso@nano:~/eeebsd >sudo ./scan_smbus res: 0 slave = 0x44 data = FF FF FF FF res: 0 slave = 0x50 data = 0A 60 40 00 05 30 45 00 82 08 00 00 0C 04 res: 0 slave = 0x69 data = FF F7 00 00 01 0F 07 E0 18 46 1B 24 D8 63 00 res: 0 slave = 0xC4 data = FF FF FF FF res: 0 slave = 0xD0 data = 0A 60 40 00 05 30 45 00 82 08 00 00 0C 04 res: 0 slave = 0xE9 data = FF F7 00 00 01 0F 07 E0 18 46 1B 24 D8 63 00 FYI this is on an asus eeepc. -- bye, P. From owner-freebsd-hackers@FreeBSD.ORG Sun Sep 21 13:55:08 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C3B251065676; Sun, 21 Sep 2008 13:55:08 +0000 (UTC) (envelope-from nox@saturn.kn-bremen.de) Received: from gwyn.kn-bremen.de (gwyn.kn-bremen.de [212.63.36.242]) by mx1.freebsd.org (Postfix) with ESMTP id 496FB8FC1B; Sun, 21 Sep 2008 13:55:08 +0000 (UTC) (envelope-from nox@saturn.kn-bremen.de) Received: by gwyn.kn-bremen.de (Postfix, from userid 10) id E919B191A4A; Sun, 21 Sep 2008 15:28:00 +0200 (CEST) Received: from saturn.kn-bremen.de (noident@localhost [127.0.0.1]) by saturn.kn-bremen.de (8.14.2/8.13.8) with ESMTP id m8LDQrVB065878; Sun, 21 Sep 2008 15:26:53 +0200 (CEST) (envelope-from nox@saturn.kn-bremen.de) Received: (from nox@localhost) by saturn.kn-bremen.de (8.14.2/8.13.6/Submit) id m8LDQq16065877; Sun, 21 Sep 2008 15:26:52 +0200 (CEST) (envelope-from nox) Date: Sun, 21 Sep 2008 15:26:52 +0200 (CEST) From: Juergen Lock Message-Id: <200809211326.m8LDQq16065877@saturn.kn-bremen.de> To: jhb@freebsd.org X-Newsgroups: local.list.freebsd.hackers In-Reply-To: <200809171628.52406.jhb@freebsd.org> References: <200809171131.30819.jhb@freebsd.org> Organization: home X-Mailman-Approved-At: Sun, 21 Sep 2008 13:59:41 +0000 Cc: freebsd-hackers@freebsd.org, Navdeep Parhar Subject: Re: kgdb's add-kld broken on amd64 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 21 Sep 2008 13:55:08 -0000 In article <200809171628.52406.jhb@freebsd.org> you write: >On Wednesday 17 September 2008 03:51:02 pm Navdeep Parhar wrote: >> Hello John, >> >> The patch did NOT fix the problem. Read on for more.... >> >> On Wed, Sep 17, 2008 at 8:31 AM, John Baldwin wrote: >> > On Tuesday 16 September 2008 04:07:46 pm Navdeep Parhar wrote: >> >> Hello everyone, >> >> >> >> The add-kld command in kgdb does not work as expected on amd64 >> >> (I'm using a recent HEAD, problem may affect others too). It uses >> >> the same address for all sections: >> >> >> >> (kgdb) add-kld if_cxgb.ko >> >> add symbol table from file "/boot/kernel/if_cxgb.ko" at >> >> .text_addr = 0xffffffff81022000 >> >> .rodata_addr = 0xffffffff81022000 >> >> .rodata.str1.8_addr = 0xffffffff81022000 >> >> .rodata.str1.1_addr = 0xffffffff81022000 >> >> set_modmetadata_set_addr = 0xffffffff81022000 >> >> set_sysctl_set_addr = 0xffffffff81022000 >> >> set_sysinit_set_addr = 0xffffffff81022000 >> >> set_sysuninit_set_addr = 0xffffffff81022000 >> >> .data_addr = 0xffffffff81022000 >> >> .bss_addr = 0xffffffff81022000 >> >> (y or n) >> >> >> >> This is not correct. The .text section's address is OK but the >> >> others are not. >> >> >> >> The problem seems to be that all amd64 kernel objects have VMA set >> >> to 0 for all sections. add_section() in gnu/usr.bin/gdb/kgdb/kld.c >> >> uses this VMA to adjust the address of the section: >> >> >> >> address = asi->base_addr + bfd_get_section_vma(bfd, sect); >> >> >> >> objdump -h shows that the userland objects on amd64 and all >> >> objects (kernel + userland) on i386 set VMA. It is only the >> >> kernel objects on amd64 that have VMA = 0. (sample output from >> >> amd64 and i386 machines appended at the end) >> >> >> >> For the time being I've patched kgdb to consider the file offset >> >> and not the VMA while calculating the section address. It seems >> >> to work but is probably not the right way to fix the problem. >> >> >> >> Any thoughts? >> > >> > Hmm, I wonder if this is because on amd64 modules are .o's rather >than .so's. >> > It is. File offset isn't quite right. Instead, the way >> > sys/kern/link_elf_obj.c works is that it just loads the PROGBITS (text, >code, >> > etc.) and NOBITS (bss) sections in the order they are in the file and >> > concatenates them. So, the relocation logic in kgdb will need to be >updated >> > to recognize a .o vs .so and apply that algorithm for .o files. >> > >> > Actually, what I've done is to replace the home-rolled section relocation >> > stuff with the gdb primitives that the solib code in gdb uses. It works >here >> > on i386, and hopefully this will fix this as this is how the sharedlibrary >> > kld stuff is doing the relocations: >> >> I had to modify the patch a bit as add-kld -> build_section_table() -> >xfree() >> was a bad free and led to bus errors or segv: >> >> - struct section_table *sections, *sections_end, *s; >> + struct section_table *sections = NULL, *sections_end = NULL, *s; >> >> After fixing that, add-kld still wouldn't pick up the correct >> addresses: >> >> (kgdb) add-kld if_cxgb.ko >> add symbol table from file "/boot/kernel/if_cxgb.ko" at >> .text_addr = 0xffffffff81022000 >> .rodata_addr = 0xffffffff81022000 >> .rodata.str1.8_addr = 0xffffffff81022000 >> .rodata.str1.1_addr = 0xffffffff81022000 >> set_modmetadata_set_addr = 0xffffffff81022000 >> set_sysctl_set_addr = 0xffffffff81022000 >> set_sysinit_set_addr = 0xffffffff81022000 >> set_sysuninit_set_addr = 0xffffffff81022000 >> .data_addr = 0xffffffff81022000 >> .bss_addr = 0xffffffff81022000 >> >> With the patch the section relocation is still taking place based >> on the VMA (which is 0 for amd64 modules as I pointed out >> earlier). So the behaviour is no different than before. If I >> read the code right, each section's addr is calculated as: >> >> load_kld -> build_section_table -> add_to_section_table >> >> This sets it to bfd_section_vma(abfd, asect), which is no good >> for amd64 kernel modules. > >Well, this means gdb can't handle loading .o's, though I guess that is to be >expected. :( Even if I fix add-kld there's probably no way I can easily fix >the sharedlibrary stuff w/o ripping gdb itself up a bunch. I haven't looked at what the gdb patch exactly does, but I was able to load klds the old way on amd64 using a patched asf(8) as posted here: http://lists.freebsd.org/pipermail/freebsd-amd64/2008-May/011062.html Better than nothing I guess... :) Juergen From owner-freebsd-hackers@FreeBSD.ORG Sun Sep 21 20:51:48 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F25BF1065670 for ; Sun, 21 Sep 2008 20:51:48 +0000 (UTC) (envelope-from ticso@cicely7.cicely.de) Received: from raven.bwct.de (raven.bwct.de [85.159.14.73]) by mx1.freebsd.org (Postfix) with ESMTP id 78C098FC14 for ; Sun, 21 Sep 2008 20:51:42 +0000 (UTC) (envelope-from ticso@cicely7.cicely.de) Received: from cicely5.cicely.de ([10.1.1.7]) by raven.bwct.de (8.13.4/8.13.4) with ESMTP id m8LKpeBt083686 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK); Sun, 21 Sep 2008 22:51:40 +0200 (CEST) (envelope-from ticso@cicely7.cicely.de) Received: from cicely7.cicely.de (cicely7.cicely.de [10.1.1.9]) by cicely5.cicely.de (8.14.2/8.14.2) with ESMTP id m8LKpbJd069956 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Sun, 21 Sep 2008 22:51:37 +0200 (CEST) (envelope-from ticso@cicely7.cicely.de) Received: from cicely7.cicely.de (localhost [127.0.0.1]) by cicely7.cicely.de (8.14.2/8.14.2) with ESMTP id m8LKpbPi021774; Sun, 21 Sep 2008 22:51:37 +0200 (CEST) (envelope-from ticso@cicely7.cicely.de) Received: (from ticso@localhost) by cicely7.cicely.de (8.14.2/8.14.2/Submit) id m8LKpbh8021773; Sun, 21 Sep 2008 22:51:37 +0200 (CEST) (envelope-from ticso) Date: Sun, 21 Sep 2008 22:51:37 +0200 From: Bernd Walter To: Paolo Pisati Message-ID: <20080921205137.GM93308@cicely7.cicely.de> References: <20080921115545.GA61452@tin.it> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20080921115545.GA61452@tin.it> X-Operating-System: FreeBSD cicely7.cicely.de 7.0-STABLE i386 User-Agent: Mutt/1.5.11 X-Spam-Status: No, score=-4.3 required=5.0 tests=ALL_TRUSTED=-1.8, AWL=0.065, BAYES_00=-2.599 autolearn=ham version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on spamd.cicely.de Cc: freebsd-hackers@freebsd.org Subject: Re: smbus & i2c: why i2c is not enabled on ich? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: ticso@cicely.de List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 21 Sep 2008 20:51:49 -0000 On Sun, Sep 21, 2008 at 01:55:45PM +0200, Paolo Pisati wrote: > > Any reason why i2c mode in not enable in ichsmb? Because the controller is a SMB controller and not a I2C one. SMB is more specific than I2C in that it defines complete I2C sequences. With SMB you don't have the individual control over all I2C phases. You can do SMB with an I2C controller, but you can't do raw I2C with an SMB controller. Use SMB to address your devices - SMB is good enough to handle most I2C cases. > ichsmb0@pci0:0:31:3: class=0x0c0500 card=0x82d81043 chip=0x266a8086 rev=0x04 hdr=0x00 > vendor = 'Intel Corporation' > device = '82801FB (ICH6) SMBus Controller' > class = serial bus > subclass = SMBus > > piso@nano:~/eeebsd >sudo pciconf -rb pci0:0:31:3: 0x40 > 01 > piso@nano:~/eeebsd >sudo ./scan_smbus > res: 0 slave = 0x44 data = > res: 0 slave = 0x50 data = > res: 0 slave = 0x69 data = > res: 0 slave = 0xC4 data = > res: 0 slave = 0xD0 data = > res: 0 slave = 0xE9 data = > piso@nano:~/eeebsd >sudo pciconf -wb pci0:0:31:3: 0x40 5 > piso@nano:~/eeebsd >sudo pciconf -rb pci0:0:31:3: 0x40 > 05 > piso@nano:~/eeebsd >sudo ./scan_smbus > res: 0 slave = 0x44 data = FF FF FF FF > res: 0 slave = 0x50 data = 0A 60 40 00 05 30 45 00 82 08 00 00 0C 04 > res: 0 slave = 0x69 data = FF F7 00 00 01 0F 07 E0 18 46 1B 24 D8 63 00 > res: 0 slave = 0xC4 data = FF FF FF FF > res: 0 slave = 0xD0 data = 0A 60 40 00 05 30 45 00 82 08 00 00 0C 04 > res: 0 slave = 0xE9 data = FF F7 00 00 01 0F 07 E0 18 46 1B 24 D8 63 00 > > FYI this is on an asus eeepc. > -- > bye, > P. > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" -- B.Walter http://www.bwct.de Modbus/TCP Ethernet I/O Baugruppen, ARM basierte FreeBSD Rechner uvm. From owner-freebsd-hackers@FreeBSD.ORG Mon Sep 22 12:40:49 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 738AD106564A for ; Mon, 22 Sep 2008 12:40:49 +0000 (UTC) (envelope-from christophe.cap@gdnmail.net) Received: from omta0106.mta.everyone.net (sitemail3.everyone.net [216.200.145.37]) by mx1.freebsd.org (Postfix) with ESMTP id 646E48FC16 for ; Mon, 22 Sep 2008 12:40:49 +0000 (UTC) (envelope-from christophe.cap@gdnmail.net) Received: from dm24.mta.everyone.net (sj1-slb03-gw2 [172.16.1.96]) by omta0106.mta.everyone.net (Postfix) with ESMTP id 77128475155 for ; Mon, 22 Sep 2008 05:09:41 -0700 (PDT) X-Eon-Dm: dm24 Received: by resin17.mta.everyone.net (EON-PICKUP) id resin17.48d73e35.af0; Mon, 22 Sep 2008 05:09:41 -0700 Message-Id: <20080922050941.88CAFE41@resin17.mta.everyone.net> Date: Mon, 22 Sep 2008 05:09:41 -0700 From: "Christophe Cap" To: X-Eon-Sig: AQDXCe5I14sFtLXx2gEAAAAB,23f04e49b4acd20410319fbe93456f9d X-Originating-Ip: [81.246.43.153] MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: Subject: VirtualBox looks for FreeBSD developer X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: christophe.cap@gdnmail.net List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 22 Sep 2008 12:40:49 -0000 Hey, I stumbled upon this cry for help from Sun : [1]http://groups.google.com/group/mailing.freebsd.ports/browse_thread/ thread/5d525a3d040e0a0e?pli=1 Is anybody looking into this ? ciao! Christophe --- Truly great madness cannot be achieved without significant intelligence. --- _________________________________________________________________ GameDev.net Email Service - "Plenty of 1's and 0's" References 1. http://groups.google.com/group/mailing.freebsd.ports/browse_thread/thread/5d525a3d040e0a0e?pli=1 From owner-freebsd-hackers@FreeBSD.ORG Mon Sep 22 20:33:28 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 968C1106566C for ; Mon, 22 Sep 2008 20:33:28 +0000 (UTC) (envelope-from max@love2party.net) Received: from moutng.kundenserver.de (moutng.kundenserver.de [212.227.126.171]) by mx1.freebsd.org (Postfix) with ESMTP id 218E78FC1A for ; Mon, 22 Sep 2008 20:33:28 +0000 (UTC) (envelope-from max@love2party.net) Received: from vampire.homelinux.org (dslb-088-066-030-029.pools.arcor-ip.net [88.66.30.29]) by mrelayeu.kundenserver.de (node=mrelayeu7) with ESMTP (Nemesis) id 0ML2xA-1Khs623A91-0002vV; Mon, 22 Sep 2008 22:33:26 +0200 Received: (qmail 57921 invoked from network); 22 Sep 2008 20:33:26 -0000 Received: from fbsd8.laiers.local (192.168.4.151) by laiers.local with SMTP; 22 Sep 2008 20:33:26 -0000 From: Max Laier Organization: FreeBSD To: freebsd-current@freebsd.org Date: Mon, 22 Sep 2008 22:33:25 +0200 User-Agent: KMail/1.10.1 (FreeBSD/8.0-CURRENT; KDE/4.1.1; i386; ; ) MIME-Version: 1.0 Content-Type: Multipart/Mixed; boundary="Boundary-00=_WEA2ISSM6C76Uw/" Message-Id: <200809222233.26053.max@love2party.net> X-Provags-ID: V01U2FsdGVkX18BCe3wNZxd9yH1Hr7lHt19vz6f3OM0dvPQu87 SnkZ85IrSUMXRzG5SRqDru3gEgDl+l0VAtfxDkuZ9pw6LiYWxJ yCFi/NTbnn8kTva9ANZ4w== Cc: freebsd-hackers@freebsd.org Subject: cosum: Checkout verification PoC X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 22 Sep 2008 20:33:28 -0000 --Boundary-00=_WEA2ISSM6C76Uw/ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Content-Disposition: inline Hi, the attached script will generate md5 and sha256 checksums of a checkout and try to find the corresponding svn-revision. This can help to verify that your checkout from cvsupX.yy.freebsd.org is authentic. Not that there is reason to believe that we have compromised cvsup-servers. This is just something I've been toying with and wanted to let you know to see if people find the idea interesting. I'd also be interested in reviews of the concept (note that I know that https would be a good idea, I just cba to setup a certificate). The coverage currently is head and stable/{6,7} svn revision 179451:183186 (i.e. since the first svn commit up to "2008-09-19 16:51:41 +0200". I don't yet have a cronjob in place to generate new checksums, so this will become less useful quick. If people do find it interesting, however, I could certainly roll something. As you can see, the script is ready to checksum cvs and svn checkouts. If you obtain your checkout from some local git/hg/svk/... mirror you must modify the find excludes accordingly. Let me know what you think. -- /"\ Best regards, | mlaier@freebsd.org \ / Max Laier | ICQ #67774661 X http://pf4freebsd.love2party.net/ | mlaier@EFnet / \ ASCII Ribbon Campaign | Against HTML Mail and News --Boundary-00=_WEA2ISSM6C76Uw/ Content-Type: text/plain; charset="us-ascii"; name="cosum" Content-Transfer-Encoding: 7bit Content-Disposition: inline; filename="cosum" #!/bin/sh BASEURL="http://laiers.net/cosum/data/md5" tempfoo=`basename $0` TMPFILE=`mktemp -t ${tempfoo}` || exit 1 MD5SUM=`find -s . -type f -not -path "*/.svn/*" -not -path "*/CVS/*" \ -exec cat {} + | md5` SHA256SUM=`find -s . -type f -not -path "*/.svn/*" -not -path "*/CVS/*" \ -exec cat {} + | sha256` MD5DIR=`echo ${MD5SUM} | cut -c 1-2` if ! fetch -o ${TMPFILE} ${BASEURL}/${MD5DIR}/${MD5SUM} ; then echo "No corresponding md5sum found, try again in a bit" >&2 exit 1 fi ORIG_MD5SUM=`cat ${TMPFILE} | grep ^md5 | cut -d":" -f 2` ORIG_SHA256SUM=`cat ${TMPFILE} | grep ^sha256 | cut -d":" -f 2` if [ "${MD5SUM}" != "${ORIG_MD5SUM}" ]; then echo "md5 mismatch - something went terribly wrong!" >&2 exit 1 fi if [ "${SHA256SUM}" != "${ORIG_SHA256SUM}" ]; then echo "sha256 mismatch, but same md5 - please report this!" >&2 cat ${TMPFILE} exit 1 fi echo "Your checkout seems to be:" cat ${TMPFILE} --Boundary-00=_WEA2ISSM6C76Uw/-- From owner-freebsd-hackers@FreeBSD.ORG Tue Sep 23 12:37:01 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3EAAE106566B; Tue, 23 Sep 2008 12:37:01 +0000 (UTC) (envelope-from fabien.thomas@netasq.com) Received: from netasq.netasq.com (netasq.netasq.com [213.30.137.178]) by mx1.freebsd.org (Postfix) with ESMTP id 89E528FC1F; Tue, 23 Sep 2008 12:37:00 +0000 (UTC) (envelope-from fabien.thomas@netasq.com) Received: from [10.20.1.5] (unknown [10.0.0.126]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (Client did not present a certificate) by netasq.netasq.com (Postfix) with ESMTP id AE70E2E65E; Tue, 23 Sep 2008 14:04:11 +0200 (CEST) Message-Id: <02117AD8-A70C-4B2A-9EA1-56A4847D845F@netasq.com> From: Fabien Thomas To: FreeBSD Stable List , FreeBSD Hackers In-Reply-To: <84dead720807122205i33bf6eb0p998d473df9e52304@mail.gmail.com> Content-Type: multipart/signed; boundary=Apple-Mail-30--948915904; micalg=sha1; protocol="application/pkcs7-signature" Mime-Version: 1.0 (Apple Message framework v929.2) Date: Tue, 23 Sep 2008 14:03:39 +0200 References: <84dead720807122205i33bf6eb0p998d473df9e52304@mail.gmail.com> X-Mailer: Apple Mail (2.929.2) X-Mailman-Approved-At: Tue, 23 Sep 2008 12:44:50 +0000 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: Subject: Re: Announcement: PmcTools callchain capture for RELENG_7 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 23 Sep 2008 12:37:01 -0000 --Apple-Mail-30--948915904 Content-Type: text/plain; charset=ISO-8859-1; format=flowed; delsp=yes Content-Transfer-Encoding: quoted-printable Hello, A new patch is available that was done just after dtrace backport. You can find it like the previous one on the pmc wiki. It also include some new bugfix from head. Fabien Le 13 juil. 08 =E0 07:05, Joseph Koshy a =E9crit : > Hello List(s), > > I am very pleased to announce a patch, by Fabien Thomas, that brings > PmcTools' callchain capture features to 7-STABLE. Thank you, Fabien! > > The patch is linked to from the PmcTools wiki page: > http://wiki.freebsd.org/PmcTools. > > The current file name is: "patch-callchain-FreeBSD-7-=20 > STABLE-2008-07-12.gz". > As the file name indicates, it should apply against a 7-STABLE tree of > 2008-07-12 > vintage. > > To apply the patch: > % cd /home/src-7x # or whereever your RELENG_7 tree resides > % patch < PATCH-FILE > > Then you should follow the full procedure to update userland > and kernel from source as spelled out in src/UPDATING. > > Please note that HWPMC(4) log files that contain callchain =20 > information are > not binary compatible with prior versions of pmc(3) and pmcstat(8). > > Please do test on your systems and let Fabien and me know > how you fared. > > Koshy > --Apple-Mail-30--948915904-- From owner-freebsd-hackers@FreeBSD.ORG Tue Sep 23 13:50:45 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CDD2A1065674 for ; Tue, 23 Sep 2008 13:50:45 +0000 (UTC) (envelope-from rea-fbsd@codelabs.ru) Received: from 0.mx.codelabs.ru (0.mx.codelabs.ru [144.206.177.45]) by mx1.freebsd.org (Postfix) with ESMTP id 6D36C8FC08 for ; Tue, 23 Sep 2008 13:50:45 +0000 (UTC) (envelope-from rea-fbsd@codelabs.ru) DomainKey-Signature: a=rsa-sha1; q=dns; c=simple; s=one; d=codelabs.ru; h=Received:Date:From:To:Cc:Subject:Message-ID:MIME-Version:Content-Type:Content-Disposition:Sender; b=kxEvCuYnD0nXdBw26g6FECUhz5IgiMdpbzfAkms4W4aWUf4ZytcDqjvfljEv5f5DB6rRknHeu0HfHNVWX4DKwpboCHwpONaoMysxz1P+DoPlSk22ytQ5sTd2OViFx7YfXJ9Vkw+Goj6sczOWfH+L79lwbCSuHo1ZmMBgw3Og17c=; Received: from void.codelabs.ru (void.codelabs.ru [144.206.177.25]) by 0.mx.codelabs.ru with esmtpsa (TLSv1:AES256-SHA:256) id 1Ki7zj-000N0J-RX; Tue, 23 Sep 2008 17:31:59 +0400 Date: Tue, 23 Sep 2008 17:31:58 +0400 From: Eygene Ryabinkin To: freebsd-hackers@freebsd.org Message-ID: MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="JP+T4n/bALQSJXh8" Content-Disposition: inline Sender: rea-fbsd@codelabs.ru Cc: bug-followup@freebsd.org Subject: ports/126853: ports-mgmt/portaudit: speed up audit of installed packages X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 23 Sep 2008 13:50:45 -0000 --JP+T4n/bALQSJXh8 Content-Type: text/plain; charset=koi8-r Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Good day. A while ago I had created the new utility that serves as VuXML filter for the installed packages: http://www.freebsd.org/cgi/query-pr.cgi?pr=3Dports/126853 My primary intention was to speed up the process of auditing the vulnerable ports: I needed to run portaudit checks with Nagios and to avoid large timeouts. The new utility is called pkg_audit and it serves as a simple text filter: on input it takes the full VuXML feed and on output it puts VuXML entries that matches ports that are installed in the system with port version specification substituted with the actual port versions. No harm is done to the actual poartudit -- if pkg_audit is missing, old code path is activated. If someone is interested and will be able to test -- I am all ears. Thanks! --=20 Eygene _ ___ _.--. # \`.|\..----...-'` `-._.-'_.-'` # Remember that it is hard / ' ` , __.--' # to read the on-line manual =20 )/' _/ \ `-_, / # while single-stepping the kernel. `-'" `"\_ ,_.-;_.-\_ ', fsc/as # _.-'_./ {_.' ; / # -- FreeBSD Developers handbook=20 {_.-``-' {_/ # --JP+T4n/bALQSJXh8 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (FreeBSD) iEYEARECAAYFAkjY784ACgkQthUKNsbL7YhcBACgkxuLO+Hm23w+yRsbP07VfmM+ 1poAn0kvc5fWx4a9OTcfO203lDawKRXn =BZFN -----END PGP SIGNATURE----- --JP+T4n/bALQSJXh8-- From owner-freebsd-hackers@FreeBSD.ORG Tue Sep 23 16:06:51 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 78B011065675 for ; Tue, 23 Sep 2008 16:06:51 +0000 (UTC) (envelope-from freebsd-hackers@wheelhouse.org) Received: from mail.nearlyfreespeech.net (x1.phxe.nearlyfreespeech.net [208.94.116.235]) by mx1.freebsd.org (Postfix) with ESMTP id 53CF58FC1C for ; Tue, 23 Sep 2008 16:06:51 +0000 (UTC) (envelope-from freebsd-hackers@wheelhouse.org) Received: from [10.0.1.201] (78.193.33.65.cfl.res.rr.com [65.33.193.78]) by mail.nearlyfreespeech.net (Postfix) with ESMTPSA id 4DFD1EBC77 for ; Tue, 23 Sep 2008 08:51:29 -0700 (MST) Message-Id: From: Jeff Wheelhouse To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Date: Tue, 23 Sep 2008 11:51:28 -0400 X-Mailer: Apple Mail (2.929.2) Subject: panic: lockmgr on FreeBSD 7.0-RELEASE-p4 amd64 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 23 Sep 2008 16:06:51 -0000 Got the following panic overnight: panic: lockmgr: thread 0xffffff0053cda680, not exclusive lock holder 0xffffff002d7da680 unlocking cpuid = 0 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a panic() at panic+0x17a _lockmgr() at _lockmgr+0x872 VOP_UNLOCK_APV() at VOP_UNLOCK_APV+0x46 null_unlock() at null_unlock+0xff VOP_UNLOCK_APV() at VOP_UNLOCK_APV+0x46 nullfs_mount() at nullfs_mount+0x244 vfs_donmount() at vfs_donmount+0xe4d nmount() at nmount+0xa5 syscall() at syscall+0x254 Xfast_syscall() at Xfast_syscall+0xab --- syscall (378, FreeBSD ELF64, nmount), rip = 0x206845ac, rsp = 0x7fffffffdfb8, rbp = 0x7fffffffdfc0 --- I've done some searches and "not exclusive lock holder" has been seen before, but I didn't find any previous reports related to nullfs with a stack trace at all like this on FreeBSD 7. This machine is diskless and thus cannot store a kernel dump. Ideas/ suggestions for fixes, causes or debugging steps? The kernel is amd64, with config shown below. Thanks, Jeff include GENERIC device carp device pf device pflog device pfsync options SW_WATCHDOG options DEVICE_POLLING options ALTQ options ALTQ_CBQ options ALTQ_RED options ALTQ_RIO options ALTQ_HFSC options ALTQ_PRIQ options ALTQ_NOPCC options KDB options KDB_UNATTENDED options KDB_TRACE options DDB options BREAK_TO_DEBUGGER From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 24 02:22:38 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E9D3A1065681 for ; Wed, 24 Sep 2008 02:22:38 +0000 (UTC) (envelope-from alec-keyword-freebsd.org.a6e2e4@SetFilePointer.com) Received: from hamlet.setfilepointer.com (hamlet.SetFilePointer.com [63.224.10.2]) by mx1.freebsd.org (Postfix) with SMTP id 963D88FC08 for ; Wed, 24 Sep 2008 02:22:38 +0000 (UTC) (envelope-from alec-keyword-freebsd.org.a6e2e4@SetFilePointer.com) Received: (qmail 43899 invoked by uid 4250); 23 Sep 2008 20:55:57 -0500 Received: by hamlet.SetFilePointer.com (tmda-sendmail, from uid 4250); Tue, 23 Sep 2008 20:55:57 -0500 Date: Tue, 23 Sep 2008 20:55:56 -0500 To: Rink Springer Message-ID: <20080924015556.GN23927@hamlet.SetFilePointer.com> References: <20080803161057.GB35301@rink.nu> <20080809193233.GC19885@rink.nu> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="FhKpTYimqQF2+bfE" Content-Disposition: inline In-Reply-To: <20080809193233.GC19885@rink.nu> User-Agent: Mutt/1.4.2.3i X-Delivery-Agent: TMDA/1.1.12 (Macallan) From: Alec Kloss X-Primary-Address: alec@SetFilePointer.com Cc: freebsd-hackers@freebsd.org, Ivan Voras Subject: Re: Patch for working AMD Geode CS5530 audio driver on HEAD X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Sep 2008 02:22:39 -0000 --FhKpTYimqQF2+bfE Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 2008-08-09 21:32, Rink Springer wrote: > Hi Ivan, >=20 > On Sat, Aug 09, 2008 at 07:36:07PM +0200, Ivan Voras wrote: > > This patch looks like it needs something. Can you post or link to the= =20 > > entire driver please? >=20 > Sure - this was already outlined in the original thread, but have a look > at http://63.249.85.132/gx_audio/index.html - the driver there works. > You need minor tweaks to the Makefile, these can be found in > http://setfilepointer.com/pub/geode/ns_geode.diff. >=20 > Regards, I just got around to playing with this again, to no avail: **** geode Probe devid 20821022 classid 00000010! **** geode Probe devid 20931022 classid 00000004! pcm0: port 0xfe00-0xfe7f irq 11 at device 15.3 o= n pci0 **** geode Attach! ---> Geode mem regs at fe01 **** AUDIO PCI HDR *** -->Vendor ID =3D1022 -->Dev ID =3D2093 -->PCI cmd =3D5 -->PCI status =3D2a0 -->Dev revision =3D1 -->PCI class =3Dffffffff -->PCI latency =3D0 -->PCI header type =3D0 -->BIST =3D0 --> Register Base address =3Dfe01 pcm0: calling bus_alloc_resource pcm0: failed to enable memory mapping! pcm0: unable to map BAR reg device_attach: pcm0 attach returned 6 Anyone got any ideas? Remote access is available upon request. --=20 Alec Kloss alec@SetFilePointer.com IM: angryspamhater@yahoo.com PGP key at http://pgp.mit.edu:11371/pks/lookup?op=3Dget&search=3D0xA241980E "No Bunny!" -- Simon, http://wiki.adultswim.com/xwiki/bin/Frisky+Dingo/Simon --FhKpTYimqQF2+bfE Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.5 (FreeBSD) iD8DBQFI2Z4s2s33paJBmA4RAjrvAJ9MBcOGeud5flvceQ3MrDbvopUv7QCfRRjW b9hQUp3u4hpJyLHuKe+Ywtc= =5jiC -----END PGP SIGNATURE----- --FhKpTYimqQF2+bfE-- From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 24 04:53:03 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 31A081065673 for ; Wed, 24 Sep 2008 04:53:03 +0000 (UTC) (envelope-from freebsd-hackers@wheelhouse.org) Received: from mail.nearlyfreespeech.net (x1.phxe.nearlyfreespeech.net [208.94.116.235]) by mx1.freebsd.org (Postfix) with ESMTP id 0448F8FC18 for ; Wed, 24 Sep 2008 04:53:02 +0000 (UTC) (envelope-from freebsd-hackers@wheelhouse.org) Received: from [10.0.1.201] (78.193.33.65.cfl.res.rr.com [65.33.193.78]) by mail.nearlyfreespeech.net (Postfix) with ESMTPSA id 4A349EBC3C for ; Tue, 23 Sep 2008 21:53:01 -0700 (MST) Message-Id: <8185F68B-C443-4891-BEC2-5E3D453DDC93@wheelhouse.org> From: Jeff Wheelhouse To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Date: Wed, 24 Sep 2008 00:52:59 -0400 X-Mailer: Apple Mail (2.929.2) Subject: Major SMP problems with lstat/namei X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Sep 2008 04:53:03 -0000 We have encountered some serious SMP performance/scalability problems that we've tracked back to lstat/namei calls. I've written a quick benchmark with a pair of tests to simplify/measure the problem. Both tests use a tree of directories: the top level directory contains five subdirectories a, b, c, d, and e. Each subdirectory contains five subdirectories a, b, c, d, and e, and so on.. 1 directory at level one, 5 at level two, 25 at level three, 125 at level four, 625 at level five, and 3125 at level six. In the "realpath" test, a random path is constructed at the bottom of the tree (e.g. /tmp/lstat/a/b/c/d/e) and realpath() is called on that, provoking lstat() calls on the whole tree. This is to simulate a mix of high-contention and low-contention lstat() calls. In the "lstat" test, lstat is called directly on a path at the bottom of the tree. Since there are 3125 files, this simulates relatively low-contention lstat() calls. In both cases, the test repeats as many times as possible for 60 seconds. Each test is run simultaneously by multiple processes, with progressively doubling concurrency from 1 to 512. What I found was that everything is fine at concurrency 2, probably indicating that the benchmark pegged on some other resource limit. At concurrency 4, realpath drops to 31.8% of concurrency 1. At concurrency 8, performance is down to 18.3%. In the interim, CPU load goes to 80-90% system CPU. I've confirmed via ktrace and the rusage that the CPU usage is all system time, and that lstat() is the *only* system call in the test (realpath() is called with an absolute path). I then reran the 32-process test on 1-7 cores, and found that performance peaks at 2 cores and drops sharply from there. eight cores runs *fifteen* times slower than two cores. The test full results are at the bottom of this message. This is on 6.3-RELEASE-p4 with vfs.lookup_shared=1. I believe this is the same issue that was previously discussed as "2 x quad-core system is slower that 2 x dual core on FreeBSD" archived here: http://lists.freebsd.org/pipermail/freebsd-stable/2007-November/038441.html In that post, Kris Kennaway wrote: > It is hard to say for certain without a direct profile comparison of the > workload, but it is probably due to lockmgr contention. lockmgr is used > for various locking operations to do with VFS data structures. It is > known to have poor performance and scale very badly." At this point, what I've got is one of those synthetic benchmarks, but it matches our production problems exactly, except that the production processes need a whole lot more RAM and eventually when this manifests, they backlog and the server death spirals through swap, which is a most unfortunate difference. I've chased my way up the kernel source to kern_lstat(), where a shared lock is obtained, and then onto namei, where vfs.lookup_shared comes into play. But unfortunately, I don't understand lockmgr, I don't know how the macros and flags I see here relate to it, I can't figure out what happened to the changes that Attilio Rao was working on, and there didn't seem to be much other hope at the time. This is becoming a huge problem for us. Is there anything that at all can be done, or any news? In the case linked above, improvement was made by changing a PHP setting that isn't applicable in our case. Thanks, Jeff Concurrency 1 realpath Total = 1409069 (100%) Total/Sec = 23484 Total/Sec/Worker = 23484 lstat Total = 6828763 (100%) Total/Sec = 113812 Total/Sec/Worker = 113812 Concurrency 2 realpath Total = 1450489 (100%) Total/Sec = 24174 Total/Sec/Worker = 12087 lstat Total = 6891417 (100.9%) Total/Sec = 114856 Total/Sec/Worker = 57428 Concurrency 4 realpath Total = 448693 (31.8%) Total/Sec = 7478 Total/Sec/Worker = 1869 lstat Total = 3047933 (44.6%) Total/Sec = 50798 Total/Sec/Worker = 12699 Concurrency 8 realpath Total = 258281 (18.3%) Total/Sec = 4304 Total/Sec/Worker = 538 lstat Total = 1688728 (24.7%) Total/Sec = 28145 Total/Sec/Worker = 3518 Concurrency 16 realpath Total = 179150 (12.7%) Total/Sec = 2985 Total/Sec/Worker = 186 lstat Total = 966558 (14.1%) Total/Sec = 16109 Total/Sec/Worker = 1006 Concurrency 32 realpath Total = 116982 (8.3%) Total/Sec = 1949 Total/Sec/Worker = 60 lstat Total = 644703 (9.4%) Total/Sec = 10745 Total/Sec/Worker = 335 Concurrency 64 realpath Total = 112050 (7.9%) Total/Sec = 1867 Total/Sec/Worker = 29 lstat Total = 572798 (8.3%) Total/Sec = 9546 Total/Sec/Worker = 149 Concurrency 128 realpath Total = 111544 (7.9%) Total/Sec = 1859 Total/Sec/Worker = 14 lstat Total = 570800 (8.3%) Total/Sec = 9513 Total/Sec/Worker = 74 Concurrency 256 realpath Total = 96461 (6.8%) Total/Sec = 1607 Total/Sec/Worker = 6 lstat Total = 580679 (8.5%) Total/Sec = 9677 Total/Sec/Worker = 37 Concurrency 512 realpath Total = 91224 (6.4%) Total/Sec = 1520 Total/Sec/Worker = 2 lstat Total = 498342 (7.2%) Total/Sec = 8305 Total/Sec/Worker = 16 realpath Concurrency 32 - 1 Core Total = 1289527 Total/Sec = 21492 Total/Sec/Worker = 671 realpath Concurrency 32 - 2 Core Total = 1753625 Total/Sec = 29227 Total/Sec/Worker = 913 realpath Concurrency 32 - 3 Core Total = 1197896 Total/Sec = 19964 Total/Sec/Worker = 623 realpath Concurrency 32 - 4 Core Total = 631293 Total/Sec = 10521 Total/Sec/Worker = 328 realpath Concurrency 32 - 5 Core Total = 227814 Total/Sec = 3796 Total/Sec/Worker = 118 realpath Concurrency 32 - 6 Core Total = 153550 Total/Sec = 2559 Total/Sec/Worker = 79 realpath Concurrency 32 - 7 Core Total = 136013 Total/Sec = 2266 Total/Sec/Worker = 70 From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 24 10:12:26 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BDBFB1065676 for ; Wed, 24 Sep 2008 10:12:26 +0000 (UTC) (envelope-from freebsd-hackers@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id 428FF8FC1E for ; Wed, 24 Sep 2008 10:12:26 +0000 (UTC) (envelope-from freebsd-hackers@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1KiRM7-0005tr-OG for freebsd-hackers@freebsd.org; Wed, 24 Sep 2008 10:12:23 +0000 Received: from lara.cc.fer.hr ([161.53.72.113]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 24 Sep 2008 10:12:23 +0000 Received: from ivoras by lara.cc.fer.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 24 Sep 2008 10:12:23 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-hackers@freebsd.org From: Ivan Voras Date: Wed, 24 Sep 2008 12:12:08 +0200 Lines: 42 Message-ID: References: <8185F68B-C443-4891-BEC2-5E3D453DDC93@wheelhouse.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enigD704C9DE8A456A90B84816ED" X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: lara.cc.fer.hr User-Agent: Thunderbird 2.0.0.16 (X11/20080724) In-Reply-To: <8185F68B-C443-4891-BEC2-5E3D453DDC93@wheelhouse.org> X-Enigmail-Version: 0.95.0 Sender: news Subject: Re: Major SMP problems with lstat/namei X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Sep 2008 10:12:26 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enigD704C9DE8A456A90B84816ED Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Jeff Wheelhouse wrote: > This is on 6.3-RELEASE-p4 with vfs.lookup_shared=3D1. >=20 > I believe this is the same issue that was previously discussed as "2 x > quad-core system is slower that 2 x dual core on FreeBSD" archived here= : >=20 > http://lists.freebsd.org/pipermail/freebsd-stable/2007-November/038441.= html > This is becoming a huge problem for us. Is there anything that at all > can be done, or any news? In the case linked above, improvement was > made by changing a PHP setting that isn't applicable in our case. There is nothing that can be done within the 6.x branch. 7.x contains many improvements but I think only 8.x will directly change the lockmgr and the namei cache. The best things you can try right now is to use 7-STABLE (or soon to be released 7.1; you might need tuning with 7.0-RELEASE) or try 8-CURRENT (it's quite stable). --------------enigD704C9DE8A456A90B84816ED Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFI2hJ+ldnAQVacBcgRAuJfAKCX495H//nIbm2Vsl0ZkfJkUolmBACg59iW 2oswydaLxO1Tdzex7r19pAc= =J9Rx -----END PGP SIGNATURE----- --------------enigD704C9DE8A456A90B84816ED-- From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 24 10:23:41 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0675A1065680 for ; Wed, 24 Sep 2008 10:23:41 +0000 (UTC) (envelope-from freebsd-hackers@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id B475D8FC22 for ; Wed, 24 Sep 2008 10:23:40 +0000 (UTC) (envelope-from freebsd-hackers@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1KiRX2-0006Om-98 for freebsd-hackers@freebsd.org; Wed, 24 Sep 2008 10:23:40 +0000 Received: from lara.cc.fer.hr ([161.53.72.113]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 24 Sep 2008 10:23:40 +0000 Received: from ivoras by lara.cc.fer.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 24 Sep 2008 10:23:40 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-hackers@freebsd.org From: Ivan Voras Date: Wed, 24 Sep 2008 12:23:33 +0200 Lines: 38 Message-ID: References: <8185F68B-C443-4891-BEC2-5E3D453DDC93@wheelhouse.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enigE17F28EA7E3A58CAFF658852" X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: lara.cc.fer.hr User-Agent: Thunderbird 2.0.0.16 (X11/20080724) In-Reply-To: X-Enigmail-Version: 0.95.0 Sender: news Subject: Re: Major SMP problems with lstat/namei X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Sep 2008 10:23:41 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enigE17F28EA7E3A58CAFF658852 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Ivan Voras wrote: > There is nothing that can be done within the 6.x branch. 7.x contains > many improvements but I think only 8.x will directly change the lockmgr= > and the namei cache. The best things you can try right now is to use > 7-STABLE (or soon to be released 7.1; you might need tuning with > 7.0-RELEASE) or try 8-CURRENT (it's quite stable). I remembered two more things: * The problematic load can also be generated with benchmarks/blogbench * I don't have the numbers here but I think I remember that ZFS had noticably larger score than UFS in this workload. Of course, ZFS has other problems. --------------enigE17F28EA7E3A58CAFF658852 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFI2hUlldnAQVacBcgRAsR2AKCXVfj2YxaX0t2y9UOv+nEx0z5PWACgnDE+ rzauJyAc70nIG5r9c2iA3yw= =cmxt -----END PGP SIGNATURE----- --------------enigE17F28EA7E3A58CAFF658852-- From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 24 07:46:47 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D11F01065678 for ; Wed, 24 Sep 2008 07:46:47 +0000 (UTC) (envelope-from danger@rulez.sk) Received: from services.rulez.sk (services.rulez.sk [92.240.234.125]) by mx1.freebsd.org (Postfix) with ESMTP id 8A39B8FC21 for ; Wed, 24 Sep 2008 07:46:47 +0000 (UTC) (envelope-from danger@rulez.sk) Received: from localhost (services.rulez.sk [92.240.234.125]) by services.rulez.sk (Postfix) with ESMTP id 0B62E13345DC; Wed, 24 Sep 2008 09:26:57 +0200 (CEST) X-Virus-Scanned: amavisd-new at rulez.sk Received: from services.rulez.sk ([92.240.234.125]) by localhost (services.rulez.sk [92.240.234.125]) (amavisd-new, port 10024) with ESMTP id zcNiVP03bKhH; Wed, 24 Sep 2008 09:26:56 +0200 (CEST) Received: from hosting.cia.sk (hosting.cia.sk [92.240.234.123]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by services.rulez.sk (Postfix) with ESMTPS id 545A813345DB; Wed, 24 Sep 2008 09:26:56 +0200 (CEST) Received: (from www@localhost) by hosting.cia.sk (8.14.2/8.14.2/Submit) id m8O7Qt4g015024; Wed, 24 Sep 2008 09:26:55 +0200 (CEST) (envelope-from danger@rulez.sk) X-Authentication-Warning: hosting.cia.sk: www set sender to danger@rulez.sk using -f To: Jeff Wheelhouse MIME-Version: 1.0 Date: Wed, 24 Sep 2008 09:26:55 +0200 From: Daniel Gerzo In-Reply-To: <8185F68B-C443-4891-BEC2-5E3D453DDC93@wheelhouse.org> References: <8185F68B-C443-4891-BEC2-5E3D453DDC93@wheelhouse.org> Message-ID: <5654e5239c4c2cda3aaa56bb7e1acd30@services.rulez.sk> X-Sender: danger@rulez.sk User-Agent: RoundCube Webmail/0.2a Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 8bit X-Mailman-Approved-At: Wed, 24 Sep 2008 11:30:11 +0000 Cc: freebsd-hackers@freebsd.org Subject: Re: Major SMP problems with lstat/namei X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Sep 2008 07:46:47 -0000 Hello Jeff, On Wed, 24 Sep 2008 00:52:59 -0400, Jeff Wheelhouse wrote: > > We have encountered some serious SMP performance/scalability problems > that we've tracked back to lstat/namei calls. I've written a quick this all seems like a reason of very poor performance of PHP when used with open_basedir and safe_mode enabled. It would be nice to see if there's something what could be done to make it better. -- S pozdravom / Best regards Daniel Geržo From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 24 11:40:39 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C426B1065686 for ; Wed, 24 Sep 2008 11:40:39 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from QMTA06.emeryville.ca.mail.comcast.net (qmta06.emeryville.ca.mail.comcast.net [76.96.30.56]) by mx1.freebsd.org (Postfix) with ESMTP id A9FA98FC12 for ; Wed, 24 Sep 2008 11:40:39 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from OMTA09.emeryville.ca.mail.comcast.net ([76.96.30.20]) by QMTA06.emeryville.ca.mail.comcast.net with comcast id JaKe1a00C0S2fkCA6bgfAn; Wed, 24 Sep 2008 11:40:39 +0000 Received: from koitsu.dyndns.org ([67.180.253.227]) by OMTA09.emeryville.ca.mail.comcast.net with comcast id Jbge1a0034v8bD78Vbgeqq; Wed, 24 Sep 2008 11:40:39 +0000 X-Authority-Analysis: v=1.0 c=1 a=YDA77r1Fh2MA:10 a=QycZ5dHgAAAA:8 a=vCiXsZHq6jDZe_JDf9UA:9 a=QoCIHm8ucUowj9o0QyUA:7 a=LLc6nKyNnBTQJinxnAA7fy4QfVIA:4 a=EoioJ0NPDVgA:10 a=STgsBMGmCuoA:10 a=LY0hPdMaydYA:10 Received: by icarus.home.lan (Postfix, from userid 1000) id 18C6C17B81A; Wed, 24 Sep 2008 04:40:38 -0700 (PDT) Date: Wed, 24 Sep 2008 04:40:38 -0700 From: Jeremy Chadwick To: Daniel Gerzo Message-ID: <20080924114038.GA81573@icarus.home.lan> References: <8185F68B-C443-4891-BEC2-5E3D453DDC93@wheelhouse.org> <5654e5239c4c2cda3aaa56bb7e1acd30@services.rulez.sk> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <5654e5239c4c2cda3aaa56bb7e1acd30@services.rulez.sk> User-Agent: Mutt/1.5.18 (2008-05-17) Cc: Jeff Wheelhouse , freebsd-hackers@freebsd.org Subject: Re: Major SMP problems with lstat/namei X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Sep 2008 11:40:39 -0000 On Wed, Sep 24, 2008 at 09:26:55AM +0200, Daniel Gerzo wrote: > Hello Jeff, > > On Wed, 24 Sep 2008 00:52:59 -0400, Jeff Wheelhouse > wrote: > > > > We have encountered some serious SMP performance/scalability problems > > that we've tracked back to lstat/namei calls. I've written a quick > > this all seems like a reason of very poor performance of PHP when used with > open_basedir and safe_mode enabled. It would be nice to see if there's > something what could be done to make it better. Both of which are features which will, thankfully, be removed in PHP 6. Whoever uses these features in PHP deserves the pain -- they're worthless and provide no security what-so-ever. Consider using suPHP or an MPM like mpm-itk. Also, PHP and performance shouldn't be put in the same sentence. -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 24 16:17:59 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7FC72106568D for ; Wed, 24 Sep 2008 16:17:59 +0000 (UTC) (envelope-from freebsd-hackers@wheelhouse.org) Received: from mail.nearlyfreespeech.net (x1.phxe.nearlyfreespeech.net [208.94.116.235]) by mx1.freebsd.org (Postfix) with ESMTP id 598058FC13 for ; Wed, 24 Sep 2008 16:17:59 +0000 (UTC) (envelope-from freebsd-hackers@wheelhouse.org) Received: from [10.0.1.201] (78.193.33.65.cfl.res.rr.com [65.33.193.78]) by mail.nearlyfreespeech.net (Postfix) with ESMTPSA id C8DDFEBC49 for ; Wed, 24 Sep 2008 09:17:57 -0700 (MST) Message-Id: From: Jeff Wheelhouse To: freebsd-hackers@freebsd.org In-Reply-To: Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Date: Wed, 24 Sep 2008 12:17:56 -0400 References: X-Mailer: Apple Mail (2.929.2) Subject: Re: panic: lockmgr on FreeBSD 7.0-RELEASE-p4 amd64 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Sep 2008 16:17:59 -0000 We got the same panic again, this time after switching to the ULE scheduler: panic: lockmgr: thread 0xffffff0050858350, not exclusive lock holder 0xffffff00074959f0 unlocking cpuid = 0 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a panic() at panic+0x17a _lockmgr() at _lockmgr+0x872 VOP_UNLOCK_APV() at VOP_UNLOCK_APV+0x46 null_unlock() at null_unlock+0xff VOP_UNLOCK_APV() at VOP_UNLOCK_APV+0x46 nullfs_mount() at nullfs_mount+0x244 vfs_donmount() at vfs_donmount+0xe4d nmount() at nmount+0xa5 syscall() at syscall+0x254 Xfast_syscall() at Xfast_syscall+0xab --- syscall (378, FreeBSD ELF64, nmount), rip = 0x206845ac, rsp = 0x7fffffffdfc8, rbp = 0x7fffffffdfd0 --- Thanks, Jeff On Sep 23, 2008, at 11:51 AM, Jeff Wheelhouse wrote: > > Got the following panic overnight: > > panic: lockmgr: thread 0xffffff0053cda680, not exclusive lock holder > 0xffffff002d7da680 unlocking > cpuid = 0 > KDB: stack backtrace: > db_trace_self_wrapper() at db_trace_self_wrapper+0x2a > panic() at panic+0x17a > _lockmgr() at _lockmgr+0x872 > VOP_UNLOCK_APV() at VOP_UNLOCK_APV+0x46 > null_unlock() at null_unlock+0xff > VOP_UNLOCK_APV() at VOP_UNLOCK_APV+0x46 > nullfs_mount() at nullfs_mount+0x244 > vfs_donmount() at vfs_donmount+0xe4d > nmount() at nmount+0xa5 > syscall() at syscall+0x254 > Xfast_syscall() at Xfast_syscall+0xab > --- syscall (378, FreeBSD ELF64, nmount), rip = 0x206845ac, rsp = > 0x7fffffffdfb8, rbp = 0x7fffffffdfc0 --- > > I've done some searches and "not exclusive lock holder" has been > seen before, but I didn't find any previous reports related to > nullfs with a stack trace at all like this on FreeBSD 7. > > This machine is diskless and thus cannot store a kernel dump. Ideas/ > suggestions for fixes, causes or debugging steps? > > The kernel is amd64, with config shown below. > > Thanks, > Jeff > > include GENERIC > > device carp > device pf > device pflog > device pfsync > > options SW_WATCHDOG > options DEVICE_POLLING > > options ALTQ > options ALTQ_CBQ > options ALTQ_RED > options ALTQ_RIO > options ALTQ_HFSC > options ALTQ_PRIQ > options ALTQ_NOPCC > > options KDB > options KDB_UNATTENDED > options KDB_TRACE > options DDB > options BREAK_TO_DEBUGGER > > > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org > " From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 24 16:41:50 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F29E8106569C for ; Wed, 24 Sep 2008 16:41:50 +0000 (UTC) (envelope-from jdw@wheelhouse.org) Received: from mail.nearlyfreespeech.net (x1.phxe.nearlyfreespeech.net [208.94.116.235]) by mx1.freebsd.org (Postfix) with ESMTP id CDB8B8FC12 for ; Wed, 24 Sep 2008 16:41:50 +0000 (UTC) (envelope-from jdw@wheelhouse.org) Received: from [10.0.1.201] (78.193.33.65.cfl.res.rr.com [65.33.193.78]) by mail.nearlyfreespeech.net (Postfix) with ESMTPSA id 904C3EBC4A for ; Wed, 24 Sep 2008 09:26:24 -0700 (MST) Message-Id: From: Jeff Wheelhouse To: freebsd-hackers@freebsd.org In-Reply-To: Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Date: Wed, 24 Sep 2008 12:26:23 -0400 References: <8185F68B-C443-4891-BEC2-5E3D453DDC93@wheelhouse.org> X-Mailer: Apple Mail (2.929.2) X-Mailman-Approved-At: Wed, 24 Sep 2008 16:51:22 +0000 Subject: Re: Major SMP problems with lstat/namei X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Sep 2008 16:41:51 -0000 On Sep 24, 2008, at 6:12 AM, Ivan Voras wrote: > There is nothing that can be done within the 6.x branch. 7.x contains > many improvements but I think only 8.x will directly change the > lockmgr > and the namei cache. The best things you can try right now is to use > 7-STABLE (or soon to be released 7.1; you might need tuning with > 7.0-RELEASE) or try 8-CURRENT (it's quite stable). Really? Nothing? We get lockmgr-related panics on FreeBSD 7.0, as detailed elsewhere on this list. Stability issues aside, what else would we need to tune on 7.0, besides enabling the ULE scheduler, and how much benefit would we really get? These servers are in production, so 8-CURRENT is not an option. I've already had my knuckles rapped by a customer for trying 7.1-PRERELEASE on one of their machines. Thanks, Jeff From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 24 16:54:57 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 602841065685 for ; Wed, 24 Sep 2008 16:54:57 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from server.baldwin.cx (bigknife-pt.tunnel.tserv9.chi1.ipv6.he.net [IPv6:2001:470:1f10:75::2]) by mx1.freebsd.org (Postfix) with ESMTP id B34388FC12 for ; Wed, 24 Sep 2008 16:54:56 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from localhost.corp.yahoo.com (john@localhost [IPv6:::1]) (authenticated bits=0) by server.baldwin.cx (8.14.2/8.14.2) with ESMTP id m8OGshJf084657; Wed, 24 Sep 2008 12:54:50 -0400 (EDT) (envelope-from jhb@freebsd.org) From: John Baldwin To: freebsd-hackers@freebsd.org Date: Wed, 24 Sep 2008 12:12:09 -0400 User-Agent: KMail/1.9.7 References: <8185F68B-C443-4891-BEC2-5E3D453DDC93@wheelhouse.org> In-Reply-To: <8185F68B-C443-4891-BEC2-5E3D453DDC93@wheelhouse.org> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200809241212.09920.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH authentication, not delayed by milter-greylist-2.0.2 (server.baldwin.cx [IPv6:::1]); Wed, 24 Sep 2008 12:54:50 -0400 (EDT) X-Virus-Scanned: ClamAV 0.93.1/8324/Wed Sep 24 06:55:43 2008 on server.baldwin.cx X-Virus-Status: Clean X-Spam-Status: No, score=-2.6 required=4.2 tests=AWL,BAYES_00,NO_RELAYS autolearn=ham version=3.1.3 X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on server.baldwin.cx Cc: Jeff Wheelhouse Subject: Re: Major SMP problems with lstat/namei X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Sep 2008 16:54:57 -0000 On Wednesday 24 September 2008 12:52:59 am Jeff Wheelhouse wrote: > > We have encountered some serious SMP performance/scalability problems > that we've tracked back to lstat/namei calls. I've written a quick > benchmark with a pair of tests to simplify/measure the problem. Both > tests use a tree of directories: the top level directory contains five > subdirectories a, b, c, d, and e. Each subdirectory contains five > subdirectories a, b, c, d, and e, and so on.. 1 directory at level > one, 5 at level two, 25 at level three, 125 at level four, 625 at > level five, and 3125 at level six. > > In the "realpath" test, a random path is constructed at the bottom of > the tree (e.g. /tmp/lstat/a/b/c/d/e) and realpath() is called on that, > provoking lstat() calls on the whole tree. This is to simulate a mix > of high-contention and low-contention lstat() calls. > > In the "lstat" test, lstat is called directly on a path at the bottom > of the tree. Since there are 3125 files, this simulates relatively > low-contention lstat() calls. > > In both cases, the test repeats as many times as possible for 60 > seconds. Each test is run simultaneously by multiple processes, with > progressively doubling concurrency from 1 to 512. > > What I found was that everything is fine at concurrency 2, probably > indicating that the benchmark pegged on some other resource limit. At > concurrency 4, realpath drops to 31.8% of concurrency 1. At > concurrency 8, performance is down to 18.3%. In the interim, CPU load > goes to 80-90% system CPU. I've confirmed via ktrace and the rusage > that the CPU usage is all system time, and that lstat() is the *only* > system call in the test (realpath() is called with an absolute path). > > I then reran the 32-process test on 1-7 cores, and found that > performance peaks at 2 cores and drops sharply from there. eight > cores runs *fifteen* times slower than two cores. > > The test full results are at the bottom of this message. > > This is on 6.3-RELEASE-p4 with vfs.lookup_shared=1. Shared lookups only work on the NFS client in 6.x. I'm about to turn them on for UFS in HEAD (8.x) and will backport the needed fixes to 7.x after 7.1 (too risky to merge to 7.x this close to a release). So lookup_shared=1 isn't going to really help on 6.x unless you are doing it all over NFS. You also want to backport my fix to cache_enter() before using lookup_shared at all: jhb 2008-08-23 15:13:39 UTC FreeBSD src repository Modified files: sys/kern vfs_cache.c Log: SVN rev 182061 on 2008-08-23 15:13:39Z by jhb Fix a race condition with concurrent LOOKUP namecache operations for a vnode not in the namecache when shared lookups are enabled (vfs.lookup_shared=1, it is currently off by default) and the filesystem supports shared lookups (e.g. NFS client). Specifically, if multiple concurrent LOOKUPs both miss in the name cache in parallel, each of the lookups may each end up adding an entry to the namecache resulting in duplicate entries in the namecache for the same pathname. A subsequent removal of the mapping of that pathname to that vnode (via remove or rename) would only evict one of the entries from the name cache. As a result, subseqent lookups for that pathname would still return the old vnode. This race was observed with shared lookups over NFS where a file was updated by writing a new file out to a temporary file name and then renaming that temporary file to the "real" file to effect atomic updates of a file. Other processes on the same client that were periodically reading the file would occasionally receive an ESTALE error from open(2) because the VOP_GETATTR() in nfs_open() would receive that error when given the stale vnode. The fix here is to check for duplicates in cache_enter() and just return if an entry for this same directory and leaf file name for this vnode is already in the cache. The check for duplicates is done by walking the per-vnode list of name cache entries. It is expected that this list should be very small in the common case (usually 0 or 1 entries during a cache_enter() since most files only have 1 "leaf" name). Reviewed by: ups, scottl MFC after: 2 months Revision Changes Path 1.124 +33 -9 src/sys/kern/vfs_cache.c If you want to try the UFS stuff on 7, you would need to probably backport at least the following, maybe more: jeff 2008-04-11 09:44:25 UTC FreeBSD src repository Modified files: sys/ufs/ufs ufs_lookup.c Log: - cache dp->i_offset in the local 'i_offset' variable for use in loop indexes so directory lookup becomes shared lock safe. In the modifying cases an exclusive lock is held here so the commit routine may rely on the state of i_offset. - Similarly handle i_diroff by fetching at the start and setting only once the operation is complete. Without the exclusive lock these are only considered hints. - Assert that an exclusive lock is held when we're preparing for a commit routine. - Honor the lock type request from lookup instead of always using exclusive locking. Tested by: pho, kris Revision Changes Path 1.87 +48 -29 src/sys/ufs/ufs/ufs_lookup.c jeff 2008-04-22 12:34:16 UTC FreeBSD src repository Modified files: sys/ufs/ufs inode.h ufs_lookup.c Log: - Use a local variable for i_ino in ufs_lookup. It is only used to communicate between two parts of this one function. This was causing problems with shared lookups as each would trash the ino value in the inode. - Remove the unused i_ino field from the inode structure. Revision Changes Path 1.53 +0 -1 src/sys/ufs/ufs/inode.h 1.88 +10 -13 src/sys/ufs/ufs/ufs_lookup.c jhb 2008-07-30 21:07:56 UTC FreeBSD src repository Modified files: sys/ufs/ufs ufs_lookup.c Log: SVN rev 181018 on 2008-07-30 21:07:56Z by jhb Whitespace tweak. Revision Changes Path 1.90 +0 -1 src/sys/ufs/ufs/ufs_lookup.c jhb 2008-09-16 16:18:36 UTC FreeBSD src repository Modified files: sys/ufs/ufs ufs_lookup.c Log: SVN rev 183079 on 2008-09-16 16:18:36Z by jhb - Only set i_offset in the parent directory's i-node during a lookup for non-LOOKUP operations. - Relax a VOP assertion for a DELETE lookup. rename() uses WANTPARENT instead of LOCKPARENT when looking up the source pathname. ufs_rename() uses a relookup() to lock the parent directory when it decides to finally remove the source path. Thus, it is ok for a DELETE with WANTPARENT set instead of LOCKPARENT to use a shared vnode lock rather than an exclusive vnode lock. Reported by: kris (2) Reviewed by: jeff Revision Changes Path 1.91 +9 -3 src/sys/ufs/ufs/ufs_lookup.c jhb 2008-09-16 19:06:44 UTC FreeBSD src repository Modified files: sys/ufs/ufs inode.h ufs_lookup.c Log: SVN rev 183093 on 2008-09-16 19:06:44Z by jhb Retire the 'i_reclen' field from the in-memory i-node. Previously, during a DELETE lookup operation, lookup would cache the length of the directory entry to be deleted in 'i_reclen'. Later, the actual VOP to remove the directory entry (ufs_remove, ufs_rename, etc.) would call ufs_dirremove() which extended the length of the previous directory entry to "remove" the deleted entry. However, we always read the entire block containing the directory entry when doing the removal, so we always have the directory entry to be deleted in-memory when doing the update to the directory block. Also, we already have to figure out where the directory entry that is being removed is in the block so that we can pass the component name to the dirhash code to update the dirhash. So, instead of passing 'i_reclen' from ufs_lookup() to the ufs_dirremove() routine, just read the 'd_reclen' field directly out of the entry being removed when updating the length of the previous entry in the block. This avoids a cosmetic issue of writing to 'i_reclen' while holding a shared vnode lock. It also slightly reduces the amount of side-band data passed from ufs_lookup() to operations updating a directory via the directory's i-node. Reviewed by: jeff Revision Changes Path 1.54 +0 -1 src/sys/ufs/ufs/inode.h 1.92 +9 -6 src/sys/ufs/ufs/ufs_lookup.c jeff 2008-04-11 09:48:12 UTC FreeBSD src repository Modified files: sys/ufs/ufs dirhash.h ufs_dirhash.c Log: - Use a lockmgr lock rather than a mtx to protect dirhash. This lock may be held for the duration of the various dirhash operations which avoids many complex unlock/lock/revalidate sequences. - Permit shared locks on lookup. To protect the ip->i_dirhash pointer we use the vnode interlock in the shared case. Callers holding the exclusive vnode lock can run without fear of concurrent modification to i_dirhash. - Hold an exclusive dirhash lock when creating the dirhash structure for the first time or when re-creating a dirhash structure which has been recycled. Tested by: kris, pho Revision Changes Path 1.6 +2 -1 src/sys/ufs/ufs/dirhash.h 1.24 +289 -227 src/sys/ufs/ufs/ufs_dirhash.c jhb 2008-09-16 16:23:56 UTC FreeBSD src repository Modified files: sys/ufs/ufs dirhash.h ufs_dirhash.c Log: SVN rev 183080 on 2008-09-16 16:23:56Z by jhb Fix a race with shared lookups on UFS. If the the dirhash code reached the cap on memory usage, then shared LOOKUP operations could start free'ing dirhash structures. Without these fixes, concurrent free's on the same directory could result in one of the threads blocked on a lock in a dirhash structure free'd by the other thread. - Replace the lockmgr lock in the dirhash structure with an sx lock. - Use a reference count managed with ufsdirhash_hold()/drop() to determine when to free the dirhash structures. The directory i-node holds a reference while the dirhash is attached to an i-node. Code that wishes to lock the dirhash while holding a shared vnode lock must first acquire a private reference to the dirhash while holding the vnode interlock before acquiring the dirhash sx lock. After acquiring the sx lock, it drops the private reference after checking to see if the dirhash is still used by the directory i-node. Revision Changes Path 1.7 +5 -1 src/sys/ufs/ufs/dirhash.h 1.25 +82 -33 src/sys/ufs/ufs/ufs_dirhash.c jhb 2008-09-22 20:53:22 UTC FreeBSD src repository Modified files: sys/ufs/ufs ufs_dirhash.c Log: SVN rev 183280 on 2008-09-22 20:53:22Z by jhb Close a race between concurrent calls to ufsdirhash_recycle() and ufsdirhash_free() introduced in my last commit by removing the dirhash about to be free'd in ufsdirhash_free() from the global dirhash list before dropping the sx lock. Tested by: kris Revision Changes Path 1.26 +10 -5 src/sys/ufs/ufs/ufs_dirhash.c There are additional fixes needed to fix races with umount -f, so if you backport all this stuff, don't use umount -f or you risk panics. :) Also, you will need to set the flag in the mount flags to enable shared lookups in the mount VOP in ffs_vfsops.c: --- //depot/projects/smpng/sys/ufs/ffs/ffs_vfsops.c 2008/08/25 16:33:41 +++ //depot/user/jhb/lock/ufs/ffs/ffs_vfsops.c 2008/08/29 15:04:03 @@ -852,7 +852,7 @@ * Initialize filesystem stat information in mount struct. */ MNT_ILOCK(mp); - mp->mnt_kern_flag |= MNTK_MPSAFE; + mp->mnt_kern_flag |= MNTK_MPSAFE | MNTK_LOOKUP_SHARED; MNT_IUNLOCK(mp); #ifdef UFS_EXTATTR #ifdef UFS_EXTATTR_AUTOSTART For 6.x you could in theory backport all of this as well, but there may be other fixes needed as well for 6.x. I'm only planning on merging this stuff back to 7.x myself. -- John Baldwin From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 24 16:55:02 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C91AB1065680 for ; Wed, 24 Sep 2008 16:55:02 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from server.baldwin.cx (bigknife-pt.tunnel.tserv9.chi1.ipv6.he.net [IPv6:2001:470:1f10:75::2]) by mx1.freebsd.org (Postfix) with ESMTP id 69C828FC1C for ; Wed, 24 Sep 2008 16:55:02 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from localhost.corp.yahoo.com (john@localhost [IPv6:::1]) (authenticated bits=0) by server.baldwin.cx (8.14.2/8.14.2) with ESMTP id m8OGshJg084657; Wed, 24 Sep 2008 12:54:56 -0400 (EDT) (envelope-from jhb@freebsd.org) From: John Baldwin To: freebsd-hackers@freebsd.org Date: Wed, 24 Sep 2008 12:34:54 -0400 User-Agent: KMail/1.9.7 References: In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200809241234.55075.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH authentication, not delayed by milter-greylist-2.0.2 (server.baldwin.cx [IPv6:::1]); Wed, 24 Sep 2008 12:54:56 -0400 (EDT) X-Virus-Scanned: ClamAV 0.93.1/8324/Wed Sep 24 06:55:43 2008 on server.baldwin.cx X-Virus-Status: Clean X-Spam-Status: No, score=-2.6 required=4.2 tests=AWL,BAYES_00,NO_RELAYS autolearn=ham version=3.1.3 X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on server.baldwin.cx Cc: Jeff Wheelhouse Subject: Re: panic: lockmgr on FreeBSD 7.0-RELEASE-p4 amd64 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Sep 2008 16:55:02 -0000 On Wednesday 24 September 2008 12:17:56 pm Jeff Wheelhouse wrote: > > We got the same panic again, this time after switching to the ULE > scheduler: > > panic: lockmgr: thread 0xffffff0050858350, not exclusive lock holder > 0xffffff00074959f0 unlocking > cpuid = 0 > KDB: stack backtrace: > db_trace_self_wrapper() at db_trace_self_wrapper+0x2a > panic() at panic+0x17a > _lockmgr() at _lockmgr+0x872 > VOP_UNLOCK_APV() at VOP_UNLOCK_APV+0x46 > null_unlock() at null_unlock+0xff > VOP_UNLOCK_APV() at VOP_UNLOCK_APV+0x46 > nullfs_mount() at nullfs_mount+0x244 > vfs_donmount() at vfs_donmount+0xe4d > nmount() at nmount+0xa5 > syscall() at syscall+0x254 > Xfast_syscall() at Xfast_syscall+0xab > --- syscall (378, FreeBSD ELF64, nmount), rip = 0x206845ac, rsp = > 0x7fffffffdfc8, rbp = 0x7fffffffdfd0 --- Can you use gdb or the like to get the souce file/line for the nullfs_mount+0x244 frame? i.e. 'gdb /boot/kernel/kernel' (gdb) l *nullfs_mount+0x244 -- John Baldwin From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 24 17:35:47 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8D4681065675 for ; Wed, 24 Sep 2008 17:35:47 +0000 (UTC) (envelope-from freebsd-hackers@wheelhouse.org) Received: from mail.nearlyfreespeech.net (x1.phxe.nearlyfreespeech.net [208.94.116.235]) by mx1.freebsd.org (Postfix) with ESMTP id 5F1C98FC1A for ; Wed, 24 Sep 2008 17:35:47 +0000 (UTC) (envelope-from freebsd-hackers@wheelhouse.org) Received: from [10.0.1.201] (78.193.33.65.cfl.res.rr.com [65.33.193.78]) by mail.nearlyfreespeech.net (Postfix) with ESMTPSA id 51B6BEBC49; Wed, 24 Sep 2008 10:35:46 -0700 (MST) Message-Id: From: Jeff Wheelhouse To: John Baldwin In-Reply-To: <200809241234.55075.jhb@freebsd.org> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Date: Wed, 24 Sep 2008 13:35:44 -0400 References: <200809241234.55075.jhb@freebsd.org> X-Mailer: Apple Mail (2.929.2) Cc: freebsd-hackers@freebsd.org Subject: Re: panic: lockmgr on FreeBSD 7.0-RELEASE-p4 amd64 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Sep 2008 17:35:47 -0000 On Sep 24, 2008, at 12:34 PM, John Baldwin wrote: > On Wednesday 24 September 2008 12:17:56 pm Jeff Wheelhouse wrote: >> nullfs_mount() at nullfs_mount+0x244 >> > Can you use gdb or the like to get the souce file/line for the > nullfs_mount+0x244 frame? > > i.e. 'gdb /boot/kernel/kernel' > > (gdb) l *nullfs_mount+0x244 The running kernel did not have -g so I added it to the same config and rebuilt. I will slip in a reboot ASAP and post more info after the next panic. Thanks for taking a look! Thanks, Jeff From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 24 17:47:35 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9AAB510656D1; Wed, 24 Sep 2008 17:47:35 +0000 (UTC) (envelope-from freebsd-hackers@wheelhouse.org) Received: from mail.nearlyfreespeech.net (x1.phxe.nearlyfreespeech.net [208.94.116.235]) by mx1.freebsd.org (Postfix) with ESMTP id 733218FC1F; Wed, 24 Sep 2008 17:47:35 +0000 (UTC) (envelope-from freebsd-hackers@wheelhouse.org) Received: from [10.0.1.201] (78.193.33.65.cfl.res.rr.com [65.33.193.78]) by mail.nearlyfreespeech.net (Postfix) with ESMTPSA id 6328DEBC54; Wed, 24 Sep 2008 10:47:34 -0700 (MST) Message-Id: From: Jeff Wheelhouse To: John Baldwin In-Reply-To: <200809241212.09920.jhb@freebsd.org> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Date: Wed, 24 Sep 2008 13:47:32 -0400 References: <8185F68B-C443-4891-BEC2-5E3D453DDC93@wheelhouse.org> <200809241212.09920.jhb@freebsd.org> X-Mailer: Apple Mail (2.929.2) Cc: freebsd-hackers@freebsd.org Subject: Re: Major SMP problems with lstat/namei X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Sep 2008 17:47:35 -0000 On Sep 24, 2008, at 12:12 PM, John Baldwin wrote: > Shared lookups only work on the NFS client in 6.x. I'm about to > turn them on > for UFS in HEAD (8.x) and will backport the needed fixes to 7.x > after 7.1 > (too risky to merge to 7.x this close to a release). Testers available, when you get to that. :-) > So lookup_shared=1 > isn't going to really help on 6.x unless you are doing it all over > NFS. You > also want to backport my fix to cache_enter() before using > lookup_shared at > all: Since it sounds like 6.x is a dead end, we'll focus on 7.x, provided we can get it to be stable for us. Having never used svn, I do need to figure out how to pull the specific patches you referenced, but I'm sure that's not an unclimbable mountain. :-) I appreciate your insight on this, it's very helpful. Thanks, Jeff From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 24 18:11:24 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F1F531065725 for ; Wed, 24 Sep 2008 18:11:24 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from server.baldwin.cx (bigknife-pt.tunnel.tserv9.chi1.ipv6.he.net [IPv6:2001:470:1f10:75::2]) by mx1.freebsd.org (Postfix) with ESMTP id 90C678FC0A for ; Wed, 24 Sep 2008 18:11:24 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from localhost.corp.yahoo.com (john@localhost [IPv6:::1]) (authenticated bits=0) by server.baldwin.cx (8.14.2/8.14.2) with ESMTP id m8OIBBbi085246; Wed, 24 Sep 2008 14:11:18 -0400 (EDT) (envelope-from jhb@freebsd.org) From: John Baldwin To: Jeff Wheelhouse Date: Wed, 24 Sep 2008 14:10:23 -0400 User-Agent: KMail/1.9.7 References: <8185F68B-C443-4891-BEC2-5E3D453DDC93@wheelhouse.org> <200809241212.09920.jhb@freebsd.org> In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200809241410.23238.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH authentication, not delayed by milter-greylist-2.0.2 (server.baldwin.cx [IPv6:::1]); Wed, 24 Sep 2008 14:11:18 -0400 (EDT) X-Virus-Scanned: ClamAV 0.93.1/8324/Wed Sep 24 06:55:43 2008 on server.baldwin.cx X-Virus-Status: Clean X-Spam-Status: No, score=-2.6 required=4.2 tests=AWL,BAYES_00,NO_RELAYS autolearn=ham version=3.1.3 X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on server.baldwin.cx Cc: freebsd-hackers@freebsd.org Subject: Re: Major SMP problems with lstat/namei X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Sep 2008 18:11:25 -0000 On Wednesday 24 September 2008 01:47:32 pm Jeff Wheelhouse wrote: > > On Sep 24, 2008, at 12:12 PM, John Baldwin wrote: > > Shared lookups only work on the NFS client in 6.x. I'm about to > > turn them on > > for UFS in HEAD (8.x) and will backport the needed fixes to 7.x > > after 7.1 > > (too risky to merge to 7.x this close to a release). > > Testers available, when you get to that. :-) > > > So lookup_shared=1 > > isn't going to really help on 6.x unless you are doing it all over > > NFS. You > > also want to backport my fix to cache_enter() before using > > lookup_shared at > > all: > > Since it sounds like 6.x is a dead end, we'll focus on 7.x, provided > we can get it to be stable for us. Yes. > Having never used svn, I do need to figure out how to pull the > specific patches you referenced, but I'm sure that's not an > unclimbable mountain. :-) You can still use cvs to pull the revisions. All those e-mail msg's have the CVS revisions in them, too. -- John Baldwin From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 24 18:11:31 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0691C1065730 for ; Wed, 24 Sep 2008 18:11:31 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from server.baldwin.cx (bigknife-pt.tunnel.tserv9.chi1.ipv6.he.net [IPv6:2001:470:1f10:75::2]) by mx1.freebsd.org (Postfix) with ESMTP id 97F228FC08 for ; Wed, 24 Sep 2008 18:11:30 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from localhost.corp.yahoo.com (john@localhost [IPv6:::1]) (authenticated bits=0) by server.baldwin.cx (8.14.2/8.14.2) with ESMTP id m8OIBBbj085246; Wed, 24 Sep 2008 14:11:24 -0400 (EDT) (envelope-from jhb@freebsd.org) From: John Baldwin To: Jeff Wheelhouse Date: Wed, 24 Sep 2008 14:10:59 -0400 User-Agent: KMail/1.9.7 References: <200809241234.55075.jhb@freebsd.org> In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200809241410.59492.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH authentication, not delayed by milter-greylist-2.0.2 (server.baldwin.cx [IPv6:::1]); Wed, 24 Sep 2008 14:11:24 -0400 (EDT) X-Virus-Scanned: ClamAV 0.93.1/8324/Wed Sep 24 06:55:43 2008 on server.baldwin.cx X-Virus-Status: Clean X-Spam-Status: No, score=-2.6 required=4.2 tests=AWL,BAYES_00,NO_RELAYS autolearn=ham version=3.1.3 X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on server.baldwin.cx Cc: freebsd-hackers@freebsd.org Subject: Re: panic: lockmgr on FreeBSD 7.0-RELEASE-p4 amd64 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Sep 2008 18:11:31 -0000 On Wednesday 24 September 2008 01:35:44 pm Jeff Wheelhouse wrote: > On Sep 24, 2008, at 12:34 PM, John Baldwin wrote: > > On Wednesday 24 September 2008 12:17:56 pm Jeff Wheelhouse wrote: > >> nullfs_mount() at nullfs_mount+0x244 > >> > > Can you use gdb or the like to get the souce file/line for the > > nullfs_mount+0x244 frame? > > > > i.e. 'gdb /boot/kernel/kernel' > > > > (gdb) l *nullfs_mount+0x244 > > The running kernel did not have -g so I added it to the same config > and rebuilt. I will slip in a reboot ASAP and post more info after > the next panic. > > Thanks for taking a look! If possible, get a crashdump. -- John Baldwin From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 24 18:16:02 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E17F71065673; Wed, 24 Sep 2008 18:16:02 +0000 (UTC) (envelope-from freebsd-hackers@wheelhouse.org) Received: from mail.nearlyfreespeech.net (x1.phxe.nearlyfreespeech.net [208.94.116.235]) by mx1.freebsd.org (Postfix) with ESMTP id B89318FC0A; Wed, 24 Sep 2008 18:16:02 +0000 (UTC) (envelope-from freebsd-hackers@wheelhouse.org) Received: from [10.0.1.201] (78.193.33.65.cfl.res.rr.com [65.33.193.78]) by mail.nearlyfreespeech.net (Postfix) with ESMTPSA id BEB49EBC49; Wed, 24 Sep 2008 11:16:01 -0700 (MST) Message-Id: <121FE098-4426-4C8E-B003-37BB12B0684F@wheelhouse.org> From: Jeff Wheelhouse To: John Baldwin In-Reply-To: <200809241410.59492.jhb@freebsd.org> Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Date: Wed, 24 Sep 2008 14:15:59 -0400 References: <200809241234.55075.jhb@freebsd.org> <200809241410.59492.jhb@freebsd.org> X-Mailer: Apple Mail (2.929.2) Cc: freebsd-hackers@freebsd.org Subject: Re: panic: lockmgr on FreeBSD 7.0-RELEASE-p4 amd64 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Sep 2008 18:16:03 -0000 On Sep 24, 2008, at 2:10 PM, John Baldwin wrote: > If possible, get a crashdump. gmirror. :( Thanks, Jeff From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 24 18:21:42 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 62C21106564A; Wed, 24 Sep 2008 18:21:42 +0000 (UTC) (envelope-from freebsd-hackers@wheelhouse.org) Received: from mail.nearlyfreespeech.net (x1.phxe.nearlyfreespeech.net [208.94.116.235]) by mx1.freebsd.org (Postfix) with ESMTP id 3B8808FC0A; Wed, 24 Sep 2008 18:21:42 +0000 (UTC) (envelope-from freebsd-hackers@wheelhouse.org) Received: from [10.0.1.201] (78.193.33.65.cfl.res.rr.com [65.33.193.78]) by mail.nearlyfreespeech.net (Postfix) with ESMTPSA id 839FAEBC49; Wed, 24 Sep 2008 11:21:41 -0700 (MST) Message-Id: From: Jeff Wheelhouse To: John Baldwin In-Reply-To: <200809241410.23238.jhb@freebsd.org> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Date: Wed, 24 Sep 2008 14:21:40 -0400 References: <8185F68B-C443-4891-BEC2-5E3D453DDC93@wheelhouse.org> <200809241212.09920.jhb@freebsd.org> <200809241410.23238.jhb@freebsd.org> X-Mailer: Apple Mail (2.929.2) Cc: freebsd-hackers@freebsd.org Subject: Re: Major SMP problems with lstat/namei X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Sep 2008 18:21:42 -0000 On Sep 24, 2008, at 2:10 PM, John Baldwin wrote: > You can still use cvs to pull the revisions. All those e-mail msg's > have the > CVS revisions in them, too. If I'm ever to do anything that will benefit someone besides myself, it's worth my making the effort to learn SVN. We have coasted on the back of FreeBSD without giving back for long enough. Thanks, Jeff From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 24 18:50:08 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 51465106566B for ; Wed, 24 Sep 2008 18:50:08 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from server.baldwin.cx (server.baldwin.cx [208.65.91.234]) by mx1.freebsd.org (Postfix) with ESMTP id BF8208FC1B for ; Wed, 24 Sep 2008 18:50:07 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from localhost.corp.yahoo.com (john@localhost [IPv6:::1]) (authenticated bits=0) by server.baldwin.cx (8.14.2/8.14.2) with ESMTP id m8OIZAdB085434; Wed, 24 Sep 2008 14:35:21 -0400 (EDT) (envelope-from jhb@freebsd.org) From: John Baldwin To: Jeff Wheelhouse Date: Wed, 24 Sep 2008 14:34:52 -0400 User-Agent: KMail/1.9.7 References: <200809241410.59492.jhb@freebsd.org> <121FE098-4426-4C8E-B003-37BB12B0684F@wheelhouse.org> In-Reply-To: <121FE098-4426-4C8E-B003-37BB12B0684F@wheelhouse.org> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200809241434.53043.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH authentication, not delayed by milter-greylist-2.0.2 (server.baldwin.cx [IPv6:::1]); Wed, 24 Sep 2008 14:35:21 -0400 (EDT) X-Virus-Scanned: ClamAV 0.93.1/8324/Wed Sep 24 06:55:43 2008 on server.baldwin.cx X-Virus-Status: Clean X-Spam-Status: No, score=-2.6 required=4.2 tests=AWL,BAYES_00,NO_RELAYS autolearn=ham version=3.1.3 X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on server.baldwin.cx Cc: freebsd-hackers@freebsd.org Subject: Re: panic: lockmgr on FreeBSD 7.0-RELEASE-p4 amd64 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Sep 2008 18:50:08 -0000 On Wednesday 24 September 2008 02:15:59 pm Jeff Wheelhouse wrote: > > On Sep 24, 2008, at 2:10 PM, John Baldwin wrote: > > If possible, get a crashdump. > > gmirror. :( Gah. Make pjd@ fix crashdumps on that. :P -- John Baldwin From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 24 20:25:54 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3B035106566C for ; Wed, 24 Sep 2008 20:25:54 +0000 (UTC) (envelope-from julian@elischer.org) Received: from outR.internet-mail-service.net (outr.internet-mail-service.net [216.240.47.241]) by mx1.freebsd.org (Postfix) with ESMTP id 1F8C78FC0A for ; Wed, 24 Sep 2008 20:25:53 +0000 (UTC) (envelope-from julian@elischer.org) Received: from idiom.com (mx0.idiom.com [216.240.32.160]) by out.internet-mail-service.net (Postfix) with ESMTP id C4DF32488; Wed, 24 Sep 2008 13:26:09 -0700 (PDT) Received: from julian-mac.elischer.org (localhost [127.0.0.1]) by idiom.com (Postfix) with ESMTP id 7F74A2D600D; Wed, 24 Sep 2008 13:25:53 -0700 (PDT) Message-ID: <48DAA252.2050406@elischer.org> Date: Wed, 24 Sep 2008 13:25:54 -0700 From: Julian Elischer User-Agent: Thunderbird 2.0.0.16 (Macintosh/20080707) MIME-Version: 1.0 To: Jeff Wheelhouse References: <8185F68B-C443-4891-BEC2-5E3D453DDC93@wheelhouse.org> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-hackers@freebsd.org Subject: Re: Major SMP problems with lstat/namei X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Sep 2008 20:25:54 -0000 Jeff Wheelhouse wrote: > > On Sep 24, 2008, at 6:12 AM, Ivan Voras wrote: >> There is nothing that can be done within the 6.x branch. 7.x contains >> many improvements but I think only 8.x will directly change the lockmgr >> and the namei cache. The best things you can try right now is to use >> 7-STABLE (or soon to be released 7.1; you might need tuning with >> 7.0-RELEASE) or try 8-CURRENT (it's quite stable). > > Really? Nothing? > > We get lockmgr-related panics on FreeBSD 7.0, as detailed elsewhere on > this list. > > Stability issues aside, what else would we need to tune on 7.0, besides > enabling the ULE scheduler, and how much benefit would we really get? > > These servers are in production, so 8-CURRENT is not an option. I've > already had my knuckles rapped by a customer for trying 7.1-PRERELEASE > on one of their machines. You are supposed to edit the uname info back to 7.0 before installing experimental 7.1 systems! Didn't you get the memo? > > Thanks, > Jeff > > > > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 25 05:34:09 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EA08D106568E; Thu, 25 Sep 2008 05:34:09 +0000 (UTC) (envelope-from freebsd-hackers@wheelhouse.org) Received: from mail.nearlyfreespeech.net (x1.phxe.nearlyfreespeech.net [208.94.116.235]) by mx1.freebsd.org (Postfix) with ESMTP id C21E18FC15; Thu, 25 Sep 2008 05:34:09 +0000 (UTC) (envelope-from freebsd-hackers@wheelhouse.org) Received: from [10.0.1.201] (78.193.33.65.cfl.res.rr.com [65.33.193.78]) by mail.nearlyfreespeech.net (Postfix) with ESMTPSA id E8002EBC4A; Wed, 24 Sep 2008 22:34:07 -0700 (MST) Message-Id: <57DCDBC7-8542-4082-8893-5B96DA92DA9A@wheelhouse.org> From: Jeff Wheelhouse To: John Baldwin In-Reply-To: <200809241234.55075.jhb@freebsd.org> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Date: Thu, 25 Sep 2008 01:34:06 -0400 References: <200809241234.55075.jhb@freebsd.org> X-Mailer: Apple Mail (2.929.2) Cc: freebsd-hackers@freebsd.org Subject: Re: panic: lockmgr on FreeBSD 7.0-RELEASE-p4 amd64 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Sep 2008 05:34:10 -0000 On Sep 24, 2008, at 12:34 PM, John Baldwin wrote: > On Wednesday 24 September 2008 12:17:56 pm Jeff Wheelhouse wrote: >> panic: lockmgr: thread 0xffffff0050858350, not exclusive lock holder >> 0xffffff00074959f0 unlocking >> cpuid = 0 >> KDB: stack backtrace: >> db_trace_self_wrapper() at db_trace_self_wrapper+0x2a >> panic() at panic+0x17a >> _lockmgr() at _lockmgr+0x872 >> VOP_UNLOCK_APV() at VOP_UNLOCK_APV+0x46 >> null_unlock() at null_unlock+0xff >> VOP_UNLOCK_APV() at VOP_UNLOCK_APV+0x46 >> nullfs_mount() at nullfs_mount+0x244 >> vfs_donmount() at vfs_donmount+0xe4d >> nmount() at nmount+0xa5 >> syscall() at syscall+0x254 >> Xfast_syscall() at Xfast_syscall+0xab >> --- syscall (378, FreeBSD ELF64, nmount), rip = 0x206845ac, rsp = >> 0x7fffffffdfc8, rbp = 0x7fffffffdfd0 --- > > Can you use gdb or the like to get the souce file/line for the > nullfs_mount+0x244 frame? Got it again, this time with the full debug kernel, and I'm getting the same weird results from gdb, so I'll go ahead and post it: panic: lockmgr: thread 0xffffff0003e499f0, not exclusive lock holder 0xffffff000a5e16a0 unlocking cpuid = 0 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a panic() at panic+0x17a _lockmgr() at _lockmgr+0x872 VOP_UNLOCK_APV() at VOP_UNLOCK_APV+0x46 null_unlock() at null_unlock+0xff VOP_UNLOCK_APV() at VOP_UNLOCK_APV+0x46 nullfs_mount() at nullfs_mount+0x244 vfs_donmount() at vfs_donmount+0xe4d nmount() at nmount+0xa5 syscall() at syscall+0x254 Xfast_syscall() at Xfast_syscall+0xab --- syscall (378, FreeBSD ELF64, nmount), rip = 0x206845ac, rsp = 0x7fffffffe1c8, rbp = 0x7fffffffe1d0 --- $ gdb /boot/kernel/nullfs.ko GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... (gdb) l *nullfs_mount+0x244 0x9c4 is in nullfs_mount (namei.h:163). 158 struct thread *td) 159 { 160 ndp->ni_cnd.cn_nameiop = op; 161 ndp->ni_cnd.cn_flags = flags; 162 ndp->ni_segflg = segflg; 163 ndp->ni_dirp = namep; 164 ndp->ni_cnd.cn_thread = td; 165 } 166 167 #define NDF_NO_DVP_RELE 0x00000001 (gdb) (That's NDINIT(), but line 163 doesn't look like it belongs in the middle of a call stack. There's a VOP_UNLOCK a few lines above NDINIT() in mount_nullfs(), and another one some ways farther on in the function.) The good news is we took this particular machine out of production and came up with a synthetic test based on our in-house code that can probably reliably reproduce this within a few minutes. As you might expect, the test involves hammering the same nullfs mount point with mounts and umounts from multiple processes without any external synchronization. Thanks, Jeff From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 25 13:30:02 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8CE8A1065742 for ; Thu, 25 Sep 2008 13:30:02 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from server.baldwin.cx (bigknife-pt.tunnel.tserv9.chi1.ipv6.he.net [IPv6:2001:470:1f10:75::2]) by mx1.freebsd.org (Postfix) with ESMTP id 18DFC8FC19 for ; Thu, 25 Sep 2008 13:30:01 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from localhost.corp.yahoo.com (john@localhost [IPv6:::1]) (authenticated bits=0) by server.baldwin.cx (8.14.2/8.14.2) with ESMTP id m8PDTWLY095309; Thu, 25 Sep 2008 09:29:55 -0400 (EDT) (envelope-from jhb@freebsd.org) From: John Baldwin To: Jeff Wheelhouse Date: Thu, 25 Sep 2008 08:45:05 -0400 User-Agent: KMail/1.9.7 References: <200809241234.55075.jhb@freebsd.org> <57DCDBC7-8542-4082-8893-5B96DA92DA9A@wheelhouse.org> In-Reply-To: <57DCDBC7-8542-4082-8893-5B96DA92DA9A@wheelhouse.org> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200809250845.06042.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH authentication, not delayed by milter-greylist-2.0.2 (server.baldwin.cx [IPv6:::1]); Thu, 25 Sep 2008 09:29:56 -0400 (EDT) X-Virus-Scanned: ClamAV 0.93.1/8329/Thu Sep 25 04:47:46 2008 on server.baldwin.cx X-Virus-Status: Clean X-Spam-Status: No, score=-2.6 required=4.2 tests=BAYES_00,NO_RELAYS autolearn=ham version=3.1.3 X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on server.baldwin.cx Cc: freebsd-hackers@freebsd.org Subject: Re: panic: lockmgr on FreeBSD 7.0-RELEASE-p4 amd64 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Sep 2008 13:30:02 -0000 On Thursday 25 September 2008 01:34:06 am Jeff Wheelhouse wrote: > > On Sep 24, 2008, at 12:34 PM, John Baldwin wrote: > > > On Wednesday 24 September 2008 12:17:56 pm Jeff Wheelhouse wrote: > >> panic: lockmgr: thread 0xffffff0050858350, not exclusive lock holder > >> 0xffffff00074959f0 unlocking > >> cpuid = 0 > >> KDB: stack backtrace: > >> db_trace_self_wrapper() at db_trace_self_wrapper+0x2a > >> panic() at panic+0x17a > >> _lockmgr() at _lockmgr+0x872 > >> VOP_UNLOCK_APV() at VOP_UNLOCK_APV+0x46 > >> null_unlock() at null_unlock+0xff > >> VOP_UNLOCK_APV() at VOP_UNLOCK_APV+0x46 > >> nullfs_mount() at nullfs_mount+0x244 > >> vfs_donmount() at vfs_donmount+0xe4d > >> nmount() at nmount+0xa5 > >> syscall() at syscall+0x254 > >> Xfast_syscall() at Xfast_syscall+0xab > >> --- syscall (378, FreeBSD ELF64, nmount), rip = 0x206845ac, rsp = > >> 0x7fffffffdfc8, rbp = 0x7fffffffdfd0 --- > > > > Can you use gdb or the like to get the souce file/line for the > > nullfs_mount+0x244 frame? > > Got it again, this time with the full debug kernel, and I'm getting > the same weird results from gdb, so I'll go ahead and post it: > > panic: lockmgr: thread 0xffffff0003e499f0, not exclusive lock holder > 0xffffff000a5e16a0 unlocking > cpuid = 0 > KDB: stack backtrace: > db_trace_self_wrapper() at db_trace_self_wrapper+0x2a > panic() at panic+0x17a > _lockmgr() at _lockmgr+0x872 > VOP_UNLOCK_APV() at VOP_UNLOCK_APV+0x46 > null_unlock() at null_unlock+0xff > VOP_UNLOCK_APV() at VOP_UNLOCK_APV+0x46 > nullfs_mount() at nullfs_mount+0x244 > vfs_donmount() at vfs_donmount+0xe4d > nmount() at nmount+0xa5 > syscall() at syscall+0x254 > Xfast_syscall() at Xfast_syscall+0xab > --- syscall (378, FreeBSD ELF64, nmount), rip = 0x206845ac, rsp = > 0x7fffffffe1c8, rbp = 0x7fffffffe1d0 --- > > $ gdb /boot/kernel/nullfs.ko > GNU gdb 6.1.1 [FreeBSD] > Copyright 2004 Free Software Foundation, Inc. > GDB is free software, covered by the GNU General Public License, and > you are > welcome to change it and/or distribute copies of it under certain > conditions. > Type "show copying" to see the conditions. > There is absolutely no warranty for GDB. Type "show warranty" for > details. > This GDB was configured as "amd64-marcel-freebsd"... > (gdb) l *nullfs_mount+0x244 > 0x9c4 is in nullfs_mount (namei.h:163). > 158 struct thread *td) > 159 { > 160 ndp->ni_cnd.cn_nameiop = op; > 161 ndp->ni_cnd.cn_flags = flags; > 162 ndp->ni_segflg = segflg; > 163 ndp->ni_dirp = namep; > 164 ndp->ni_cnd.cn_thread = td; > 165 } > 166 > 167 #define NDF_NO_DVP_RELE 0x00000001 > (gdb) > > (That's NDINIT(), but line 163 doesn't look like it belongs in the > middle of a call stack. There's a VOP_UNLOCK a few lines above > NDINIT() in mount_nullfs(), and another one some ways farther on in > the function.) It's probably the one just before the NDINIT (note that the return address in the call stack is pointing to the next instruction to be executed after the call to VOP_UNLOCK(), so sometimes it can end up referring to the next line in the source code from the actual function call): if ((mp->mnt_vnodecovered->v_op == &null_vnodeops) && VOP_ISLOCKED(mp->mnt_vnodecovered)) { VOP_UNLOCK(mp->mnt_vnodecovered, 0); isvnunlocked = 1; } /* * Find lower node */ NDINIT(ndp, LOOKUP, FOLLOW|LOCKLEAF, UIO_SYSSPACE, target, td); error = namei(ndp); Can you 'p *mp'? I'm curious if mp->mnt_vnodecovered is NULL (in which case, why didn't the two tests in the if() fail?) > The good news is we took this particular machine out of production and > came up with a synthetic test based on our in-house code that can > probably reliably reproduce this within a few minutes. As you might > expect, the test involves hammering the same nullfs mount point with > mounts and umounts from multiple processes without any external > synchronization. Ok. Reproducibility is good. :) -- John Baldwin From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 25 14:51:41 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0067B1065686 for ; Thu, 25 Sep 2008 14:51:40 +0000 (UTC) (envelope-from des@des.no) Received: from tim.des.no (tim.des.no [194.63.250.121]) by mx1.freebsd.org (Postfix) with ESMTP id B52BD8FC16 for ; Thu, 25 Sep 2008 14:51:40 +0000 (UTC) (envelope-from des@des.no) Received: from ds4.des.no (des.no [84.49.246.2]) by smtp.des.no (Postfix) with ESMTP id 4F391207E; Thu, 25 Sep 2008 16:51:39 +0200 (CEST) Received: by ds4.des.no (Postfix, from userid 1001) id 36262844BF; Thu, 25 Sep 2008 16:51:39 +0200 (CEST) From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= To: Jeff Wheelhouse References: <8185F68B-C443-4891-BEC2-5E3D453DDC93@wheelhouse.org> Date: Thu, 25 Sep 2008 16:51:39 +0200 In-Reply-To: <8185F68B-C443-4891-BEC2-5E3D453DDC93@wheelhouse.org> (Jeff Wheelhouse's message of "Wed, 24 Sep 2008 00:52:59 -0400") Message-ID: <86ljxgs2h0.fsf@ds4.des.no> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/23.0.60 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Cc: freebsd-hackers@freebsd.org Subject: Re: Major SMP problems with lstat/namei X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Sep 2008 14:51:41 -0000 Jeff Wheelhouse writes: > I've written a quick benchmark with a pair of tests to > simplify/measure the problem. [...] Care to share? DES --=20 Dag-Erling Sm=C3=B8rgrav - des@des.no From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 25 18:02:10 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 00A54106568E for ; Thu, 25 Sep 2008 18:02:10 +0000 (UTC) (envelope-from nparhar@gmail.com) Received: from ey-out-2122.google.com (ey-out-2122.google.com [74.125.78.27]) by mx1.freebsd.org (Postfix) with ESMTP id 7B0F08FC0A for ; Thu, 25 Sep 2008 18:02:09 +0000 (UTC) (envelope-from nparhar@gmail.com) Received: by ey-out-2122.google.com with SMTP id 6so162195eyi.7 for ; Thu, 25 Sep 2008 11:02:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=t9JJs1i2x1BAx4ZZMvOB/iQCdykF2GBrmRqCqkYl3KA=; b=E4dHfYxiEwqK9fr9CyfcDSm0teL0R1Vr8e3/ulW6/Y4YyhwrZZBy203Jdn07bN+C77 dQ9beN83zWmbN5V41dcG6tHXi80G3abPFoZMApA/mD54OmV/ixqoLOGkzplfpvUXpHIO 4cXexZ57aXiQNU5trP3/8cX993j/369ZaHh8o= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=sDOOZrn0DJKlFcsW03WawZggMcyiu3sV3NiFXXeiWJSF8UlLHBm7lwI8vYY89UQuoJ K+fF1mX4XTug+aqEXMfs8zPmtTkgLsmZEpXlPytx2wos2ts4sXu4hFim2swW1slwvmM2 eb8hJ7YA0g8goUYeOzGaADtQSizfKGfl2vIM4= Received: by 10.187.251.11 with SMTP id d11mr38901fas.104.1222365727903; Thu, 25 Sep 2008 11:02:07 -0700 (PDT) Received: by 10.187.182.13 with HTTP; Thu, 25 Sep 2008 11:02:07 -0700 (PDT) Message-ID: Date: Thu, 25 Sep 2008 11:02:07 -0700 From: "Navdeep Parhar" To: freebsd-hackers@freebsd.org In-Reply-To: <200809171628.52406.jhb@freebsd.org> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <200809171131.30819.jhb@freebsd.org> <200809171628.52406.jhb@freebsd.org> Subject: Re: kgdb's add-kld broken on amd64 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Sep 2008 18:02:10 -0000 > Well, this means gdb can't handle loading .o's, though I guess that is to be > expected. :( Even if I fix add-kld there's probably no way I can easily fix > the sharedlibrary stuff w/o ripping gdb itself up a bunch. > > -- > John Baldwin > I thought I'd leave this patch here on the list in case anyone finds it helpful. This patch works both when "add-kld ..." is explicitly called, and when kgdb autodetects KLDs and reads in their symbols automatically. The changes to kld.c are from what John B. posted in this thread earlier. The additional changes to exec.c mimic what the kernel does in link_elf_obj.c for amd64 modules. I used "info files" to verify that the segment reloc info was correct. Regards, Navdeep diff -r 3292f0cda869 contrib/gdb/gdb/exec.c --- a/contrib/gdb/gdb/exec.c Wed Sep 24 17:32:58 2008 -0700 +++ b/contrib/gdb/gdb/exec.c Wed Sep 24 19:54:31 2008 -0700 @@ -348,6 +348,18 @@ (*table_pp)->bfd = abfd; (*table_pp)->the_bfd_section = asect; (*table_pp)->addr = bfd_section_vma (abfd, asect); + if ((*table_pp)->addr == 0 && asect->index > 0) { + /* + * KLDs on amd64 go down this code path. Adjust the addr as is done in + * kern/link_elf_obj.c. We need the previous section's endaddr in order + * to do that. + */ + struct section_table *p = (*table_pp) - 1; + + (*table_pp)->addr = align_power(p->endaddr, + bfd_section_alignment(abfd, asect)); + } + (*table_pp)->endaddr = (*table_pp)->addr + bfd_section_size (abfd, asect); (*table_pp)++; } diff -r 3292f0cda869 gnu/usr.bin/gdb/kgdb/kld.c --- a/gnu/usr.bin/gdb/kgdb/kld.c Wed Sep 24 17:32:58 2008 -0700 +++ b/gnu/usr.bin/gdb/kgdb/kld.c Wed Sep 24 19:54:31 2008 -0700 @@ -37,6 +37,7 @@ #include #include #include +#include #include #include #include @@ -196,39 +197,14 @@ return (0); } -struct add_section_info { - struct section_addr_info *section_addrs; - int sect_index; - CORE_ADDR base_addr; -}; - -static void -add_section (bfd *bfd, asection *sect, void *arg) -{ - struct add_section_info *asi = arg; - CORE_ADDR address; - char *name; - - /* Ignore non-resident sections. */ - if ((bfd_get_section_flags(bfd, sect) & (SEC_ALLOC | SEC_LOAD)) == 0) - return; - - name = xstrdup(bfd_get_section_name(bfd, sect)); - make_cleanup(xfree, name); - address = asi->base_addr + bfd_get_section_vma(bfd, sect); - asi->section_addrs->other[asi->sect_index].name = name; - asi->section_addrs->other[asi->sect_index].addr = address; - asi->section_addrs->other[asi->sect_index].sectindex = sect->index; - printf_unfiltered("\t%s_addr = %s\n", name, local_hex_string(address)); - asi->sect_index++; -} - static void load_kld (char *path, CORE_ADDR base_addr, int from_tty) { - struct add_section_info asi; struct cleanup *cleanup; + struct section_addr_info *sap; + struct section_table *sections = NULL, *sections_end = NULL, *s; bfd *bfd; + int i; /* Open the kld. */ bfd = bfd_openr(path, gnutarget); @@ -244,19 +220,30 @@ if (bfd_get_section_by_name (bfd, ".text") == NULL) error("\"%s\": can't find text section", path); + /* Build a section table from the bfd and relocate the sections. */ + if (build_section_table(bfd, §ions, §ions_end)) + error("\"%s\": can't find file sections", path); + cleanup = make_cleanup(xfree, sections); + for (s = sections; s < sections_end; s++) { + s->addr += base_addr; + s->endaddr += base_addr; + } + + /* Build a section addr info to pass to symbol_file_add(). */ + sap = build_section_addr_info_from_section_table (sections, + sections_end); + cleanup = make_cleanup((make_cleanup_ftype *)free_section_addr_info, + sap); + printf_unfiltered("add symbol table from file \"%s\" at\n", path); - - /* Build a section table for symbol_file_add() from the bfd sections. */ - asi.section_addrs = alloc_section_addr_info(bfd_count_sections(bfd)); - cleanup = make_cleanup(xfree, asi.section_addrs); - asi.sect_index = 0; - asi.base_addr = base_addr; - bfd_map_over_sections(bfd, add_section, &asi); + for (i = 0; i < sap->num_sections; i++) + printf_unfiltered("\t%s_addr = %s\n", sap->other[i].name, + local_hex_string(sap->other[i].addr)); if (from_tty && (!query("%s", ""))) error("Not confirmed."); - symbol_file_add(path, from_tty, asi.section_addrs, 0, OBJF_USERLOADED); + symbol_file_add(path, from_tty, sap, 0, OBJF_USERLOADED); do_cleanups(cleanup); } From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 25 18:02:30 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0A852106568A for ; Thu, 25 Sep 2008 18:02:30 +0000 (UTC) (envelope-from freebsd-hackers@wheelhouse.org) Received: from mail.nearlyfreespeech.net (x1.phxe.nearlyfreespeech.net [208.94.116.235]) by mx1.freebsd.org (Postfix) with ESMTP id D85998FC1B for ; Thu, 25 Sep 2008 18:02:29 +0000 (UTC) (envelope-from freebsd-hackers@wheelhouse.org) Received: from [10.0.1.201] (78.193.33.65.cfl.res.rr.com [65.33.193.78]) by mail.nearlyfreespeech.net (Postfix) with ESMTPSA id 8EF41EBC4B; Thu, 25 Sep 2008 11:02:28 -0700 (MST) Message-Id: <05B718C6-BBC9-4B78-B580-4E250199DDCF@wheelhouse.org> From: Jeff Wheelhouse To: =?ISO-8859-1?Q?Dag-Erling_Sm=F8rgrav?= In-Reply-To: <86ljxgs2h0.fsf@ds4.des.no> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Apple Message framework v929.2) Date: Thu, 25 Sep 2008 14:02:26 -0400 References: <8185F68B-C443-4891-BEC2-5E3D453DDC93@wheelhouse.org> <86ljxgs2h0.fsf@ds4.des.no> X-Mailer: Apple Mail (2.929.2) Cc: freebsd-hackers@freebsd.org Subject: Re: Major SMP problems with lstat/namei X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Sep 2008 18:02:30 -0000 On Sep 25, 2008, at 10:51 AM, Dag-Erling Sm=F8rgrav wrote: > Jeff Wheelhouse writes: >> I've written a quick benchmark with a pair of tests to >> simplify/measure the problem. [...] > > Care to share? No problem: http://software.wheelhouse.org/rptest.tar.bz2 Thanks, Jeff From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 25 19:29:23 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BABDE106568C; Thu, 25 Sep 2008 19:29:23 +0000 (UTC) (envelope-from freebsd-hackers@wheelhouse.org) Received: from mail.nearlyfreespeech.net (x1.phxe.nearlyfreespeech.net [208.94.116.235]) by mx1.freebsd.org (Postfix) with ESMTP id 91BA28FC12; Thu, 25 Sep 2008 19:29:23 +0000 (UTC) (envelope-from freebsd-hackers@wheelhouse.org) Received: from [10.0.1.201] (78.193.33.65.cfl.res.rr.com [65.33.193.78]) by mail.nearlyfreespeech.net (Postfix) with ESMTPSA id 10A7CEBC1C; Thu, 25 Sep 2008 12:29:21 -0700 (MST) Message-Id: <61B6EB36-0E0C-4FFA-A84B-B434050B6244@wheelhouse.org> From: Jeff Wheelhouse To: John Baldwin In-Reply-To: <200809250845.06042.jhb@freebsd.org> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Date: Thu, 25 Sep 2008 15:29:20 -0400 References: <200809241234.55075.jhb@freebsd.org> <57DCDBC7-8542-4082-8893-5B96DA92DA9A@wheelhouse.org> <200809250845.06042.jhb@freebsd.org> X-Mailer: Apple Mail (2.929.2) Cc: freebsd-hackers@freebsd.org Subject: Re: panic: lockmgr on FreeBSD 7.0-RELEASE-p4 amd64 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Sep 2008 19:29:23 -0000 On Sep 25, 2008, at 8:45 AM, John Baldwin wrote: > It's probably the one just before the NDINIT (note that the return > address in > the call stack is pointing to the next instruction to be executed > after the > call to VOP_UNLOCK(), so sometimes it can end up referring to the > next line > in the source code from the actual function call): Seems like we're six or seven lines of source down, not on the next line, which was the source of my confusion. But if you're not confused, I won't be. :) > Can you 'p *mp'? I'm curious if mp->mnt_vnodecovered is NULL (in > which case, > why didn't the two tests in the if() fail?) Apparently I can't; we're stuck with DDB since we can't get a crash dump and the serial console goes to a hardware terminal server. I'm afraid I'm not quite clever enough to find the right data structure without symbols. I could try to throw a printf in there, or add a panic if mp- >mt_vnodecovered is NULL, if you think that would help. The printf will probably significantly alter timings, so I might need some guidance as far as what to print, and under what conditions. Thanks, Jeff From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 25 21:44:53 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 152CE1065689 for ; Thu, 25 Sep 2008 21:44:53 +0000 (UTC) (envelope-from jespasac@minibofh.org) Received: from smtp01.cdmon.com (smtp01.cdmon.com [212.36.75.232]) by mx1.freebsd.org (Postfix) with ESMTP id D10838FC20 for ; Thu, 25 Sep 2008 21:44:52 +0000 (UTC) (envelope-from jespasac@minibofh.org) Received: from desktop.melrose.com (unknown [84.77.66.237]) by smtp01.cdmon.com (Postfix) with ESMTP id C962BF7BA5 for ; Thu, 25 Sep 2008 23:25:54 +0200 (CEST) Message-ID: <48DC01DA.9040108@minibofh.org> Date: Thu, 25 Sep 2008 23:25:46 +0200 From: Jordi Espasa Clofent User-Agent: Thunderbird 2.0.0.12 (X11/20080313) MIME-Version: 1.0 To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit Subject: Regenerate ports tree from installed ports? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Sep 2008 21:44:53 -0000 Hi all, I suppose it's a dumb (and crazy) question, but as post subject says: ¿Is it possible to regenerate the /usr/ports tree _from_ the installed ports? Let's me to explain. I've a lot of production servers with 6.2 and 6.3 version, and I wanna update them to new 7.x branch. I'll use the 'traditional' method (cvsup, make buildworld, make kernel...etc) instead the new binary method (freebsd-update) because of I've a customized kernel in these boxes. Until that point, it's all right. But everybody knows that you have to recompile all your installed ports after the kernel and userland upgrade, to re-link the new libraries and disappeared ones. But in my case, these boxes are used as shared web-hostings, and a lot of particularities are present. Change the php version, for example, can means that tens of webs not work fine. If I would have a perfect ports tree it would be easy: simple recompile all the ports with portupgrade; but the nasty reality is that I'm not sure that the present ports tree is the identical mirror of installed ports. Even there are more possibilities that ports tree is more updated than the majority of installed ports. So, the only way I can see is the next: * update buildworld and kernel * remove /usr/ports * regenerate the /usr/ports from _installed_ ports * recompile all ports in new kernel/userland ¿Is it possible? Please, be polite if I'm saying a stupid things :P -- Thanks, Jordi Espasa Clofent From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 25 21:59:52 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 67DAD1065689 for ; Thu, 25 Sep 2008 21:59:52 +0000 (UTC) (envelope-from delphij@delphij.net) Received: from tarsier.delphij.net (unknown [IPv6:2001:470:1f03:2c9::2]) by mx1.freebsd.org (Postfix) with ESMTP id 11A178FC25 for ; Thu, 25 Sep 2008 21:59:52 +0000 (UTC) (envelope-from delphij@delphij.net) Received: from tarsier.geekcn.org (tarsier.geekcn.org [211.166.10.233]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by tarsier.delphij.net (Postfix) with ESMTPS id 0E50D28449 for ; Fri, 26 Sep 2008 05:59:51 +0800 (CST) Received: from localhost (tarsier.geekcn.org [211.166.10.233]) by tarsier.geekcn.org (Postfix) with ESMTP id 8A4A9F67811; Fri, 26 Sep 2008 05:59:50 +0800 (CST) X-Virus-Scanned: amavisd-new at geekcn.org Received: from tarsier.geekcn.org ([211.166.10.233]) by localhost (mail.geekcn.org [211.166.10.233]) (amavisd-new, port 10024) with ESMTP id MsA5ZHd9qz02; Fri, 26 Sep 2008 05:59:45 +0800 (CST) Received: from charlie.delphij.net (71.5.7.139.ptr.us.xo.net [71.5.7.139]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by tarsier.geekcn.org (Postfix) with ESMTPSA id 39F8FF66E11; Fri, 26 Sep 2008 05:59:44 +0800 (CST) DomainKey-Signature: a=rsa-sha1; s=default; d=delphij.net; c=nofws; q=dns; h=message-id:date:from:reply-to:organization:user-agent: mime-version:to:cc:subject:references:in-reply-to: x-enigmail-version:openpgp:content-type:content-transfer-encoding; b=CBX6QpApQv/eVhTb9bkWs45a14+D+C0mXg0zDO+0b4KCAqaZ4jkU98nt5rKkIpi2g BuOkzTvFWhdp69ILyFLVw== Message-ID: <48DC09CC.9010606@delphij.net> Date: Thu, 25 Sep 2008 14:59:40 -0700 From: Xin LI Organization: The FreeBSD Project User-Agent: Thunderbird 2.0.0.16 (X11/20080725) MIME-Version: 1.0 To: Jordi Espasa Clofent References: <48DC01DA.9040108@minibofh.org> In-Reply-To: <48DC01DA.9040108@minibofh.org> X-Enigmail-Version: 0.95.7 OpenPGP: id=18EDEBA0; url=http://www.delphij.net/delphij.asc Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit Cc: freebsd-hackers@freebsd.org Subject: Re: Regenerate ports tree from installed ports? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: d@delphij.net List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Sep 2008 21:59:52 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Jordi Espasa Clofent wrote: > Hi all, > > I suppose it's a dumb (and crazy) question, but as post subject says: > ¿Is it possible to regenerate the /usr/ports tree _from_ the installed > ports? As long as your ports tree is not very old, you will be able to use it in newer system but this is not always guaranteed. It is, however, possible to checkout ports tree from the date you specified with either cvsup or cvs. My personal suggestion is that when upgrading, try to build a new environment from scratch (say, everything is brand new) with ports named by 'pkg_info -qoa' on old system, and have the new environment reveal potential issues before making major updates to running system. Another possible approach is to update from time to time but this could cause you a lot of downtime. Cheers, - -- Xin LI http://www.delphij.net/ FreeBSD - The Power to Serve! -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (FreeBSD) iEYEARECAAYFAkjcCcsACgkQi+vbBBjt66D+5gCgraZv+FSEuxKFFiPNTan16Oyf HvEAoIt0OWlpSqgYwxo7Og/+7e9WBG2g =DJkP -----END PGP SIGNATURE----- From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 25 22:16:42 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BB1251065677 for ; Thu, 25 Sep 2008 22:16:42 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from server.baldwin.cx (bigknife-pt.tunnel.tserv9.chi1.ipv6.he.net [IPv6:2001:470:1f10:75::2]) by mx1.freebsd.org (Postfix) with ESMTP id 3DA6A8FC1E for ; Thu, 25 Sep 2008 22:16:42 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from localhost.corp.yahoo.com (john@localhost [IPv6:::1]) (authenticated bits=0) by server.baldwin.cx (8.14.2/8.14.2) with ESMTP id m8PMGZZ9099256; Thu, 25 Sep 2008 18:16:36 -0400 (EDT) (envelope-from jhb@freebsd.org) From: John Baldwin To: Jeff Wheelhouse Date: Thu, 25 Sep 2008 15:53:48 -0400 User-Agent: KMail/1.9.7 References: <200809250845.06042.jhb@freebsd.org> <61B6EB36-0E0C-4FFA-A84B-B434050B6244@wheelhouse.org> In-Reply-To: <61B6EB36-0E0C-4FFA-A84B-B434050B6244@wheelhouse.org> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200809251553.48978.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH authentication, not delayed by milter-greylist-2.0.2 (server.baldwin.cx [IPv6:::1]); Thu, 25 Sep 2008 18:16:36 -0400 (EDT) X-Virus-Scanned: ClamAV 0.93.1/8340/Thu Sep 25 16:13:43 2008 on server.baldwin.cx X-Virus-Status: Clean X-Spam-Status: No, score=-2.6 required=4.2 tests=BAYES_00,NO_RELAYS autolearn=ham version=3.1.3 X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on server.baldwin.cx Cc: freebsd-hackers@freebsd.org Subject: Re: panic: lockmgr on FreeBSD 7.0-RELEASE-p4 amd64 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Sep 2008 22:16:42 -0000 On Thursday 25 September 2008 03:29:20 pm Jeff Wheelhouse wrote: > > On Sep 25, 2008, at 8:45 AM, John Baldwin wrote: > > It's probably the one just before the NDINIT (note that the return > > address in > > the call stack is pointing to the next instruction to be executed > > after the > > call to VOP_UNLOCK(), so sometimes it can end up referring to the > > next line > > in the source code from the actual function call): > > Seems like we're six or seven lines of source down, not on the next > line, which was the source of my confusion. But if you're not > confused, I won't be. :) > > > Can you 'p *mp'? I'm curious if mp->mnt_vnodecovered is NULL (in > > which case, > > why didn't the two tests in the if() fail?) > > Apparently I can't; we're stuck with DDB since we can't get a crash > dump and the serial console goes to a hardware terminal server. I'm > afraid I'm not quite clever enough to find the right data structure > without symbols. > > I could try to throw a printf in there, or add a panic if mp- > >mt_vnodecovered is NULL, if you think that would help. The printf > will probably significantly alter timings, so I might need some > guidance as far as what to print, and under what conditions. You can use KTR instead of printf perhaps and then use 'show ktr' from DDB. This won't have the same impact on timing as printf(). I would include PIDs in any KTR traces you do so it's easier to parse the interleaved entries from multiple CPUs. Also, if you have a good test case, it might be worth grabbing a box w/o gmirror that can generate a crashdump and reproduce it there. -- John Baldwin From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 25 23:00:08 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 401401065689; Thu, 25 Sep 2008 23:00:08 +0000 (UTC) (envelope-from freebsd-hackers@wheelhouse.org) Received: from mail.nearlyfreespeech.net (x1.phxe.nearlyfreespeech.net [208.94.116.235]) by mx1.freebsd.org (Postfix) with ESMTP id 08AD58FC1E; Thu, 25 Sep 2008 23:00:07 +0000 (UTC) (envelope-from freebsd-hackers@wheelhouse.org) Received: from [10.0.1.201] (78.193.33.65.cfl.res.rr.com [65.33.193.78]) by mail.nearlyfreespeech.net (Postfix) with ESMTPSA id 08442EBC1C; Thu, 25 Sep 2008 16:00:05 -0700 (MST) Message-Id: From: Jeff Wheelhouse To: John Baldwin In-Reply-To: <200809241212.09920.jhb@freebsd.org> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Date: Thu, 25 Sep 2008 19:00:04 -0400 References: <8185F68B-C443-4891-BEC2-5E3D453DDC93@wheelhouse.org> <200809241212.09920.jhb@freebsd.org> X-Mailer: Apple Mail (2.929.2) Cc: freebsd-hackers@freebsd.org Subject: Re: Major SMP problems with lstat/namei X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Sep 2008 23:00:08 -0000 On Sep 24, 2008, at 12:12 PM, John Baldwin wrote: > Shared lookups only work on the NFS client in 6.x. I'm about to > turn them on > for UFS in HEAD (8.x) and will backport the needed fixes to 7.x > after 7.1 > (too risky to merge to 7.x this close to a release). OK, given all the patches you referenced, I did make a decent effort at backporting to 7.0. Here are the results: > Revision Changes Path > 1.87 +48 -29 src/sys/ufs/ufs/ufs_lookup.c Applied, changing a couple of VOP_ISLOCKED() and vn_lock() calls to add "td" as the last parameter. > Revision Changes Path > 1.53 +0 -1 src/sys/ufs/ufs/inode.h > 1.88 +10 -13 src/sys/ufs/ufs/ufs_lookup.c Applied successfully. > SVN rev 181018 on 2008-07-30 21:07:56Z by jhb NOT applied, because it was a whitespace tweak on ufs_lookup 1.89 which was not on your list. > SVN rev 183079 on 2008-09-16 16:18:36Z by jhb Applied cleanly. > Modified files: > sys/ufs/ufs inode.h ufs_lookup.c > Log: > SVN rev 183093 on 2008-09-16 19:06:44Z by jhb Applied cleanly. > 1.6 +2 -1 src/sys/ufs/ufs/dirhash.h > 1.24 +289 -227 src/sys/ufs/ufs/ufs_dirhash.c This patch applies but generates an awful lot of errors (enclosed at end). I think it may be dependent on the 8.0 lockmgr. Since most of the remaining patches are against the same files, I bailed out here. > SVN rev 183080 on 2008-09-16 16:23:56Z by jhb Skipped. > SVN rev 183280 on 2008-09-22 20:53:22Z by jhb Skipped. > There are additional fixes needed to fix races with umount -f, > so if you backport all this stuff, don't use umount -f or you > risk panics. :) Noted. > - mp->mnt_kern_flag |= MNTK_MPSAFE; > + mp->mnt_kern_flag |= MNTK_MPSAFE | MNTK_LOOKUP_SHARED; Applied. If I can make the backport work (a big if, given the dirhash changes) on 7.0, I am happy to maintain and test the diffs locally until after the 7.1 release and send them over to you at that time, if it will save you some effort. Thanks, Jeff Dirhash compile errors: /usr/src/sys/ufs/ufs/ufs_dirhash.c:132:37: error: macro "lockmgr" requires 4 arguments, but only 3 given /usr/src/sys/ufs/ufs/ufs_dirhash.c: In function 'ufsdirhash_release': /usr/src/sys/ufs/ufs/ufs_dirhash.c:132: error: 'lockmgr' undeclared (first use in this function) /usr/src/sys/ufs/ufs/ufs_dirhash.c:132: error: (Each undeclared identifier is reported only once /usr/src/sys/ufs/ufs/ufs_dirhash.c:132: error: for each function it appears in.) /usr/src/sys/ufs/ufs/ufs_dirhash.c:161:45: error: macro "lockmgr" requires 4 arguments, but only 3 given /usr/src/sys/ufs/ufs/ufs_dirhash.c: In function 'ufsdirhash_create': /usr/src/sys/ufs/ufs/ufs_dirhash.c:161: error: 'lockmgr' undeclared (first use in this function) /usr/src/sys/ufs/ufs/ufs_dirhash.c:178:17: error: macro "lockmgr" requires 4 arguments, but only 3 given /usr/src/sys/ufs/ufs/ufs_dirhash.c:193:60: error: macro "lockmgr" requires 4 arguments, but only 3 given /usr/src/sys/ufs/ufs/ufs_dirhash.c:198:42: error: macro "lockmgr" requires 4 arguments, but only 3 given /usr/src/sys/ufs/ufs/ufs_dirhash.c:222:39: error: macro "lockmgr" requires 4 arguments, but only 3 given /usr/src/sys/ufs/ufs/ufs_dirhash.c: In function 'ufsdirhash_acquire': /usr/src/sys/ufs/ufs/ufs_dirhash.c:222: error: 'lockmgr' undeclared (first use in this function) /usr/src/sys/ufs/ufs/ufs_dirhash.c:248:17: error: macro "lockmgr" requires 4 arguments, but only 3 given /usr/src/sys/ufs/ufs/ufs_dirhash.c: In function 'ufsdirhash_free': /usr/src/sys/ufs/ufs/ufs_dirhash.c:247: error: 'lockmgr' undeclared (first use in this function) /usr/src/sys/ufs/ufs/ufs_dirhash.c:385:39: error: macro "lockmgr" requires 4 arguments, but only 3 given /usr/src/sys/ufs/ufs/ufs_dirhash.c: In function 'ufsdirhash_build': /usr/src/sys/ufs/ufs/ufs_dirhash.c:385: error: 'lockmgr' undeclared (first use in this function) cc1: warnings being treated as errors /usr/src/sys/ufs/ufs/ufs_dirhash.c: In function 'ufsdirhash_free_locked': /usr/src/sys/ufs/ufs/ufs_dirhash.c:403: warning: implicit declaration of function 'lockmgr_assert' /usr/src/sys/ufs/ufs/ufs_dirhash.c:403: warning: nested extern declaration of 'lockmgr_assert' /usr/src/sys/ufs/ufs/ufs_dirhash.c:403: error: 'KA_LOCKED' undeclared (first use in this function) /usr/src/sys/ufs/ufs/ufs_dirhash.c:417:37: error: macro "lockmgr" requires 4 arguments, but only 3 given /usr/src/sys/ufs/ufs/ufs_dirhash.c:417: error: 'lockmgr' undeclared (first use in this function) /usr/src/sys/ufs/ufs/ufs_dirhash.c:418:35: error: macro "lockmgr" requires 4 arguments, but only 3 given /usr/src/sys/ufs/ufs/ufs_dirhash.c:438:37: error: macro "lockmgr" requires 4 arguments, but only 3 given /usr/src/sys/ufs/ufs/ufs_dirhash.c: In function 'ufsdirhash_lookup': /usr/src/sys/ufs/ufs/ufs_dirhash.c:473: error: 'KA_LOCKED' undeclared (first use in this function) /usr/src/sys/ufs/ufs/ufs_dirhash.c: In function 'ufsdirhash_findfree': /usr/src/sys/ufs/ufs/ufs_dirhash.c:621: error: 'KA_LOCKED' undeclared (first use in this function) /usr/src/sys/ufs/ufs/ufs_dirhash.c: In function 'ufsdirhash_enduseful': /usr/src/sys/ufs/ufs/ufs_dirhash.c:692: error: 'KA_LOCKED' undeclared (first use in this function) /usr/src/sys/ufs/ufs/ufs_dirhash.c: In function 'ufsdirhash_findslot': /usr/src/sys/ufs/ufs/ufs_dirhash.c:1001: error: 'KA_LOCKED' undeclared (first use in this function) /usr/src/sys/ufs/ufs/ufs_dirhash.c: In function 'ufsdirhash_delslot': /usr/src/sys/ufs/ufs/ufs_dirhash.c:1025: error: 'KA_LOCKED' undeclared (first use in this function) /usr/src/sys/ufs/ufs/ufs_dirhash.c:1101:59: error: macro "lockmgr" requires 4 arguments, but only 3 given /usr/src/sys/ufs/ufs/ufs_dirhash.c: In function 'ufsdirhash_recycle': /usr/src/sys/ufs/ufs/ufs_dirhash.c:1101: error: 'lockmgr' undeclared (first use in this function) From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 25 23:06:01 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1492A1065690; Thu, 25 Sep 2008 23:06:01 +0000 (UTC) (envelope-from freebsd-hackers@wheelhouse.org) Received: from mail.nearlyfreespeech.net (x1.phxe.nearlyfreespeech.net [208.94.116.235]) by mx1.freebsd.org (Postfix) with ESMTP id E11D28FC16; Thu, 25 Sep 2008 23:06:00 +0000 (UTC) (envelope-from freebsd-hackers@wheelhouse.org) Received: from [10.0.1.201] (78.193.33.65.cfl.res.rr.com [65.33.193.78]) by mail.nearlyfreespeech.net (Postfix) with ESMTPSA id 399FFEBC3C; Thu, 25 Sep 2008 16:06:00 -0700 (MST) Message-Id: From: Jeff Wheelhouse To: John Baldwin In-Reply-To: <200809251553.48978.jhb@freebsd.org> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Date: Thu, 25 Sep 2008 19:05:58 -0400 References: <200809250845.06042.jhb@freebsd.org> <61B6EB36-0E0C-4FFA-A84B-B434050B6244@wheelhouse.org> <200809251553.48978.jhb@freebsd.org> X-Mailer: Apple Mail (2.929.2) Cc: freebsd-hackers@freebsd.org Subject: Re: panic: lockmgr on FreeBSD 7.0-RELEASE-p4 amd64 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Sep 2008 23:06:01 -0000 On Sep 25, 2008, at 3:53 PM, John Baldwin wrote: > You can use KTR instead of printf perhaps and then use 'show ktr' > from DDB. > This won't have the same impact on timing as printf(). I would > include PIDs > in any KTR traces you do so it's easier to parse the interleaved > entries from > multiple CPUs. OK, while I am educating myself about how KTR works, what would you like to see? Just mp->mnt_vnodecovered? > Also, if you have a good test case, it might be worth > grabbing a box w/o gmirror that can generate a crashdump and > reproduce it > there. Not an option for us right now; spare 8-core boxes are hard to come by. We're looking for a USB hard drive or something we can dump to. Thanks, Jeff From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 25 23:46:39 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AA6FF1065694 for ; Thu, 25 Sep 2008 23:46:39 +0000 (UTC) (envelope-from daniel@dgnetwork.com.br) Received: from mail.mastercabo.com.br (mail.mastercabo.com.br [200.179.179.14]) by mx1.freebsd.org (Postfix) with SMTP id 7B77D8FC0C for ; Thu, 25 Sep 2008 23:46:38 +0000 (UTC) (envelope-from daniel@dgnetwork.com.br) Received: (qmail 53364 invoked by uid 1008); 25 Sep 2008 23:19:56 -0000 Received: from unknown (HELO ?192.168.10.74?) (200.209.221.29) by mail.mastercabo.com.br with SMTP; 25 Sep 2008 23:19:56 -0000 Message-ID: <48DC1C97.6010701@dgnetwork.com.br> Date: Thu, 25 Sep 2008 20:19:51 -0300 From: =?ISO-8859-1?Q?Daniel_Dias_Gon=E7alves?= User-Agent: Thunderbird 2.0.0.16 (Windows/20080708) MIME-Version: 1.0 To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: FreeBSD and ISCSI, Strange Problem X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: daniel@dgnetwork.com.br List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Sep 2008 23:46:39 -0000 I'm with a very strange problem in the FreeBSD 7.0R I use the iscsi_initiator to mount two devices of a Dell MD3000i, the file system is UFS. The problem occurs when I make a copy of a great directory for inside of the /data/email directory, passed some minutes of beginning of copy, the SSH connection stops to answer, when trying to open a new connection " Password: " it isn't requested, in the console, when typing the user "root" e to press enter, " Password: " also it isn't requested. The only way to come back is restarting the FreeBSD. When press CTRL+T during the freeze it is shown: # ssh root@10.0.20.10 load: 0.76 cmd: ssh 86930 [sbwait] 0.00u 0.01s 0% 2076k In another freeze it showed state [ufs] During freeze, send and receive pings work fine, but no service runing work. I already verified for some related LOG, however not see nothing related. MOUNT: /dev/da0s1g on /home (ufs, local, soft-updates) /dev/da0s1f on /tmp (ufs, local, soft-updates) /dev/da0s1d on /usr (ufs, local, soft-updates) /dev/da0s1e on /var (ufs, NFS exported, local, soft-updates) /dev/da2s1d on /data/db (ufs, NFS exported, local, soft-updates) /dev/da3s1d on /data/email (ufs, NFS exported, local, soft-updates) DMESG: Copyright (c) 1992-2008 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 7.0-RELEASE #0: Mon Sep 15 20:00:35 BRT 2008 root@srvdata1:/usr/src/sys/i386/compile/GENERIC Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Xeon(R) CPU E5410 @ 2.33GHz (2329.84-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0x10676 Stepping = 6 Features=0xbfebfbff Features2=0xce3bd> AMD Features=0x20100000 AMD Features2=0x1 Cores per package: 4 real memory = 3484745728 (3323 MB) avail memory = 3405615104 (3247 MB) ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 2 cpu3 (AP): APIC ID: 3 ioapic0: Changing APIC ID to 4 ioapic0 irqs 0-23 on motherboard kbd1 at kbdmux0 ath_hal: 0.9.20.3 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413) hptrr: HPT RocketRAID controller driver v1.1 (Sep 15 2008 20:00:23) acpi0: on motherboard acpi0: [ITHREAD] acpi0: Power Button (fixed) Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 acpi_hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 900 cpu0: on acpi0 est0: on cpu0 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr 720072006000720 device_attach: est0 attach returned 6 p4tcc0: on cpu0 cpu1: on acpi0 est1: on cpu1 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr 720072006000720 device_attach: est1 attach returned 6 p4tcc1: on cpu1 cpu2: on acpi0 est2: on cpu2 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr 720072006000720 device_attach: est2 attach returned 6 p4tcc2: on cpu2 cpu3: on acpi0 est3: on cpu3 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr 720072006000720 device_attach: est3 attach returned 6 p4tcc3: on cpu3 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib1: at device 2.0 on pci0 pci4: on pcib1 pcib2: at device 0.0 on pci4 pci5: on pcib2 pcib3: at device 0.0 on pci5 pci6: on pcib3 pcib4: at device 0.0 on pci6 pci7: on pcib4 bce0: mem 0xf4000000-0xf5ffffff irq 16 at device 0.0 on pci7 miibus0: on bce0 brgphy0: PHY 1 on miibus0 brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto bce0: Ethernet address: 00:1e:c9:b4:e5:2b bce0: [ITHREAD] bce0: ASIC (0x57081020); Rev (B2); Bus (PCI-X, 64-bit, 133MHz); F/W (0x04000305); Flags( MFW MSI ) pcib5: at device 1.0 on pci5 pci8: on pcib5 pcib6: at device 0.3 on pci4 pci9: on pcib6 pcib7: at device 3.0 on pci0 pci1: on pcib7 mpt0: port 0xec00-0xecff mem 0xfc8fc000-0xfc8fffff,0xfc8e0000-0xfc8effff irq 16 at device 0.0 on pci1 mpt0: [ITHREAD] mpt0: MPI Version=1.5.14.0 mpt0: mpt_cam_event: 0x16 mpt0: mpt_cam_event: 0x12 mpt0: mpt_cam_event: 0x12 mpt0: mpt_cam_event: 0x16 mpt0: mpt_cam_event: 0x16 mpt0: mpt_cam_event: 0x16 mpt0: mpt_cam_event: 0x21 mpt0: mpt_cam_event: 0x21 pcib8: at device 4.0 on pci0 pci10: on pcib8 em0: port 0xdce0-0xdcff mem 0xfc5e0000-0xfc5fffff,0xfc5c0000-0xfc5dffff irq 16 at device 0.0 on pci10 em0: Using MSI interrupt em0: Ethernet address: 00:15:17:8b:23:12 em0: [FILTER] pcib9: at device 5.0 on pci0 pci11: on pcib9 pcib10: at device 6.0 on pci0 pci12: on pcib10 em1: port 0xcce0-0xccff mem 0xfc3e0000-0xfc3fffff,0xfc3c0000-0xfc3dffff irq 16 at device 0.0 on pci12 em1: Using MSI interrupt em1: Ethernet address: 00:15:17:8b:4f:92 em1: [FILTER] pcib11: at device 7.0 on pci0 pci13: on pcib11 pci0: at device 8.0 (no driver attached) pcib12: at device 28.0 on pci0 pci2: on pcib12 pcib13: at device 0.0 on pci2 pci3: on pcib13 bce1: mem 0xf8000000-0xf9ffffff irq 16 at device 0.0 on pci3 miibus1: on bce1 brgphy1: PHY 1 on miibus1 brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto bce1: Ethernet address: 00:1e:c9:b4:e5:29 bce1: [ITHREAD] bce1: ASIC (0x57081020); Rev (B2); Bus (PCI-X, 64-bit, 133MHz); F/W (0x04000305); Flags( MFW MSI ) uhci0: port 0xace0-0xacff irq 21 at device 29.0 on pci0 uhci0: [GIANT-LOCKED] uhci0: [ITHREAD] usb0: on uhci0 usb0: USB revision 1.0 uhub0: on usb0 uhub0: 2 ports with 2 removable, self powered uhci1: port 0xacc0-0xacdf irq 20 at device 29.1 on pci0 uhci1: [GIANT-LOCKED] uhci1: [ITHREAD] usb1: on uhci1 usb1: USB revision 1.0 uhub1: on usb1 uhub1: 2 ports with 2 removable, self powered uhci2: port 0xaca0-0xacbf irq 21 at device 29.2 on pci0 uhci2: [GIANT-LOCKED] uhci2: [ITHREAD] usb2: on uhci2 usb2: USB revision 1.0 uhub2: on usb2 uhub2: 2 ports with 2 removable, self powered uhci3: port 0xac80-0xac9f irq 20 at device 29.3 on pci0 uhci3: [GIANT-LOCKED] uhci3: [ITHREAD] usb3: on uhci3 usb3: USB revision 1.0 uhub3: on usb3 uhub3: 2 ports with 2 removable, self powered ehci0: mem 0xfca00000-0xfca003ff irq 21 at device 29.7 on pci0 ehci0: [GIANT-LOCKED] ehci0: [ITHREAD] usb4: EHCI version 1.0 usb4: companion controllers, 2 ports each: usb0 usb1 usb2 usb3 usb4: on ehci0 usb4: USB revision 2.0 uhub4: on usb4 uhub4: 8 ports with 8 removable, self powered uhub5: on uhub4 uhub5: multiple transaction translators uhub5: 4 ports with 4 removable, self powered ukbd0: on uhub5 kbd2 at ukbd0 uhid0: on uhub5 umass0: on uhub4 pcib14: at device 30.0 on pci0 pci14: on pcib14 vgapci0: port 0xbc00-0xbcff mem 0xd8000000-0xdfffffff,0xfc2d0000-0xfc2dffff irq 19 at device 13.0 on pci14 isab0: at device 31.0 on pci0 isa0: on isab0 atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xfc00-0xfc0f at device 31.1 on pci0 ata0: on atapci0 ata0: [ITHREAD] ata1: on atapci0 ata1: [ITHREAD] fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 fdc0: does not respond device_attach: fdc0 attach returned 6 sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 sio0: type 16550A sio0: [FILTER] sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 on acpi0 sio1: type 16550A sio1: [FILTER] fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 fdc0: does not respond device_attach: fdc0 attach returned 6 pmtimer0 on isa0 orm0: at iomem 0xc0000-0xc8fff,0xcf000-0xcffff,0xec000-0xeffff pnpid ORM0000 on isa0 atkbdc0: at port 0x60,0x64 on isa0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] atkbd0: [ITHREAD] ppc0: parallel port not found. sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 Timecounters tick every 1.000 msec hptrr: no controller detected. acd0: CDRW at ata0-master UDMA33 ses0 at mpt0 bus 0 target 8 lun 0 ses0: Fixed Enclosure Services SCSI-5 device ses0: 300.000MB/s transfers ses0: SCSI-3 SES Device da0 at mpt0 bus 0 target 0 lun 0 da0: Fixed Direct Access SCSI-5 device da0: 300.000MB/s transfers da0: Command Queueing Enabled da0: 237464MB (486326272 512 byte sectors: 255H 63S/T 30272C) da1 at umass-sim0 bus 0 target 0 lun 0 da1: Removable Direct Access SCSI-2 device da1: 40.000MB/s transfers da1: 959MB (1964032 512 byte sectors: 64H 32S/T 959C) SMP: AP CPU #3 Launched! SMP: AP CPU #1 Launched! SMP: AP CPU #2 Launched! GEOM_LABEL: Label for provider da1s4 is msdosfs/Hypervisor0. GEOM_LABEL: Label for provider da1s5 is msdosfs/Hypervisor1. GEOM_LABEL: Label for provider da1s6 is msdosfs/Hypervisor2. GEOM_LABEL: Label for provider da1s8 is msdosfs/Hypervisor3. Trying to mount root from ufs:/dev/da0s1a bce0: link state changed to UP em0: link state changed to UP lagg0: link state changed to UP em1: link state changed to UP em1: link state changed to DOWN em1: link state changed to UP ic_init: cam subsystem initialized 0] i_create_session: sessionID=0 0] i_create_session: error=0 0] i_setopt: maxRecvDataSegmentLength=65535 0] i_setopt: maXmitDataSegmentLength=8192 0] i_setopt: maxBurstLength=131072 0] i_setopt: maxRecvDataSegmentLength=65535 0] i_setopt: maXmitDataSegmentLength=65024 0] i_setopt: maxBurstLength=131072 0] i_setopt: opt.headerDigest='None' 0] ism_fullfeature: flag=1 0] _scan_target: target=0 da2 at iscsi0 bus 0 target 0 lun 0 da2: Fixed Direct Access SCSI-5 device da3 at iscsi0 bus 0 target 0 lun 1 da3: Fixed Direct Access SCSI-5 device Somebody can help me ? Thanks. Daniel From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 25 23:56:25 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2AF42106569C; Thu, 25 Sep 2008 23:56:25 +0000 (UTC) (envelope-from fbsd-hackers@mawer.org) Received: from outbound.icp-qv1-irony-out3.iinet.net.au (outbound.icp-qv1-irony-out3.iinet.net.au [203.59.1.148]) by mx1.freebsd.org (Postfix) with ESMTP id 682288FC1A; Thu, 25 Sep 2008 23:56:24 +0000 (UTC) (envelope-from fbsd-hackers@mawer.org) X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: Am0BADK720jLzq3r/2dsb2JhbAAItQOHC4Fl X-IronPort-AV: E=Sophos;i="4.33,309,1220198400"; d="scan'208";a="327461079" Received: from unknown (HELO [10.24.1.1]) ([203.206.173.235]) by outbound.icp-qv1-irony-out3.iinet.net.au with ESMTP; 26 Sep 2008 07:26:36 +0800 Message-ID: <48DC1D93.1000108@mawer.org> Date: Fri, 26 Sep 2008 09:24:03 +1000 From: Antony Mawer User-Agent: Thunderbird 2.0.0.16 (Windows/20080708) MIME-Version: 1.0 To: Jeff Wheelhouse References: <200809250845.06042.jhb@freebsd.org> <61B6EB36-0E0C-4FFA-A84B-B434050B6244@wheelhouse.org> <200809251553.48978.jhb@freebsd.org> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-hackers@freebsd.org Subject: Re: panic: lockmgr on FreeBSD 7.0-RELEASE-p4 amd64 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Sep 2008 23:56:25 -0000 Jeff Wheelhouse wrote: >> Also, if you have a good test case, it might be worth >> grabbing a box w/o gmirror that can generate a crashdump and reproduce it >> there. > > Not an option for us right now; spare 8-core boxes are hard to come by. > We're looking for a USB hard drive or something we can dump to. Can you set your dump device to the underlying GEOM component's swap partition rather than to the gmirror device...? -- Antony From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 26 06:39:30 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2E8C41065694 for ; Fri, 26 Sep 2008 06:39:30 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from cs1.cs.huji.ac.il (cs1.cs.huji.ac.il [132.65.16.10]) by mx1.freebsd.org (Postfix) with ESMTP id D9F448FC1A for ; Fri, 26 Sep 2008 06:39:29 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from pampa.cs.huji.ac.il ([132.65.80.32]) by cs1.cs.huji.ac.il with esmtp id 1Kj6ho-000F3b-6q; Fri, 26 Sep 2008 09:21:32 +0300 X-Mailer: exmh version 2.7.2 01/07/2005 with nmh-1.2 To: daniel@dgnetwork.com.br In-reply-to: <48DC1C97.6010701@dgnetwork.com.br> References: <48DC1C97.6010701@dgnetwork.com.br> Comments: In-reply-to =?ISO-8859-1?Q?Daniel_Dias_Gon=E7alves?= message dated "Thu, 25 Sep 2008 20:19:51 -0300." Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Fri, 26 Sep 2008 09:21:32 +0300 From: Danny Braniss Message-ID: Cc: freebsd-hackers@freebsd.org, freebsd-scsi@freebsd.org Subject: Re: FreeBSD and ISCSI, Strange Problem X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Sep 2008 06:39:30 -0000 > I'm with a very strange problem in the FreeBSD 7.0R > I use the iscsi_initiator to mount two devices of a Dell MD3000i, the > file system is UFS. > The problem occurs when I make a copy of a great directory for inside of > the /data/email directory, passed some minutes of beginning of copy, the > SSH connection stops to answer, when trying to open a new connection " > Password: " it isn't requested, in the console, when typing the user > "root" e to press enter, " Password: " also it isn't requested. The only > way to come back is restarting the FreeBSD. > > When press CTRL+T during the freeze it is shown: > # ssh root@10.0.20.10 > load: 0.76 cmd: ssh 86930 [sbwait] 0.00u 0.01s 0% 2076k > > In another freeze it showed state [ufs] > During freeze, send and receive pings work fine, but no service runing work. > > I already verified for some related LOG, however not see nothing related. hi Daniel, the problem is probably that iscsi is deadlocked, so fetch ftp://ftp/users/danny/freebsd/iscsi-2.1.tar.gz cd /usr/src tar xpzf /path-to-tar-file/iscsi-2.1.tar.gz (cd sys/modules/iscsi/initiator; make; make install) (cd sbin/iscontrol;make; make install) probably the safest is now to reboot. Let me know what happens. obrigado (thanks?), danny From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 26 07:04:17 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CD4551065688; Fri, 26 Sep 2008 07:04:17 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from cs1.cs.huji.ac.il (cs1.cs.huji.ac.il [132.65.16.10]) by mx1.freebsd.org (Postfix) with ESMTP id 8A0138FC08; Fri, 26 Sep 2008 07:04:17 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from pampa.cs.huji.ac.il ([132.65.80.32]) by cs1.cs.huji.ac.il with esmtp id 1Kj7NA-000FXz-3F; Fri, 26 Sep 2008 10:04:16 +0300 X-Mailer: exmh version 2.7.2 01/07/2005 with nmh-1.2 To: freebsd-stable@freebsd.org, freebsd-hackers@freebsd.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Fri, 26 Sep 2008 10:04:16 +0300 From: Danny Braniss Message-ID: Cc: Subject: bad NFS/UDP performance X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Sep 2008 07:04:17 -0000 Hi, There seems to be some serious degradation in performance. Under 7.0 I get about 90 MB/s (on write), while, on the same machine under 7.1 it drops to 20! Any ideas? thanks, danny From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 26 08:18:09 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7D48F106568F for ; Fri, 26 Sep 2008 08:18:09 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from QMTA03.westchester.pa.mail.comcast.net (qmta03.westchester.pa.mail.comcast.net [76.96.62.32]) by mx1.freebsd.org (Postfix) with ESMTP id 298E08FC20 for ; Fri, 26 Sep 2008 08:18:08 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from OMTA08.westchester.pa.mail.comcast.net ([76.96.62.12]) by QMTA03.westchester.pa.mail.comcast.net with comcast id KL0H1a0040Fqzac53LJ8AC; Fri, 26 Sep 2008 08:18:08 +0000 Received: from koitsu.dyndns.org ([67.180.253.227]) by OMTA08.westchester.pa.mail.comcast.net with comcast id KLJ71a0014v8bD73ULJ7cC; Fri, 26 Sep 2008 08:18:08 +0000 X-Authority-Analysis: v=1.0 c=1 a=6I5d2MoRAAAA:8 a=QycZ5dHgAAAA:8 a=shU0YM2z2wlRnnYB8ekA:9 a=-tc-E7POTj5uMGj4HiXgawpQzvYA:4 a=EoioJ0NPDVgA:10 a=LY0hPdMaydYA:10 Received: by icarus.home.lan (Postfix, from userid 1000) id CC0E0C9432; Fri, 26 Sep 2008 01:18:06 -0700 (PDT) Date: Fri, 26 Sep 2008 01:18:06 -0700 From: Jeremy Chadwick To: Danny Braniss Message-ID: <20080926081806.GA19055@icarus.home.lan> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.18 (2008-05-17) Cc: freebsd-hackers@freebsd.org, freebsd-stable@freebsd.org Subject: Re: bad NFS/UDP performance X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Sep 2008 08:18:09 -0000 On Fri, Sep 26, 2008 at 10:04:16AM +0300, Danny Braniss wrote: > Hi, > There seems to be some serious degradation in performance. > Under 7.0 I get about 90 MB/s (on write), while, on the same machine > under 7.1 it drops to 20! > Any ideas? 1) Network card driver changes, 2) This could be relevant, but rwatson@ will need to help determine that. http://lists.freebsd.org/pipermail/freebsd-stable/2008-September/045109.html -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 26 09:20:16 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 178A61065688 for ; Fri, 26 Sep 2008 09:20:16 +0000 (UTC) (envelope-from des@des.no) Received: from tim.des.no (tim.des.no [194.63.250.121]) by mx1.freebsd.org (Postfix) with ESMTP id CC2CF8FC1D for ; Fri, 26 Sep 2008 09:20:15 +0000 (UTC) (envelope-from des@des.no) Received: from ds4.des.no (des.no [84.49.246.2]) by smtp.des.no (Postfix) with ESMTP id C6504208C; Fri, 26 Sep 2008 11:20:14 +0200 (CEST) Received: by ds4.des.no (Postfix, from userid 1001) id A3A4F8444E; Fri, 26 Sep 2008 11:20:14 +0200 (CEST) From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= To: Jeff Wheelhouse References: <8185F68B-C443-4891-BEC2-5E3D453DDC93@wheelhouse.org> <86ljxgs2h0.fsf@ds4.des.no> <05B718C6-BBC9-4B78-B580-4E250199DDCF@wheelhouse.org> Date: Fri, 26 Sep 2008 11:20:14 +0200 In-Reply-To: <05B718C6-BBC9-4B78-B580-4E250199DDCF@wheelhouse.org> (Jeff Wheelhouse's message of "Thu, 25 Sep 2008 14:02:26 -0400") Message-ID: <868wtf8drl.fsf@ds4.des.no> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/23.0.60 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Cc: freebsd-hackers@freebsd.org Subject: Re: Major SMP problems with lstat/namei X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Sep 2008 09:20:16 -0000 Jeff Wheelhouse writes: > http://software.wheelhouse.org/rptest.tar.bz2 Thanks. I get similar results on head; vfs.lookup_shared actually seems to *reduce* performance by about 10% - 20%. I ran the test on both UFS and ZFS; there is no significant difference. DES --=20 Dag-Erling Sm=C3=B8rgrav - des@des.no From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 26 09:27:10 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6EE031065692; Fri, 26 Sep 2008 09:27:10 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from cs1.cs.huji.ac.il (cs1.cs.huji.ac.il [132.65.16.10]) by mx1.freebsd.org (Postfix) with ESMTP id 23BB68FC1E; Fri, 26 Sep 2008 09:27:09 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from pampa.cs.huji.ac.il ([132.65.80.32]) by cs1.cs.huji.ac.il with esmtp id 1Kj9bR-000H7t-0g; Fri, 26 Sep 2008 12:27:09 +0300 X-Mailer: exmh version 2.7.2 01/07/2005 with nmh-1.2 To: Jeremy Chadwick In-reply-to: <20080926081806.GA19055@icarus.home.lan> References: <20080926081806.GA19055@icarus.home.lan> Comments: In-reply-to Jeremy Chadwick message dated "Fri, 26 Sep 2008 01:18:06 -0700." Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Fri, 26 Sep 2008 12:27:08 +0300 From: Danny Braniss Message-ID: Cc: freebsd-hackers@freebsd.org, freebsd-stable@freebsd.org Subject: Re: bad NFS/UDP performance X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Sep 2008 09:27:10 -0000 > On Fri, Sep 26, 2008 at 10:04:16AM +0300, Danny Braniss wrote: > > Hi, > > There seems to be some serious degradation in performance. > > Under 7.0 I get about 90 MB/s (on write), while, on the same machine > > under 7.1 it drops to 20! > > Any ideas? > > 1) Network card driver changes, could be, but at least iperf/tcp is ok - can't get udp numbers, do you know of any tool to measure udp performance? BTW, I also checked on different hardware, and the badness is there. > > 2) This could be relevant, but rwatson@ will need to help determine > that. > http://lists.freebsd.org/pipermail/freebsd-stable/2008-September/045109.html gut feeling is that it's somewhere else: Writing 16 MB file BS Count /---- 7.0 ------/ /---- 7.1 -----/ 1*512 32768 0.16s 98.11MB/s 0.43s 37.18MB/s 2*512 16384 0.17s 92.04MB/s 0.46s 34.79MB/s 4*512 8192 0.16s 101.88MB/s 0.43s 37.26MB/s 8*512 4096 0.16s 99.86MB/s 0.44s 36.41MB/s 16*512 2048 0.16s 100.11MB/s 0.50s 32.03MB/s 32*512 1024 0.26s 61.71MB/s 0.46s 34.79MB/s 64*512 512 0.22s 71.45MB/s 0.45s 35.41MB/s 128*512 256 0.21s 77.84MB/s 0.51s 31.34MB/s 256*512 128 0.19s 82.47MB/s 0.43s 37.22MB/s 512*512 64 0.18s 87.77MB/s 0.49s 32.69MB/s 1024*512 32 0.18s 89.24MB/s 0.47s 34.02MB/s 2048*512 16 0.17s 91.81MB/s 0.30s 53.41MB/s 4096*512 8 0.16s 100.56MB/s 0.42s 38.07MB/s 8192*512 4 0.82s 19.56MB/s 0.80s 19.95MB/s 16384*512 2 0.82s 19.63MB/s 0.95s 16.80MB/s 32768*512 1 0.81s 19.69MB/s 0.96s 16.64MB/s Average: 75.86 33.00 the nfs filer is a NetWork Appliance, and is in use, so i get fluctuations in the measurements, but the relation are similar, good on 7.0, bad on 7.1 Cheers, danny From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 26 09:52:32 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 64784106568C for ; Fri, 26 Sep 2008 09:52:32 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from QMTA05.emeryville.ca.mail.comcast.net (qmta05.emeryville.ca.mail.comcast.net [76.96.30.48]) by mx1.freebsd.org (Postfix) with ESMTP id 48EEC8FC1B for ; Fri, 26 Sep 2008 09:52:32 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from OMTA01.emeryville.ca.mail.comcast.net ([76.96.30.11]) by QMTA05.emeryville.ca.mail.comcast.net with comcast id KMLH1a0040EPchoA5MsYYK; Fri, 26 Sep 2008 09:52:32 +0000 Received: from koitsu.dyndns.org ([67.180.253.227]) by OMTA01.emeryville.ca.mail.comcast.net with comcast id KMsW1a00A4v8bD78MMsXCm; Fri, 26 Sep 2008 09:52:31 +0000 X-Authority-Analysis: v=1.0 c=1 a=6I5d2MoRAAAA:8 a=QycZ5dHgAAAA:8 a=80Qts77T3K_gKBR54JcA:9 a=-OmQwcjttRvdMHV04IW6M1UCvTUA:4 a=EoioJ0NPDVgA:10 a=LY0hPdMaydYA:10 Received: by icarus.home.lan (Postfix, from userid 1000) id 8D6ACC9437; Fri, 26 Sep 2008 02:52:30 -0700 (PDT) Date: Fri, 26 Sep 2008 02:52:30 -0700 From: Jeremy Chadwick To: Danny Braniss Message-ID: <20080926095230.GA20789@icarus.home.lan> References: <20080926081806.GA19055@icarus.home.lan> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.18 (2008-05-17) Cc: freebsd-hackers@freebsd.org, freebsd-stable@freebsd.org Subject: Re: bad NFS/UDP performance X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Sep 2008 09:52:32 -0000 On Fri, Sep 26, 2008 at 12:27:08PM +0300, Danny Braniss wrote: > > On Fri, Sep 26, 2008 at 10:04:16AM +0300, Danny Braniss wrote: > > > Hi, > > > There seems to be some serious degradation in performance. > > > Under 7.0 I get about 90 MB/s (on write), while, on the same machine > > > under 7.1 it drops to 20! > > > Any ideas? > > > > 1) Network card driver changes, > could be, but at least iperf/tcp is ok - can't get udp numbers, do you > know of any tool to measure udp performance? > BTW, I also checked on different hardware, and the badness is there. According to INDEX, benchmarks/iperf does UDP bandwidth testing. benchmarks/nttcp should as well. What network card is in use? If Intel, what driver version (should be in dmesg). > > 2) This could be relevant, but rwatson@ will need to help determine > > that. > > http://lists.freebsd.org/pipermail/freebsd-stable/2008-September/045109.html > > gut feeling is that it's somewhere else: > > Writing 16 MB file > BS Count /---- 7.0 ------/ /---- 7.1 -----/ > 1*512 32768 0.16s 98.11MB/s 0.43s 37.18MB/s > 2*512 16384 0.17s 92.04MB/s 0.46s 34.79MB/s > 4*512 8192 0.16s 101.88MB/s 0.43s 37.26MB/s > 8*512 4096 0.16s 99.86MB/s 0.44s 36.41MB/s > 16*512 2048 0.16s 100.11MB/s 0.50s 32.03MB/s > 32*512 1024 0.26s 61.71MB/s 0.46s 34.79MB/s > 64*512 512 0.22s 71.45MB/s 0.45s 35.41MB/s > 128*512 256 0.21s 77.84MB/s 0.51s 31.34MB/s > 256*512 128 0.19s 82.47MB/s 0.43s 37.22MB/s > 512*512 64 0.18s 87.77MB/s 0.49s 32.69MB/s > 1024*512 32 0.18s 89.24MB/s 0.47s 34.02MB/s > 2048*512 16 0.17s 91.81MB/s 0.30s 53.41MB/s > 4096*512 8 0.16s 100.56MB/s 0.42s 38.07MB/s > 8192*512 4 0.82s 19.56MB/s 0.80s 19.95MB/s > 16384*512 2 0.82s 19.63MB/s 0.95s 16.80MB/s > 32768*512 1 0.81s 19.69MB/s 0.96s 16.64MB/s > > Average: 75.86 33.00 > > the nfs filer is a NetWork Appliance, and is in use, so i get fluctuations in > the > measurements, but the relation are similar, good on 7.0, bad on 7.1 Do you have any NFS-related tunings in /etc/rc.conf or /etc/sysctl.conf? -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 26 10:22:59 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D012F1065687 for ; Fri, 26 Sep 2008 10:22:59 +0000 (UTC) (envelope-from jespasac@minibofh.org) Received: from smtp01.cdmon.com (smtp01.cdmon.com [212.36.75.232]) by mx1.freebsd.org (Postfix) with ESMTP id 934DA8FC29 for ; Fri, 26 Sep 2008 10:22:59 +0000 (UTC) (envelope-from jespasac@minibofh.org) Received: from jespasac.cdmon.com (62.Red-217-126-43.staticIP.rima-tde.net [217.126.43.62]) by smtp01.cdmon.com (Postfix) with ESMTP id 7EC41F7D62; Fri, 26 Sep 2008 12:22:56 +0200 (CEST) Message-ID: <48DCB7FF.1000604@minibofh.org> Date: Fri, 26 Sep 2008 12:22:55 +0200 From: Jordi Espasa Clofent User-Agent: Thunderbird 2.0.0.16 (X11/20080724) MIME-Version: 1.0 To: freebsd-stable@freebsd.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit Cc: freebsd-hackers@freebsd.org Subject: Rare problems in upgrade process (corrupted FS?) X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Sep 2008 10:22:59 -0000 Hi all, I'm traying to update a FreeBSD server box from 6.3p11 to 7.0 and I've found a rare problems. 1) I do the sync process with csup(1); next I go into /usr/src/sys/amd64/conf to edit the GENERIC file (I use a custimized kernels) and this file doesn't exists. Mmmm.... I decide to repeat the process againt other cvsup mirror but I get the same results: GENERIC file isn't there. 2) I go to FreeBSD CVSWeb , locate the GENERIC file under the 7_0 tag, copy and paste. Yes, I know: a very nasty process. The big problem appears when I try to do 'make cleandir' and others. I get the next outputs: # pwd /usr/src # make cleandir make: don't know how to make cleandir. Stop # make buildworld make: don't know how to make buildworld. Stop # ls -l /usr/bin/make -r-xr-xr-x 1 root wheel 351024 Aug 18 13:19 /usr/bin/make # file /usr/bin/make /usr/bin/make: ELF 64-bit LSB executable, AMD x86-64, version 1 (FreeBSD), for FreeBSD 6.3, statically linked, stripped ¿?¿?¿?¿ * I reboot the machine (because of I suspect a very weird FS problem), boot in single user mode and do a 'fsck -fy'. Effectively, the fsck(8) found and repair several errors. Epecially, one error claims my attention: SUPERBLOCK. * After the theorical FS reparation I'm again in the point 1. ¿Any clues? -- Thanks, Jordi Espasa Clofent From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 26 10:47:34 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 739BF106568C for ; Fri, 26 Sep 2008 10:47:34 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from QMTA08.emeryville.ca.mail.comcast.net (qmta08.emeryville.ca.mail.comcast.net [76.96.30.80]) by mx1.freebsd.org (Postfix) with ESMTP id 595B88FC14 for ; Fri, 26 Sep 2008 10:47:34 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from OMTA03.emeryville.ca.mail.comcast.net ([76.96.30.27]) by QMTA08.emeryville.ca.mail.comcast.net with comcast id KNZT1a0090b6N64A8NnaXV; Fri, 26 Sep 2008 10:47:34 +0000 Received: from koitsu.dyndns.org ([67.180.253.227]) by OMTA03.emeryville.ca.mail.comcast.net with comcast id KNnY1a0054v8bD78PNnZjQ; Fri, 26 Sep 2008 10:47:33 +0000 X-Authority-Analysis: v=1.0 c=1 a=TjwJzeWVk3IA:10 a=yqOlm6tamNsA:10 a=QycZ5dHgAAAA:8 a=IZi5DtbZEr1s2HTaYrAA:9 a=9tpjFpv4-tXV8Y3hOiMA:7 a=xoHNCO4gei0vjgdv8Pj4pcdGjO8A:4 a=EoioJ0NPDVgA:10 a=LY0hPdMaydYA:10 Received: by icarus.home.lan (Postfix, from userid 1000) id AAFFBC9432; Fri, 26 Sep 2008 03:47:32 -0700 (PDT) Date: Fri, 26 Sep 2008 03:47:32 -0700 From: Jeremy Chadwick To: Jordi Espasa Clofent Message-ID: <20080926104732.GA22641@icarus.home.lan> References: <48DCB7FF.1000604@minibofh.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <48DCB7FF.1000604@minibofh.org> User-Agent: Mutt/1.5.18 (2008-05-17) Cc: freebsd-hackers@freebsd.org, freebsd-stable@freebsd.org Subject: Re: Rare problems in upgrade process (corrupted FS?) X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Sep 2008 10:47:34 -0000 On Fri, Sep 26, 2008 at 12:22:55PM +0200, Jordi Espasa Clofent wrote: > Hi all, > > I'm traying to update a FreeBSD server box from 6.3p11 to 7.0 and I've > found a rare problems. > > 1) I do the sync process with csup(1); next I go into > /usr/src/sys/amd64/conf to edit the GENERIC file (I use a custimized > kernels) and this file doesn't exists. Mmmm.... I decide to repeat the > process againt other cvsup mirror but I get the same results: GENERIC > file isn't there. > > 2) I go to FreeBSD CVSWeb , locate the GENERIC file under the 7_0 tag, > copy and paste. Yes, I know: a very nasty process. The big problem > appears when I try to do 'make cleandir' and others. I get the next > outputs: > > # pwd > /usr/src > # make cleandir > make: don't know how to make cleandir. Stop > # make buildworld > make: don't know how to make buildworld. Stop > # ls -l /usr/bin/make > -r-xr-xr-x 1 root wheel 351024 Aug 18 13:19 /usr/bin/make > # file /usr/bin/make > /usr/bin/make: ELF 64-bit LSB executable, AMD x86-64, version 1 > (FreeBSD), for FreeBSD 6.3, statically linked, stripped Looks to me like you have no /usr/src/Makefile. > * After the theorical FS reparation I'm again in the point 1. None of the information you provided in your above output, however, shows anything about the filesystem (other than /usr/bin/make). But this sounds honestly like some sort of corrupted supdb, or a cvsup mirror that's broken. I would do the following: rm -fr /usr/src/* rm -fr /var/db/sup/src-all csup -h -L 2 -g /usr/share/examples/stable-supfile I can assure you /sys/amd64/conf/GENERIC exists, and is on the cvsup mirrors. > * I reboot the machine (because of I suspect a very weird FS problem), > boot in single user mode and do a 'fsck -fy'. Effectively, the fsck(8) > found and repair several errors. Epecially, one error claims my > attention: SUPERBLOCK. Superblock problems wouldn't explain this; there are hundreds of superblocks available (you wouldn't be able to use your machine if they were all horked). -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 26 11:13:18 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C1D93106572B; Fri, 26 Sep 2008 11:13:18 +0000 (UTC) (envelope-from peterjeremy@optushome.com.au) Received: from mail11.syd.optusnet.com.au (mail11.syd.optusnet.com.au [211.29.132.192]) by mx1.freebsd.org (Postfix) with ESMTP id 5510C8FC1A; Fri, 26 Sep 2008 11:13:18 +0000 (UTC) (envelope-from peterjeremy@optushome.com.au) Received: from server.vk2pj.dyndns.org (c122-106-215-175.belrs3.nsw.optusnet.com.au [122.106.215.175]) by mail11.syd.optusnet.com.au (8.13.1/8.13.1) with ESMTP id m8QBDDhV010986 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Fri, 26 Sep 2008 21:13:15 +1000 X-Bogosity: Ham, spamicity=0.000000 Received: from server.vk2pj.dyndns.org (localhost.vk2pj.dyndns.org [127.0.0.1]) by server.vk2pj.dyndns.org (8.14.2/8.14.2) with ESMTP id m8QBDDHS011116; Fri, 26 Sep 2008 21:13:13 +1000 (EST) (envelope-from peter@server.vk2pj.dyndns.org) Received: (from peter@localhost) by server.vk2pj.dyndns.org (8.14.2/8.14.2/Submit) id m8QBDDFc011115; Fri, 26 Sep 2008 21:13:13 +1000 (EST) (envelope-from peter) Date: Fri, 26 Sep 2008 21:13:13 +1000 From: Peter Jeremy To: Jordi Espasa Clofent Message-ID: <20080926111313.GA7231@server.vk2pj.dyndns.org> References: <48DCB7FF.1000604@minibofh.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="EVF5PPMfhYS0aIcm" Content-Disposition: inline In-Reply-To: <48DCB7FF.1000604@minibofh.org> X-PGP-Key: http://members.optusnet.com.au/peterjeremy/pubkey.asc User-Agent: Mutt/1.5.18 (2008-05-17) Cc: freebsd-hackers@freebsd.org, freebsd-stable@freebsd.org Subject: Re: Rare problems in upgrade process (corrupted FS?) X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Sep 2008 11:13:18 -0000 --EVF5PPMfhYS0aIcm Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 2008-Sep-26 12:22:55 +0200, Jordi Espasa Clofent = wrote: >1) I do the sync process with csup(1); next I go into=20 >/usr/src/sys/amd64/conf to edit the GENERIC file (I use a custimized=20 >kernels) and this file doesn't exists. You might like to check your CVSup site against http://www.mavetju.org/unix/freebsd-mirrors/ to confirm it is updating correctly. GENERIC should exist. >* I reboot the machine (because of I suspect a very weird FS problem),=20 >boot in single user mode and do a 'fsck -fy'. Effectively, the fsck(8)=20 >found and repair several errors. Epecially, one error claims my=20 >attention: SUPERBLOCK. It might have been useful if you had kept a record of the exact messages. If you repeat the fsck, does it now report any problems? If you are using an up-to-date CVSup mirror, my next suggestion would be hardware problems. --=20 Peter Jeremy Please excuse any delays as the result of my ISP's inability to implement an MTA that is either RFC2821-compliant or matches their claimed behaviour. --EVF5PPMfhYS0aIcm Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (FreeBSD) iEYEARECAAYFAkjcw8kACgkQ/opHv/APuIeHogCfSQx1aI/iHPhd8/ZaTT2JrIsB BWwAoIj+1G/0xKDfVkW8KqDvSsrKVcZj =wZ13 -----END PGP SIGNATURE----- --EVF5PPMfhYS0aIcm-- From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 26 07:59:07 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5CB061065693 for ; Fri, 26 Sep 2008 07:59:07 +0000 (UTC) (envelope-from kometen@gmail.com) Received: from fg-out-1718.google.com (fg-out-1718.google.com [72.14.220.154]) by mx1.freebsd.org (Postfix) with ESMTP id DE9B08FC27 for ; Fri, 26 Sep 2008 07:59:06 +0000 (UTC) (envelope-from kometen@gmail.com) Received: by fg-out-1718.google.com with SMTP id l26so548725fgb.35 for ; Fri, 26 Sep 2008 00:59:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=0NTM62X0qGWRnOWfxyMg+ZUhAyADlvHH6WB0aw/7gI0=; b=R/on4lMf3de0Ipck6ME4aKBMzcpXxrDCEGPovqKof29RebQ9jsvk1/b7zxGBRA8AWD f10Kac9YU0AsZfGo4n2BcdsgyB0kFPUB0RTMEGMWpwyYqIhpsfxMKCA7Bskz5rbF9775 9YYsQz/Ywj97L6iJdc8be0s7LXfjytk9Vg+os= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=rAQFcTuV2p99HyfczYdjOgLndS0gNzlN1A+p0fUJCJBePFXqLdBQ/xNYg+JVXNxHAL pxKbjHd/6TijJHAEXbZB/10BDNoiP1X+yso6UJjvy5ykELJcQQvkSaumhmFNh0eeyhzF /hKgGG8xyUQGRiDvqNbqghg6zvcU0MSHTJG60= Received: by 10.86.79.19 with SMTP id c19mr1061522fgb.5.1222414652938; Fri, 26 Sep 2008 00:37:32 -0700 (PDT) Received: by 10.86.79.10 with HTTP; Fri, 26 Sep 2008 00:37:32 -0700 (PDT) Message-ID: Date: Fri, 26 Sep 2008 09:37:32 +0200 From: "Claus Guttesen" To: "Danny Braniss" In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: X-Mailman-Approved-At: Fri, 26 Sep 2008 11:21:49 +0000 Cc: freebsd-hackers@freebsd.org, freebsd-stable@freebsd.org Subject: Re: bad NFS/UDP performance X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Sep 2008 07:59:07 -0000 > There seems to be some serious degradation in performance. > Under 7.0 I get about 90 MB/s (on write), while, on the same machine > under 7.1 it drops to 20! > Any ideas? Can you compare performanc with tcp? -- regards Claus When lenity and cruelty play for a kingdom, the gentler gamester is the soonest winner. Shakespeare From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 26 12:33:07 2008 Return-Path: Delivered-To: freebsd-hackers@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CA964106568A for ; Fri, 26 Sep 2008 12:33:07 +0000 (UTC) (envelope-from gavin@FreeBSD.org) Received: from mail-gw2.york.ac.uk (mail-gw2.york.ac.uk [144.32.128.247]) by mx1.freebsd.org (Postfix) with ESMTP id 3EF798FC1F for ; Fri, 26 Sep 2008 12:33:06 +0000 (UTC) (envelope-from gavin@FreeBSD.org) Received: from mail-gw7.york.ac.uk (mail-gw7.york.ac.uk [144.32.129.30]) by mail-gw2.york.ac.uk (8.13.6/8.13.6) with ESMTP id m8QC1dsY002248; Fri, 26 Sep 2008 13:01:39 +0100 (BST) Received: from buffy-128.york.ac.uk ([144.32.128.160] helo=buffy.york.ac.uk) by mail-gw7.york.ac.uk with esmtps (TLSv1:AES256-SHA:256) (Exim 4.68) (envelope-from ) id 1KjC0x-0007HE-Oi; Fri, 26 Sep 2008 13:01:39 +0100 Received: from buffy.york.ac.uk (localhost [127.0.0.1]) by buffy.york.ac.uk (8.14.2/8.14.2) with ESMTP id m8QC1dn7003398; Fri, 26 Sep 2008 13:01:39 +0100 (BST) (envelope-from gavin@FreeBSD.org) Received: (from ga9@localhost) by buffy.york.ac.uk (8.14.2/8.14.2/Submit) id m8QC1dNH003397; Fri, 26 Sep 2008 13:01:39 +0100 (BST) (envelope-from gavin@FreeBSD.org) X-Authentication-Warning: buffy.york.ac.uk: ga9 set sender to gavin@FreeBSD.org using -f From: Gavin Atkinson To: Danny Braniss In-Reply-To: References: Content-Type: text/plain Content-Transfer-Encoding: 7bit Date: Fri, 26 Sep 2008 13:01:38 +0100 Message-Id: <1222430498.2993.1.camel@buffy.york.ac.uk> Mime-Version: 1.0 X-Mailer: Evolution 2.22.2 FreeBSD GNOME Team Port X-York-MailScanner: Found to be clean X-York-MailScanner-From: gavin@freebsd.org Cc: freebsd-hackers@FreeBSD.org, freebsd-stable@FreeBSD.org Subject: Re: bad NFS/UDP performance X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Sep 2008 12:33:07 -0000 On Fri, 2008-09-26 at 10:04 +0300, Danny Braniss wrote: > Hi, > There seems to be some serious degradation in performance. > Under 7.0 I get about 90 MB/s (on write), while, on the same machine > under 7.1 it drops to 20! > Any ideas? The scheduler has been changed to ULE, and NFS has historically been very sensitive to changes like that. You could try switching back to the 4BSD scheduler and seeing if that makes a difference. If it does, toggling PREEMPTION would also be interesting to see the results of. Gavin From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 26 13:12:36 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9027E1065686 for ; Fri, 26 Sep 2008 13:12:36 +0000 (UTC) (envelope-from daniel@dgnetwork.com.br) Received: from mail.mastercabo.com.br (mail.mastercabo.com.br [200.179.179.14]) by mx1.freebsd.org (Postfix) with SMTP id B18318FC1E for ; Fri, 26 Sep 2008 13:12:35 +0000 (UTC) (envelope-from daniel@dgnetwork.com.br) Received: (qmail 41669 invoked by uid 1008); 26 Sep 2008 13:12:34 -0000 Received: from unknown (HELO ?192.168.10.74?) (201.39.221.3) by mail.mastercabo.com.br with SMTP; 26 Sep 2008 13:12:34 -0000 Message-ID: <48DCD95D.9020400@dgnetwork.com.br> Date: Fri, 26 Sep 2008 09:45:17 -0300 From: =?ISO-8859-1?Q?Daniel_Dias_Gon=E7alves?= User-Agent: Thunderbird 2.0.0.16 (Windows/20080708) MIME-Version: 1.0 To: Danny Braniss References: <48DC1C97.6010701@dgnetwork.com.br> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-hackers@freebsd.org, freebsd-scsi@freebsd.org Subject: Re: FreeBSD and ISCSI, Strange Problem X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: daniel@dgnetwork.com.br List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Sep 2008 13:12:36 -0000 Danny Braniss escreveu: >> I'm with a very strange problem in the FreeBSD 7.0R >> I use the iscsi_initiator to mount two devices of a Dell MD3000i, the >> file system is UFS. >> The problem occurs when I make a copy of a great directory for inside of >> the /data/email directory, passed some minutes of beginning of copy, the >> SSH connection stops to answer, when trying to open a new connection " >> Password: " it isn't requested, in the console, when typing the user >> "root" e to press enter, " Password: " also it isn't requested. The only >> way to come back is restarting the FreeBSD. >> >> When press CTRL+T during the freeze it is shown: >> # ssh root@10.0.20.10 >> load: 0.76 cmd: ssh 86930 [sbwait] 0.00u 0.01s 0% 2076k >> >> In another freeze it showed state [ufs] >> During freeze, send and receive pings work fine, but no service runing work. >> >> I already verified for some related LOG, however not see nothing related. >> > > hi Daniel, > the problem is probably that iscsi is deadlocked, so fetch > ftp://ftp/users/danny/freebsd/iscsi-2.1.tar.gz > cd /usr/src > tar xpzf /path-to-tar-file/iscsi-2.1.tar.gz > (cd sys/modules/iscsi/initiator; make; make install) > (cd sbin/iscontrol;make; make install) > probably the safest is now to reboot. > > Let me know what happens. > > obrigado (thanks?), > danny > > > > > Danny, You typed the ftp wrong. Obrigado, thanks !! =) Daniel From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 26 13:35:19 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0EF0C106569D; Fri, 26 Sep 2008 13:35:19 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from cs1.cs.huji.ac.il (cs1.cs.huji.ac.il [132.65.16.10]) by mx1.freebsd.org (Postfix) with ESMTP id B6B0F8FC27; Fri, 26 Sep 2008 13:35:18 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from pampa.cs.huji.ac.il ([132.65.80.32]) by cs1.cs.huji.ac.il with esmtp id 1KjDTZ-000Jqb-Bh; Fri, 26 Sep 2008 16:35:17 +0300 X-Mailer: exmh version 2.7.2 01/07/2005 with nmh-1.2 To: Jeremy Chadwick In-reply-to: <20080926095230.GA20789@icarus.home.lan> References: <20080926081806.GA19055@icarus.home.lan> <20080926095230.GA20789@icarus.home.lan> Comments: In-reply-to Jeremy Chadwick message dated "Fri, 26 Sep 2008 02:52:30 -0700." Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Fri, 26 Sep 2008 16:35:17 +0300 From: Danny Braniss Message-ID: Cc: freebsd-hackers@freebsd.org, freebsd-stable@freebsd.org Subject: Re: bad NFS/UDP performance X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Sep 2008 13:35:19 -0000 > On Fri, Sep 26, 2008 at 12:27:08PM +0300, Danny Braniss wrote: > > > On Fri, Sep 26, 2008 at 10:04:16AM +0300, Danny Braniss wrote: > > > > Hi, > > > > There seems to be some serious degradation in performance. > > > > Under 7.0 I get about 90 MB/s (on write), while, on the same machine > > > > under 7.1 it drops to 20! > > > > Any ideas? > > > > > > 1) Network card driver changes, > > could be, but at least iperf/tcp is ok - can't get udp numbers, do you > > know of any tool to measure udp performance? > > BTW, I also checked on different hardware, and the badness is there. > > According to INDEX, benchmarks/iperf does UDP bandwidth testing. I know, but I get about 1mgb, which seems somewhat low :-( > > benchmarks/nttcp should as well. > > What network card is in use? If Intel, what driver version (should be > in dmesg). bge: and bce: and intels, but haven't tested there yet. > > > > 2) This could be relevant, but rwatson@ will need to help determine > > > that. > > > http://lists.freebsd.org/pipermail/freebsd-stable/2008-September/045109.html > > > > gut feeling is that it's somewhere else: > > > > Writing 16 MB file > > BS Count /---- 7.0 ------/ /---- 7.1 -----/ > > 1*512 32768 0.16s 98.11MB/s 0.43s 37.18MB/s > > 2*512 16384 0.17s 92.04MB/s 0.46s 34.79MB/s > > 4*512 8192 0.16s 101.88MB/s 0.43s 37.26MB/s > > 8*512 4096 0.16s 99.86MB/s 0.44s 36.41MB/s > > 16*512 2048 0.16s 100.11MB/s 0.50s 32.03MB/s > > 32*512 1024 0.26s 61.71MB/s 0.46s 34.79MB/s > > 64*512 512 0.22s 71.45MB/s 0.45s 35.41MB/s > > 128*512 256 0.21s 77.84MB/s 0.51s 31.34MB/s > > 256*512 128 0.19s 82.47MB/s 0.43s 37.22MB/s > > 512*512 64 0.18s 87.77MB/s 0.49s 32.69MB/s > > 1024*512 32 0.18s 89.24MB/s 0.47s 34.02MB/s > > 2048*512 16 0.17s 91.81MB/s 0.30s 53.41MB/s > > 4096*512 8 0.16s 100.56MB/s 0.42s 38.07MB/s > > 8192*512 4 0.82s 19.56MB/s 0.80s 19.95MB/s > > 16384*512 2 0.82s 19.63MB/s 0.95s 16.80MB/s > > 32768*512 1 0.81s 19.69MB/s 0.96s 16.64MB/s > > > > Average: 75.86 33.00 > > > > the nfs filer is a NetWork Appliance, and is in use, so i get fluctuations in > > the > > measurements, but the relation are similar, good on 7.0, bad on 7.1 > > Do you have any NFS-related tunings in /etc/rc.conf or /etc/sysctl.conf? > no, but diffing the sysctl show: -vfs.nfs.realign_test: 22141777 +vfs.nfs.realign_test: 498351 -vfs.nfsrv.realign_test: 5005908 +vfs.nfsrv.realign_test: 0 +vfs.nfsrv.commit_miss: 0 +vfs.nfsrv.commit_blks: 0 changing them did nothing - or at least with respect to nfs throughput :-) danny From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 26 13:41:24 2008 Return-Path: Delivered-To: freebsd-hackers@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4190F1065691; Fri, 26 Sep 2008 13:41:24 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from cs1.cs.huji.ac.il (cs1.cs.huji.ac.il [132.65.16.10]) by mx1.freebsd.org (Postfix) with ESMTP id E99C18FC21; Fri, 26 Sep 2008 13:41:23 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from pampa.cs.huji.ac.il ([132.65.80.32]) by cs1.cs.huji.ac.il with esmtp id 1KjDZS-000Juj-Vd; Fri, 26 Sep 2008 16:41:23 +0300 X-Mailer: exmh version 2.7.2 01/07/2005 with nmh-1.2 To: Gavin Atkinson In-reply-to: <1222430498.2993.1.camel@buffy.york.ac.uk> References: <1222430498.2993.1.camel@buffy.york.ac.uk> Comments: In-reply-to Gavin Atkinson message dated "Fri, 26 Sep 2008 13:01:38 +0100." Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Fri, 26 Sep 2008 16:41:22 +0300 From: Danny Braniss Message-ID: Cc: freebsd-hackers@FreeBSD.org, freebsd-stable@FreeBSD.org Subject: Re: bad NFS/UDP performance X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Sep 2008 13:41:24 -0000 > On Fri, 2008-09-26 at 10:04 +0300, Danny Braniss wrote: > > Hi, > > There seems to be some serious degradation in performance. > > Under 7.0 I get about 90 MB/s (on write), while, on the same machine > > under 7.1 it drops to 20! > > Any ideas? > > The scheduler has been changed to ULE, and NFS has historically been > very sensitive to changes like that. You could try switching back to > the 4BSD scheduler and seeing if that makes a difference. If it does, > toggling PREEMPTION would also be interesting to see the results of. > > Gavin I'm testing 7.0-stable vs 7.1-prerelease, and both have ULE. BTW, the nfs client hosts I'm testing are idle. danny From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 26 14:05:07 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C72FC1065688 for ; Fri, 26 Sep 2008 14:05:07 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from server.baldwin.cx (bigknife-pt.tunnel.tserv9.chi1.ipv6.he.net [IPv6:2001:470:1f10:75::2]) by mx1.freebsd.org (Postfix) with ESMTP id 67C958FC2F for ; Fri, 26 Sep 2008 14:05:07 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from localhost.corp.yahoo.com (john@localhost [IPv6:::1]) (authenticated bits=0) by server.baldwin.cx (8.14.2/8.14.2) with ESMTP id m8QE4dH5007656; Fri, 26 Sep 2008 10:04:51 -0400 (EDT) (envelope-from jhb@freebsd.org) From: John Baldwin To: freebsd-hackers@freebsd.org Date: Fri, 26 Sep 2008 09:49:20 -0400 User-Agent: KMail/1.9.7 References: <8185F68B-C443-4891-BEC2-5E3D453DDC93@wheelhouse.org> <05B718C6-BBC9-4B78-B580-4E250199DDCF@wheelhouse.org> <868wtf8drl.fsf@ds4.des.no> In-Reply-To: <868wtf8drl.fsf@ds4.des.no> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Message-Id: <200809260949.21592.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH authentication, not delayed by milter-greylist-2.0.2 (server.baldwin.cx [IPv6:::1]); Fri, 26 Sep 2008 10:04:51 -0400 (EDT) X-Virus-Scanned: ClamAV 0.93.1/8343/Fri Sep 26 05:43:08 2008 on server.baldwin.cx X-Virus-Status: Clean X-Spam-Status: No, score=-2.6 required=4.2 tests=BAYES_00,NO_RELAYS autolearn=ham version=3.1.3 X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on server.baldwin.cx Cc: Jeff Wheelhouse , Dag-Erling =?utf-8?q?Sm=C3=B8rgrav?= Subject: Re: Major SMP problems with lstat/namei X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Sep 2008 14:05:07 -0000 On Friday 26 September 2008 05:20:14 am Dag-Erling Sm=C3=B8rgrav wrote: > Jeff Wheelhouse writes: > > http://software.wheelhouse.org/rptest.tar.bz2 >=20 > Thanks. I get similar results on head; vfs.lookup_shared actually seems > to *reduce* performance by about 10% - 20%. I ran the test on both UFS > and ZFS; there is no significant difference. You might try http://www.FreeBSD.org/~jhb/patches/namei_rwlock.patch However, it might also be useful in general to enable lock profiling and se= e=20 which locks (if any) are contested. =2D-=20 John Baldwin From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 26 14:05:29 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3B5F41065694; Fri, 26 Sep 2008 14:05:29 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from server.baldwin.cx (bigknife-pt.tunnel.tserv9.chi1.ipv6.he.net [IPv6:2001:470:1f10:75::2]) by mx1.freebsd.org (Postfix) with ESMTP id D3D928FC1F; Fri, 26 Sep 2008 14:05:28 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from localhost.corp.yahoo.com (john@localhost [IPv6:::1]) (authenticated bits=0) by server.baldwin.cx (8.14.2/8.14.2) with ESMTP id m8QE4dH6007656; Fri, 26 Sep 2008 10:04:57 -0400 (EDT) (envelope-from jhb@freebsd.org) From: John Baldwin To: freebsd-hackers@freebsd.org Date: Fri, 26 Sep 2008 09:52:26 -0400 User-Agent: KMail/1.9.7 References: In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200809260952.26896.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH authentication, not delayed by milter-greylist-2.0.2 (server.baldwin.cx [IPv6:::1]); Fri, 26 Sep 2008 10:04:58 -0400 (EDT) X-Virus-Scanned: ClamAV 0.93.1/8343/Fri Sep 26 05:43:08 2008 on server.baldwin.cx X-Virus-Status: Clean X-Spam-Status: No, score=-2.6 required=4.2 tests=BAYES_00,NO_RELAYS autolearn=ham version=3.1.3 X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on server.baldwin.cx Cc: freebsd-stable@freebsd.org Subject: Re: bad NFS/UDP performance X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Sep 2008 14:05:29 -0000 On Friday 26 September 2008 03:04:16 am Danny Braniss wrote: > Hi, > There seems to be some serious degradation in performance. > Under 7.0 I get about 90 MB/s (on write), while, on the same machine > under 7.1 it drops to 20! > Any ideas? > > thanks, > danny Perhaps use nfsstat to see if 7.1 is performing more on-the-wire requests? Also, if you can, do a binary search to narrow down when the regression occurred in RELENG_7. -- John Baldwin From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 26 14:31:55 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8FCAD1065691 for ; Fri, 26 Sep 2008 14:31:55 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from QMTA05.emeryville.ca.mail.comcast.net (qmta05.emeryville.ca.mail.comcast.net [76.96.30.48]) by mx1.freebsd.org (Postfix) with ESMTP id 71B028FC1F for ; Fri, 26 Sep 2008 14:31:55 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from OMTA08.emeryville.ca.mail.comcast.net ([76.96.30.12]) by QMTA05.emeryville.ca.mail.comcast.net with comcast id KNlz1a00A0FhH24A5SXvM6; Fri, 26 Sep 2008 14:31:55 +0000 Received: from koitsu.dyndns.org ([67.180.253.227]) by OMTA08.emeryville.ca.mail.comcast.net with comcast id KSXt1a00k4v8bD78USXujm; Fri, 26 Sep 2008 14:31:54 +0000 X-Authority-Analysis: v=1.0 c=1 a=QycZ5dHgAAAA:8 a=4ahL9xAdBQ21JVSEjwgA:9 a=t40GXK5bKRwRqXnMqnYA:7 a=OpEWCI36gf_DNcgCPdlVQNapDp0A:4 a=EoioJ0NPDVgA:10 a=LY0hPdMaydYA:10 Received: by icarus.home.lan (Postfix, from userid 1000) id 881B0C9432; Fri, 26 Sep 2008 07:31:53 -0700 (PDT) Date: Fri, 26 Sep 2008 07:31:53 -0700 From: Jeremy Chadwick To: Danny Braniss Message-ID: <20080926143153.GA26978@icarus.home.lan> References: <20080926081806.GA19055@icarus.home.lan> <20080926095230.GA20789@icarus.home.lan> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.18 (2008-05-17) Cc: freebsd-hackers@freebsd.org, freebsd-stable@freebsd.org Subject: Re: bad NFS/UDP performance X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Sep 2008 14:31:55 -0000 On Fri, Sep 26, 2008 at 04:35:17PM +0300, Danny Braniss wrote: > > On Fri, Sep 26, 2008 at 12:27:08PM +0300, Danny Braniss wrote: > > > > On Fri, Sep 26, 2008 at 10:04:16AM +0300, Danny Braniss wrote: > > > > > Hi, > > > > > There seems to be some serious degradation in performance. > > > > > Under 7.0 I get about 90 MB/s (on write), while, on the same machine > > > > > under 7.1 it drops to 20! > > > > > Any ideas? > > > > > > > > 1) Network card driver changes, > > > could be, but at least iperf/tcp is ok - can't get udp numbers, do you > > > know of any tool to measure udp performance? > > > BTW, I also checked on different hardware, and the badness is there. > > > > According to INDEX, benchmarks/iperf does UDP bandwidth testing. > > I know, but I get about 1mgb, which seems somewhat low :-( > > > > > benchmarks/nttcp should as well. > > > > What network card is in use? If Intel, what driver version (should be > > in dmesg). > > bge: > and > bce: > and intels, but haven't tested there yet. Both bge(4) and bce(4) claim to support checksum offloading. You might try disabling it (ifconfig ... -txcsum -rxcsum) to see if things improve. If not, more troubleshooting is needed. You might also try turning off TSO if it's supported (check your ifconfig output for TSO in the options=<> section. Then use ifconfig ... -tso) > > Do you have any NFS-related tunings in /etc/rc.conf or /etc/sysctl.conf? > > > no, but diffing the sysctl show: > > -vfs.nfs.realign_test: 22141777 > +vfs.nfs.realign_test: 498351 > > -vfs.nfsrv.realign_test: 5005908 > +vfs.nfsrv.realign_test: 0 > > +vfs.nfsrv.commit_miss: 0 > +vfs.nfsrv.commit_blks: 0 > > changing them did nothing - or at least with respect to nfs throughput :-) I'm not sure what any of these do, as NFS is a bit out of my league. :-) I'll be following this thread though! -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 26 14:38:00 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 728E2106568F; Fri, 26 Sep 2008 14:38:00 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from cs1.cs.huji.ac.il (cs1.cs.huji.ac.il [132.65.16.10]) by mx1.freebsd.org (Postfix) with ESMTP id 2CD268FC13; Fri, 26 Sep 2008 14:37:59 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from pampa.cs.huji.ac.il ([132.65.80.32]) by cs1.cs.huji.ac.il with esmtp id 1KjESE-000Kdx-QS; Fri, 26 Sep 2008 17:37:58 +0300 X-Mailer: exmh version 2.7.2 01/07/2005 with nmh-1.2 To: daniel@dgnetwork.com.br In-reply-to: Your message of Fri, 26 Sep 2008 09:45:17 -0300 . Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Fri, 26 Sep 2008 17:37:58 +0300 From: Danny Braniss Message-ID: Cc: freebsd-hackers@freebsd.org, freebsd-scsi@freebsd.org Subject: Re: FreeBSD and ISCSI, Strange Problem X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Sep 2008 14:38:00 -0000 > the problem is probably that iscsi is deadlocked, so fetch > ftp://ftp/users/danny/freebsd/iscsi-2.1.tar.gzs;/ftp/;/&.cs.huji.ac.il; > > ftp://ftp.cs.huji.ac.il/users/danny/freebsd/iscsi-2.1.tar.gz > Danny, > > You typed the ftp wrong. > > hi Daniel, oh well, it was before coffee :-) > Obrigado, thanks !! =) > > Daniel > > From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 26 14:45:57 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E1EA7106568B; Fri, 26 Sep 2008 14:45:57 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from cs1.cs.huji.ac.il (cs1.cs.huji.ac.il [132.65.16.10]) by mx1.freebsd.org (Postfix) with ESMTP id 93FF08FC22; Fri, 26 Sep 2008 14:45:57 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from pampa.cs.huji.ac.il ([132.65.80.32]) by cs1.cs.huji.ac.il with esmtp id 1KjEZw-000KkH-GP; Fri, 26 Sep 2008 17:45:56 +0300 X-Mailer: exmh version 2.7.2 01/07/2005 with nmh-1.2 To: Jeremy Chadwick In-reply-to: <20080926095230.GA20789@icarus.home.lan> References: <20080926081806.GA19055@icarus.home.lan> <20080926095230.GA20789@icarus.home.lan> Comments: In-reply-to Jeremy Chadwick message dated "Fri, 26 Sep 2008 02:52:30 -0700." Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Fri, 26 Sep 2008 17:45:56 +0300 From: Danny Braniss Message-ID: Cc: freebsd-hackers@freebsd.org, freebsd-stable@freebsd.org Subject: Re: bad NFS/UDP performance X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Sep 2008 14:45:58 -0000 > On Fri, Sep 26, 2008 at 12:27:08PM +0300, Danny Braniss wrote: > > > On Fri, Sep 26, 2008 at 10:04:16AM +0300, Danny Braniss wrote: > > > > Hi, > > > > There seems to be some serious degradation in performance. > > > > Under 7.0 I get about 90 MB/s (on write), while, on the same machine > > > > under 7.1 it drops to 20! > > > > Any ideas? > > > > > > 1) Network card driver changes, > > could be, but at least iperf/tcp is ok - can't get udp numbers, do you > > know of any tool to measure udp performance? > > BTW, I also checked on different hardware, and the badness is there. > > According to INDEX, benchmarks/iperf does UDP bandwidth testing. > > benchmarks/nttcp should as well. > > What network card is in use? If Intel, what driver version (should be > in dmesg). > > > > 2) This could be relevant, but rwatson@ will need to help determine > > > that. > > > http://lists.freebsd.org/pipermail/freebsd-stable/2008-September/045109.html > > > > gut feeling is that it's somewhere else: > > > > Writing 16 MB file > > BS Count /---- 7.0 ------/ /---- 7.1 -----/ > > 1*512 32768 0.16s 98.11MB/s 0.43s 37.18MB/s > > 2*512 16384 0.17s 92.04MB/s 0.46s 34.79MB/s > > 4*512 8192 0.16s 101.88MB/s 0.43s 37.26MB/s > > 8*512 4096 0.16s 99.86MB/s 0.44s 36.41MB/s > > 16*512 2048 0.16s 100.11MB/s 0.50s 32.03MB/s > > 32*512 1024 0.26s 61.71MB/s 0.46s 34.79MB/s > > 64*512 512 0.22s 71.45MB/s 0.45s 35.41MB/s > > 128*512 256 0.21s 77.84MB/s 0.51s 31.34MB/s > > 256*512 128 0.19s 82.47MB/s 0.43s 37.22MB/s > > 512*512 64 0.18s 87.77MB/s 0.49s 32.69MB/s > > 1024*512 32 0.18s 89.24MB/s 0.47s 34.02MB/s > > 2048*512 16 0.17s 91.81MB/s 0.30s 53.41MB/s > > 4096*512 8 0.16s 100.56MB/s 0.42s 38.07MB/s > > 8192*512 4 0.82s 19.56MB/s 0.80s 19.95MB/s > > 16384*512 2 0.82s 19.63MB/s 0.95s 16.80MB/s > > 32768*512 1 0.81s 19.69MB/s 0.96s 16.64MB/s > > > > Average: 75.86 33.00 > > > > the nfs filer is a NetWork Appliance, and is in use, so i get fluctuations in > > the > > measurements, but the relation are similar, good on 7.0, bad on 7.1 > > Do you have any NFS-related tunings in /etc/rc.conf or /etc/sysctl.conf? > after more testing, it seems it's related to changes made between Aug 4 and Aug 29 ie, a kernel built on Aug 4 works fine, Aug 29 is slow. I'l now try and close the gap. danny From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 26 18:30:32 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D7818106564A; Fri, 26 Sep 2008 18:30:32 +0000 (UTC) (envelope-from dillon@apollo.backplane.com) Received: from apollo.backplane.com (apollo.backplane.com [216.240.41.2]) by mx1.freebsd.org (Postfix) with ESMTP id A95168FC13; Fri, 26 Sep 2008 18:30:32 +0000 (UTC) (envelope-from dillon@apollo.backplane.com) Received: from apollo.backplane.com (localhost [127.0.0.1]) by apollo.backplane.com (8.14.1/8.14.1) with ESMTP id m8QII6UT004334; Fri, 26 Sep 2008 11:18:06 -0700 (PDT) Received: (from dillon@localhost) by apollo.backplane.com (8.14.1/8.13.4/Submit) id m8QII6jF004333; Fri, 26 Sep 2008 11:18:06 -0700 (PDT) Date: Fri, 26 Sep 2008 11:18:06 -0700 (PDT) From: Matthew Dillon Message-Id: <200809261818.m8QII6jF004333@apollo.backplane.com> To: Jeremy Chadwick References: <20080926081806.GA19055@icarus.home.lan> <20080926095230.GA20789@icarus.home.lan> <20080926143153.GA26978@icarus.home.lan> Cc: freebsd-hackers@freebsd.org, freebsd-stable@freebsd.org Subject: Re: bad NFS/UDP performance X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Sep 2008 18:30:32 -0000 :> -vfs.nfs.realign_test: 22141777 :> +vfs.nfs.realign_test: 498351 :> :> -vfs.nfsrv.realign_test: 5005908 :> +vfs.nfsrv.realign_test: 0 :> :> +vfs.nfsrv.commit_miss: 0 :> +vfs.nfsrv.commit_blks: 0 :> :> changing them did nothing - or at least with respect to nfs throughput :-) : :I'm not sure what any of these do, as NFS is a bit out of my league. ::-) I'll be following this thread though! : :-- :| Jeremy Chadwick jdc at parodius.com | A non-zero nfs_realign_count is bad, it means NFS had to copy the mbuf chain to fix the alignment. nfs_realign_test is just the number of times it checked. So nfs_realign_test is irrelevant. it's nfs_realign_count that matters. Several things can cause NFS payloads to be improperly aligned. Anything from older network drivers which can't start DMA on a 2-byte boundary, resulting in the 14-byte encapsulation header causing improper alignment of the IP header & payload, to rpc embedded in NFS TCP streams winding up being misaligned. Modern network hardware either support 2-byte-aligned DMA, allowing the encapsulation to be 2-byte aligned so the payload winds up being 4-byte aligned, or support DMA chaining allowing the payload to be placed in its own mbuf, or pad, etc. -- One thing I would check is to be sure a couple of nfsiod's are running on the client when doing your tests. If none are running the RPCs wind up being more synchronous and less pipelined. Another thing I would check is IP fragment reassembly statistics (for UDP) - there should be none for TCP connections no matter what the NFS I/O size selected. (It does seem more likely to be scheduler-related, though). -Matt From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 26 18:34:48 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 19DB21065692 for ; Fri, 26 Sep 2008 18:34:48 +0000 (UTC) (envelope-from mwm-keyword-freebsdhackers2.e313df@mired.org) Received: from mired.org (five.mired.org [66.92.153.75]) by mx1.freebsd.org (Postfix) with ESMTP id BC6FA8FC1F for ; Fri, 26 Sep 2008 18:34:47 +0000 (UTC) (envelope-from mwm-keyword-freebsdhackers2.e313df@mired.org) Received: (qmail 44705 invoked by uid 1001); 26 Sep 2008 14:06:12 -0400 Received: from bhuda.mired.org (bhuda [192.168.195.1]) by bhuda (tmda-ofmipd) with ESMTP; Fri, 26 Sep 2008 14:06:11 -0400 Date: Fri, 26 Sep 2008 14:06:10 -0400 To: freebsd-hackers@freebsd.org Message-ID: <20080926140610.0f6ea7f6@bhuda.mired.org> In-Reply-To: <48DC01DA.9040108@minibofh.org> References: <48DC01DA.9040108@minibofh.org> Organization: Meyer Consulting X-Mailer: Claws Mail 3.5.0 (GTK+ 2.12.11; amd64-portbld-freebsd7.0) Face: iVBORw0KGgoAAAANSUhEUgAAADAAAAAwBAMAAAClLOS0AAAAG1BMVEXguIzRkGnhyaz069mXhW0WHRnbrnR9WCQ6LB0CchNMAAACSUlEQVQ4jV2TQW7jMAxFGaPQOgQEdZaGMsgBrAvUA03dCxj1Uu4U2gfwQD7AGNax51NK07RcxXz6/CSl0Ij450vkPG1jzpIZM1UwDCl/xB14TWnNX8A00Qj5a0mnVFVbVUz4MeErea2HikSRqZzY894zwg9p2+/AtO8LzxFED+tNAUFeU29iFOLRxlZAcdo9A8wi8ZBMV4BKPde82Oxrvs6BTkulQIClte0DLFzzsKk9j1MBex8iUaP00Bd78S/muyFScrTXz6zLkEUxJp+SabQfNOs4f4Jpx5qSZ/304PWwlEWP1cOn/mJQR7EOD+uKhjcBLziuL7xoY5Xm+VFAUSw/LwwwsHEHxihpwV4EJH0xXRkbw1PkRw+X4pEuSJwBggqk+HEYKkiL5/74/nQkogigzQsAFrakxZyfw3wMIEEZPv4AWMfxwqE5GNxGaERjmH+PG8AE0L4/w9g0lsp1raLYAN5azQa+AOoO9NwcpFkTrG2VKNMNEL5UKUUAw34tha0z7onUG0oBoNtczE04GwFE3wCHc0ChezAJ6A1WMV81AtY7wDAJSlXwV+4cwBvsOsrQMRawfQEBz0deEZ7WNpV2szckIKo5VpDHDSDvF1GItwqqAlG01Hh50BGtVhuUkjkasg/14bYFGCgWg1fSWHvmOoJck2xdp9ZvZBHzDVTzX23TkrOn7qe5U2COEw5D4Vx3qEQpFY2Z/3QFnJxzp7YCmSMG19nOUoe869zZfOQb5ywQuWu0yCn5+8gxZz+BE7vG3j4/wbf4D/sXN9Wug1s7AAAAAElFTkSuQmCC Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Delivery-Agent: TMDA/1.1.12 (Macallan) From: Mike Meyer Subject: Re: Regenerate ports tree from installed ports? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Sep 2008 18:34:48 -0000 On Thu, 25 Sep 2008 23:25:46 +0200 Jordi Espasa Clofent wrote: > Hi all, >=20 > I suppose it's a dumb (and crazy) question, but as post subject says: > =C2=BFIs it possible to regenerate the /usr/ports tree _from_ the install= ed=20 > ports? Possibly. If the installed ports were built from a consistent tree, you can always just use CVS to check out a copy of the ports tree for the date of the last port you installed. However, as was pointed out here, that doesn't mean you can actually build ports from them on an upgraded operating system. > Until that point, it's all right. But everybody knows that you have to=20 > recompile all your installed ports after the kernel and userland=20 > upgrade, to re-link the new libraries and disappeared ones. Um, no, everyone doesn't know you need to do that. In fact, I've almost *never* been able to do that, because I've almost always had proprietary, binary-only software of some sort or another running on my boxes for which the vendor hadn't provided an appropriate update. That's what the compat libraries are for - you can install those, and just keep on running your old binaries. It's been a while, but I'm pretty sure I managed one update by doing the OS update - including compat - and then replacing the ports piecemeal while the old ones ran on the compat libraries. Of course, running on the compat libraries isn't the ideal solution, so you want to rebuild the ports if you can. Of course, the same thing applies to running old versions of the ports - you really want to get new bug fixes, security patches, and such like that may have come out since you installed the original software.=20 > But in my=20 > case, these boxes are used as shared web-hostings, and a lot of=20 > particularities are present. Change the php version, for example, can=20 > means that tens of webs not work fine. The solution in this case is to buy one new box, build the new version on it, including all ports, clone your customers environments to it, and start it as "foobar-new". Tell your customers it's there, let them test things, help them fix what's needed, and after everyone is happy, swap the names. Repeat this process using the just-retired box to build the new one on. If these are inhouse services - so you can have some real down time - then I typically build a new system on a second disk with the same data directories, and test there. When it's all working, put everything on one disk, and then mirror the two disks, so it's there next time I need to do the dual boot upgrade thing. http://www.mired.org/consulting.html Independent Network/Unix/Perforce consultant, email for more information. O< ascii ribbon campaign - stop html mail - www.asciiribbon.org From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 26 18:43:32 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8B5991065691 for ; Fri, 26 Sep 2008 18:43:32 +0000 (UTC) (envelope-from michael.schuh@gmail.com) Received: from wf-out-1314.google.com (wf-out-1314.google.com [209.85.200.168]) by mx1.freebsd.org (Postfix) with ESMTP id 5F8118FC14 for ; Fri, 26 Sep 2008 18:43:32 +0000 (UTC) (envelope-from michael.schuh@gmail.com) Received: by wf-out-1314.google.com with SMTP id 24so1167049wfg.7 for ; Fri, 26 Sep 2008 11:43:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:mime-version:content-type; bh=1XQPOnrqVKkqUXebTG6WJDDxqyABBqmJFcxgI7DuDlU=; b=fgO5ngdWgGmfXzgs8dvWC4WwrKF/0CooOI43ELmmd1cLeyWZ2O7gkssxL4My+kME6E pd5MOn+GkyjqCo4iBWY91TrfbMl7bXPFgTF9YCmRRyVdzg4NzrFE+vPjxrzECiUiTr3U cj6Hm1PvCj1lynUOyL2ZfJoc/lOFZdLtFKUoc= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type; b=kPzTxncKZM7s3zKOW3YBb29HFpl8K5SKBCrnXAY2JQnlyXp0JfDVU0/FrC3HvSgX1+ 7NxnR0H3X0zXSU13iJEoAZ0j9XIEM7YNvjgT/T3T/BTYL/U0LPH+4xJEowt18SEc9JG6 4J9orG2LC7WFOAz/vwj8eXhUabnmXgeSKoviA= Received: by 10.142.212.18 with SMTP id k18mr715164wfg.258.1222452943086; Fri, 26 Sep 2008 11:15:43 -0700 (PDT) Received: by 10.142.170.11 with HTTP; Fri, 26 Sep 2008 11:15:43 -0700 (PDT) Message-ID: <1dbad3150809261115h379a611aweb20e47124e254d4@mail.gmail.com> Date: Fri, 26 Sep 2008 20:15:43 +0200 From: "Michael Schuh" To: freebsd-hackers@freebsd.org MIME-Version: 1.0 X-Mailman-Approved-At: Fri, 26 Sep 2008 18:47:19 +0000 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: experimantal question about md's X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Sep 2008 18:43:32 -0000 Hallo @list, first please answer me directly, i be not on the list. Let us say i have a Machine with 8 CPUs and a lot of RAM. An i need a very high perfomance Storage for holding data. My idea was to setup a raid1(0) with virtual disk images. Created with mdconfig. My idea was to create minimum 2 md-diskimages, these are located fisrt one on the harddisk as type vnode second one as exact copy totally in the memory as type malloc For now the man-page mentoid me to not to do so, while large disks in RAM cause panics, and i know panics come surely Is the above scenario possible without panics? thanks a lot. greetings from sunny Germany michael --=20 =3D=3D=3D m i c h a e l - s c h u h . n e t =3D=3D=3D Michael Schuh Postfach 10 21 52 66021 Saarbr=FCcken phone: 0681/8319664 mobil: 0177/9738644 @: m i c h a e l . s c h u h @ g m a i l . c o m =3D=3D=3D Ust-ID: DE251072318 =3D=3D=3D From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 26 19:08:52 2008 Return-Path: Delivered-To: freebsd-hackers@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B8DAE1065686; Fri, 26 Sep 2008 19:08:52 +0000 (UTC) (envelope-from dwmalone@maths.tcd.ie) Received: from salmon.maths.tcd.ie (salmon.maths.tcd.ie [IPv6:2001:770:10:300::86e2:510b]) by mx1.freebsd.org (Postfix) with SMTP id A97D48FC08; Fri, 26 Sep 2008 19:08:51 +0000 (UTC) (envelope-from dwmalone@maths.tcd.ie) Received: from walton.maths.tcd.ie ([134.226.81.10] helo=walton.maths.tcd.ie) by salmon.maths.tcd.ie with SMTP id ; 26 Sep 2008 20:08:49 +0100 (BST) Date: Fri, 26 Sep 2008 20:08:48 +0100 From: David Malone To: Danny Braniss Message-ID: <20080926190848.GA65901@walton.maths.tcd.ie> References: <20080926081806.GA19055@icarus.home.lan> <20080926095230.GA20789@icarus.home.lan> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.6i Sender: dwmalone@maths.tcd.ie Cc: freebsd-hackers@FreeBSD.org, Jeremy Chadwick , freebsd-stable@FreeBSD.org Subject: Re: bad NFS/UDP performance X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Sep 2008 19:08:52 -0000 On Fri, Sep 26, 2008 at 04:35:17PM +0300, Danny Braniss wrote: > I know, but I get about 1mgb, which seems somewhat low :-( Since UDP has no way to know how fast to send, you need to tell iperf how fast to send the packets. I think 1Mbps is the default speed. David. From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 26 22:27:17 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 420C01065693 for ; Fri, 26 Sep 2008 22:27:17 +0000 (UTC) (envelope-from xorquewasp@googlemail.com) Received: from ik-out-1112.google.com (ik-out-1112.google.com [66.249.90.182]) by mx1.freebsd.org (Postfix) with ESMTP id C93D78FC15 for ; Fri, 26 Sep 2008 22:27:16 +0000 (UTC) (envelope-from xorquewasp@googlemail.com) Received: by ik-out-1112.google.com with SMTP id c29so775330ika.3 for ; Fri, 26 Sep 2008 15:27:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=domainkey-signature:received:received:received:date:from:to:subject :message-id:mime-version:content-type:content-disposition; bh=5srK7n5Ckj9tNNVNsCVzjatZL9rZWDGtb+6qdIZO5KE=; b=vUViyZZejrHO2GR/nDAly8XIyM8S5RhkRTbUL4XerjiMHuK7e+Xqfq5aBIZSGubP3j 766lEVx4fVJX8Uqf2luk3W/J6+W4rCb8PQ3KOsUyX6nRCa2hLfQ3SpAVoTyhLPHV/us+ JCialk3DJ7+idAlw+QbU8BtXM0tBxnXCJlrRk= DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma; h=date:from:to:subject:message-id:mime-version:content-type :content-disposition; b=uI1Lq78f7JO4Ak7WgjkydVAhDx6SPEPzrrVVLuT1w5OnAnj0slCnbEGDfFeo4TJb90 jnwocfBAhMegCc9Mssa7WdFKXZOB1oTUPb5EBQ8b9jWrjgoIVdttiylbapob5aR9qo23 AR0pb8L2RSYcfufWU8CHmFlkUpoX7UIfVgHds= Received: by 10.210.27.20 with SMTP id a20mr2161885eba.86.1222468035686; Fri, 26 Sep 2008 15:27:15 -0700 (PDT) Received: from logik.internal.network ( [81.86.41.187]) by mx.google.com with ESMTPS id 10sm4740350eyd.6.2008.09.26.15.27.14 (version=TLSv1/SSLv3 cipher=OTHER); Fri, 26 Sep 2008 15:27:14 -0700 (PDT) Received: by logik.internal.network (Postfix, from userid 11001) id B7A9360AA; Fri, 26 Sep 2008 22:27:11 +0000 (UTC) Date: Fri, 26 Sep 2008 23:27:11 +0100 From: xorquewasp@googlemail.com To: freebsd-hackers@freebsd.org Message-ID: <20080926222711.GA74003@logik.internal.network> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Subject: popen() in multithreaded program - hangs? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Sep 2008 22:27:17 -0000 I'm trying to write a client for the jack audio connection kit (http://jackaudio.org), have hit an apparent bug and am not sure who's at fault. This is the client: -- #include #include jack_port_t *input_port; jack_port_t *output_port; jack_client_t *client; int main (void) { jack_status_t status; client = jack_client_open ("cdemo", JackNoStartServer, &status, "default"); if (!client) errx (112, "client_open: could not"); jack_client_close (client); return 0; } -- The jack_client_open() call never returns and the process can only be killed with SIGKILL. Tracing execution in gdb shows that the hang occurs in the popen() call in jack_get_tmpdir(), defined at client.c:114: http://trac.jackaudio.org/browser/trunk/jack/libjack/client.c Is there a known issue with calling popen() in a multithreaded program? At the point of that call, on my system, there are three running threads. Any help/advice on how to resolve this problem would be appreciated. xw From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 26 22:28:45 2008 Return-Path: Delivered-To: freebsd-hackers@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 26B431065697 for ; Fri, 26 Sep 2008 22:28:45 +0000 (UTC) (envelope-from oberman@es.net) Received: from postal1.es.net (postal4.es.net [198.124.252.66]) by mx1.freebsd.org (Postfix) with ESMTP id B93B18FC3B for ; Fri, 26 Sep 2008 22:28:44 +0000 (UTC) (envelope-from oberman@es.net) Received: from postal1.es.net (postal3.es.net [198.128.3.207]) by postal4.es.net (Postal Node 4) with ESMTP (SSL) id GFR02302; Fri, 26 Sep 2008 15:17:02 -0700 Received: from ptavv.es.net (ptavv.es.net [198.128.4.29]) by postal3.es.net (Postal Node 3) with ESMTP (SSL) id GFR53800; Fri, 26 Sep 2008 15:17:00 -0700 Received: from ptavv.es.net (localhost [127.0.0.1]) by ptavv.es.net (Tachyon Server) with ESMTP id 1C4AE4500E; Fri, 26 Sep 2008 15:17:00 -0700 (PDT) To: David Malone In-Reply-To: Your message of "Fri, 26 Sep 2008 20:08:48 BST." <20080926190848.GA65901@walton.maths.tcd.ie> Mime-Version: 1.0 Content-Type: multipart/signed; boundary="==_Exmh_1222467420_5817P"; micalg=pgp-sha1; protocol="application/pgp-signature" Content-Transfer-Encoding: 7bit Date: Fri, 26 Sep 2008 15:17:00 -0700 From: "Kevin Oberman" Message-Id: <20080926221700.1C4AE4500E@ptavv.es.net> X-Sender-IP: 198.128.3.207 X-Sender-Domain: es.net X-Recipent: ; ; ; ; ; X-Sender: X-To_Name: David Malone X-To_Domain: maths.tcd.ie X-To: David Malone X-To_Email: dwmalone@maths.tcd.ie X-To_Alias: dwmalone X-Mailman-Approved-At: Fri, 26 Sep 2008 22:43:16 +0000 Cc: freebsd-hackers@FreeBSD.org, Jeremy Chadwick , freebsd-stable@FreeBSD.org Subject: Re: bad NFS/UDP performance X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Sep 2008 22:28:45 -0000 --==_Exmh_1222467420_5817P Content-Type: text/plain; charset=us-ascii Content-Disposition: inline David, You beat me to it. Danny, read the iperf man page: -b, --bandwidth n[KM] set target bandwidth to n bits/sec (default 1 Mbit/sec). This setting requires UDP (-u). The page needs updating, though. It should read "-b, --bandwidth n[KMG]. It also does NOT require -u. If you use -b, UDP is assumed. -- R. Kevin Oberman, Network Engineer Energy Sciences Network (ESnet) Ernest O. Lawrence Berkeley National Laboratory (Berkeley Lab) E-mail: oberman@es.net Phone: +1 510 486-8634 Key fingerprint:059B 2DDF 031C 9BA3 14A4 EADA 927D EBB3 987B 3751 --==_Exmh_1222467420_5817P Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (FreeBSD) Comment: Exmh version 2.5 06/03/2002 iD8DBQFI3V9ckn3rs5h7N1ERAiyHAJ9bLra2puNNXtyoZSsaFkSnCUbxMACgi0vt Fli2cgG1hEAVg9b+A2eAsbk= =q4xd -----END PGP SIGNATURE----- --==_Exmh_1222467420_5817P-- From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 26 23:43:38 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 96AA5106568E for ; Fri, 26 Sep 2008 23:43:38 +0000 (UTC) (envelope-from julian@elischer.org) Received: from outT.internet-mail-service.net (outt.internet-mail-service.net [216.240.47.243]) by mx1.freebsd.org (Postfix) with ESMTP id 74A4D8FC27 for ; Fri, 26 Sep 2008 23:43:38 +0000 (UTC) (envelope-from julian@elischer.org) Received: from idiom.com (mx0.idiom.com [216.240.32.160]) by out.internet-mail-service.net (Postfix) with ESMTP id A561624B8; Fri, 26 Sep 2008 16:43:38 -0700 (PDT) Received: from julian-mac.elischer.org (localhost [127.0.0.1]) by idiom.com (Postfix) with ESMTP id BBAB42D6014; Fri, 26 Sep 2008 16:43:37 -0700 (PDT) Message-ID: <48DD73A9.5000505@elischer.org> Date: Fri, 26 Sep 2008 16:43:37 -0700 From: Julian Elischer User-Agent: Thunderbird 2.0.0.17 (Macintosh/20080914) MIME-Version: 1.0 To: xorquewasp@googlemail.com References: <20080926222711.GA74003@logik.internal.network> In-Reply-To: <20080926222711.GA74003@logik.internal.network> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-hackers@freebsd.org Subject: Re: popen() in multithreaded program - hangs? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Sep 2008 23:43:38 -0000 xorquewasp@googlemail.com wrote: > I'm trying to write a client for the jack audio connection kit > (http://jackaudio.org), have hit an apparent bug and am not sure what revision of FreeBSD? > who's at fault. > > This is the client: > > -- > > #include > #include > > jack_port_t *input_port; > jack_port_t *output_port; > jack_client_t *client; > > int > main (void) > { > jack_status_t status; > > client = jack_client_open ("cdemo", JackNoStartServer, &status, "default"); > if (!client) errx (112, "client_open: could not"); > > jack_client_close (client); > return 0; > } > > -- > > The jack_client_open() call never returns and the process can only be killed > with SIGKILL. Tracing execution in gdb shows that the hang occurs in the > popen() call in jack_get_tmpdir(), defined at client.c:114: > > http://trac.jackaudio.org/browser/trunk/jack/libjack/client.c > > Is there a known issue with calling popen() in a multithreaded program? At > the point of that call, on my system, there are three running threads. > > Any help/advice on how to resolve this problem would be appreciated. > > xw > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 26 23:45:03 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CF2BA106568B for ; Fri, 26 Sep 2008 23:45:03 +0000 (UTC) (envelope-from ravi.murty@intel.com) Received: from mga01.intel.com (mga01.intel.com [192.55.52.88]) by mx1.freebsd.org (Postfix) with ESMTP id 9A8338FC08 for ; Fri, 26 Sep 2008 23:45:03 +0000 (UTC) (envelope-from ravi.murty@intel.com) Received: from fmsmga001.fm.intel.com ([10.253.24.23]) by fmsmga101.fm.intel.com with ESMTP; 26 Sep 2008 16:13:02 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="4.33,316,1220252400"; d="scan'208,217";a="620795681" Received: from orsmsx334.amr.corp.intel.com (HELO orsmsx334.jf.intel.com) ([10.22.226.45]) by fmsmga001.fm.intel.com with ESMTP; 26 Sep 2008 16:17:36 -0700 Received: from orsmsx416.amr.corp.intel.com ([10.22.226.46]) by orsmsx334.jf.intel.com with Microsoft SMTPSVC(6.0.3790.1830); Fri, 26 Sep 2008 16:16:42 -0700 X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Date: Fri, 26 Sep 2008 16:15:48 -0700 Message-ID: X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: priority fields in a thread Thread-Index: AckgLc9DUVi7XEGmQ7iYhYHoGVhhyA== From: "Murty, Ravi" To: X-OriginalArrivalTime: 26 Sep 2008 23:16:42.0450 (UTC) FILETIME=[EFBC9320:01C9202D] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: priority fields in a thread X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Sep 2008 23:45:03 -0000 Hello, =20 I was wondering what all these different priority related fields in a thread structure meant. This is the 8.0 kernel tree. =20 Thanks Ravi =20 =20 Td_base_pri Td_user_pri Td_base_user_pri Td_priority From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 26 23:47:32 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4A71510656C7 for ; Fri, 26 Sep 2008 23:47:32 +0000 (UTC) (envelope-from xorquewasp@googlemail.com) Received: from ug-out-1314.google.com (ug-out-1314.google.com [66.249.92.173]) by mx1.freebsd.org (Postfix) with ESMTP id CB9DE8FC14 for ; Fri, 26 Sep 2008 23:47:31 +0000 (UTC) (envelope-from xorquewasp@googlemail.com) Received: by ug-out-1314.google.com with SMTP id m2so13617uge.39 for ; Fri, 26 Sep 2008 16:47:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=domainkey-signature:received:received:received:date:from:to:cc :subject:message-id:references:mime-version:content-type :content-disposition:in-reply-to; bh=gXbIDufL3tfI9HcRTrVEYjT8wVYg2Y9ib/DvRu4ACeg=; b=sbb9RE2wNCvR2wXGcO8DAmKLfRmQTLSeAgglBMugWKivk7GjPW2cLC5T30IkhlgmDn 1Z8PMMvmzRJ66fY77cCui6wa3GWLNqaXeIoCatJFgMT6mQWVAZXEt1VRibHv/TMZJ3Mh nKVIJJV3ZyJ2u3FWXlKAp0YrXztExYuaNmvmw= DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to; b=jGhHrK82/4nC+GwzgB03Jh/EN6v/CO47HJ2OSsLk2Aph+x5rUROGDwwzz/H63f7Rha S/nq7VTFSwY2OeVRldZ6yEbqYsRspL+4xtwhN+p7tAUV9ZecvyKODqjSlyfFkYh2jKbR sN3+dMKqlUZYcgQHwNFto42+eIu4duIyo/uaw= Received: by 10.210.24.7 with SMTP id 7mr2194964ebx.198.1222472850527; Fri, 26 Sep 2008 16:47:30 -0700 (PDT) Received: from logik.internal.network ( [81.86.41.187]) by mx.google.com with ESMTPS id 3sm4840258eyj.3.2008.09.26.16.47.29 (version=TLSv1/SSLv3 cipher=OTHER); Fri, 26 Sep 2008 16:47:30 -0700 (PDT) Received: by logik.internal.network (Postfix, from userid 11001) id C0B0860AA; Fri, 26 Sep 2008 23:47:27 +0000 (UTC) Date: Sat, 27 Sep 2008 00:47:27 +0100 From: xorquewasp@googlemail.com To: Julian Elischer Message-ID: <20080926234727.GA60860@logik.internal.network> References: <20080926222711.GA74003@logik.internal.network> <48DD73A9.5000505@elischer.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <48DD73A9.5000505@elischer.org> Cc: freebsd-hackers@freebsd.org Subject: Re: popen() in multithreaded program - hangs? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Sep 2008 23:47:32 -0000 On 20080926 16:43:37, Julian Elischer wrote: > xorquewasp@googlemail.com wrote: >> I'm trying to write a client for the jack audio connection kit >> (http://jackaudio.org), have hit an apparent bug and am not sure > > what revision of FreeBSD? Ahem, should've mentioned that. FreeBSD 6.3-RELEASE-p1 #0: Wed Feb 13 02:40:56 UTC 2008 root@i386-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC -- xw From owner-freebsd-hackers@FreeBSD.ORG Sat Sep 27 01:43:51 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D2E7E1065691 for ; Sat, 27 Sep 2008 01:43:51 +0000 (UTC) (envelope-from deischen@freebsd.org) Received: from mail.netplex.net (mail.netplex.net [204.213.176.10]) by mx1.freebsd.org (Postfix) with ESMTP id 8FC0D8FC0A for ; Sat, 27 Sep 2008 01:43:51 +0000 (UTC) (envelope-from deischen@freebsd.org) Received: from sea.ntplx.net (sea.ntplx.net [204.213.176.11]) by mail.netplex.net (8.14.3/8.14.3/NETPLEX) with ESMTP id m8R1hmX5024963; Fri, 26 Sep 2008 21:43:48 -0400 (EDT) X-Virus-Scanned: by AMaViS and Clam AntiVirus (mail.netplex.net) X-Greylist: Message whitelisted by DRAC access database, not delayed by milter-greylist-4.0 (mail.netplex.net [204.213.176.10]); Fri, 26 Sep 2008 21:43:49 -0400 (EDT) Date: Fri, 26 Sep 2008 21:43:48 -0400 (EDT) From: Daniel Eischen X-X-Sender: eischen@sea.ntplx.net To: xorquewasp@googlemail.com In-Reply-To: <20080926234727.GA60860@logik.internal.network> Message-ID: References: <20080926222711.GA74003@logik.internal.network> <48DD73A9.5000505@elischer.org> <20080926234727.GA60860@logik.internal.network> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-hackers@freebsd.org, Julian Elischer Subject: Re: popen() in multithreaded program - hangs? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Daniel Eischen List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Sep 2008 01:43:51 -0000 On Sat, 27 Sep 2008, xorquewasp@googlemail.com wrote: > On 20080926 16:43:37, Julian Elischer wrote: >> xorquewasp@googlemail.com wrote: >>> I'm trying to write a client for the jack audio connection kit >>> (http://jackaudio.org), have hit an apparent bug and am not sure >> >> what revision of FreeBSD? > > Ahem, should've mentioned that. > > FreeBSD 6.3-RELEASE-p1 #0: Wed Feb 13 02:40:56 UTC 2008 > root@i386-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC http://www.freebsd.org/releases/6.3R/errata.html http://security.freebsd.org/advisories/FreeBSD-EN-08:01.libpthread.asc -- DE From owner-freebsd-hackers@FreeBSD.ORG Sat Sep 27 02:17:16 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 26CAC106568C for ; Sat, 27 Sep 2008 02:17:16 +0000 (UTC) (envelope-from xorquewasp@googlemail.com) Received: from nf-out-0910.google.com (nf-out-0910.google.com [64.233.182.190]) by mx1.freebsd.org (Postfix) with ESMTP id A77C68FC14 for ; Sat, 27 Sep 2008 02:17:15 +0000 (UTC) (envelope-from xorquewasp@googlemail.com) Received: by nf-out-0910.google.com with SMTP id h3so485809nfh.33 for ; Fri, 26 Sep 2008 19:17:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=domainkey-signature:received:received:received:date:from:to:cc :subject:message-id:references:mime-version:content-type :content-disposition:in-reply-to; bh=LhT8FsYe/tptWxF2V6ltwR/g/6KOENee44JoB9UFOFk=; b=jGAADNKERChOxkiOt9tUnD7n4IUGjy25E1389x28gdxbi3VG71u8AzFrR/amRbsOHC QPOLQq7os50PAQ8E1hRK2PLG6wFwFLQBG5eLl3F4uuHyo3OmWiX+R5zP5f1viJUjUmC4 r49F1RAmT+LtuqqxxaMv3VPTE3d4SEJp7yzLM= DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to; b=N/Pt0UIMF45Qg5mS3k3bIsDc4qQKXutkMmmGZdyr3hBwWAcNiFOIk8naO7TMvwWrA3 izIfjlDFmAjFVotwy8QFC7mNAb2HtMMSB1FTrYSsRcWXeBayX8INgxTbC+RxhYbpb5YG gptS0eYJP6ncQqb5phTJjo3t47c+xLbLAc02g= Received: by 10.210.56.7 with SMTP id e7mr2433633eba.5.1222481834242; Fri, 26 Sep 2008 19:17:14 -0700 (PDT) Received: from logik.internal.network ( [81.86.41.187]) by mx.google.com with ESMTPS id 7sm5045522eyb.1.2008.09.26.19.17.12 (version=TLSv1/SSLv3 cipher=OTHER); Fri, 26 Sep 2008 19:17:13 -0700 (PDT) Received: by logik.internal.network (Postfix, from userid 11001) id 44D2660AA; Sat, 27 Sep 2008 02:17:10 +0000 (UTC) Date: Sat, 27 Sep 2008 03:17:10 +0100 From: xorquewasp@googlemail.com To: Daniel Eischen Message-ID: <20080927021709.GB60860@logik.internal.network> References: <20080926222711.GA74003@logik.internal.network> <48DD73A9.5000505@elischer.org> <20080926234727.GA60860@logik.internal.network> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: Cc: freebsd-hackers@freebsd.org Subject: Re: popen() in multithreaded program - hangs? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Sep 2008 02:17:16 -0000 On 20080926 21:43:48, Daniel Eischen wrote: > On Sat, 27 Sep 2008, xorquewasp@googlemail.com wrote: > >> On 20080926 16:43:37, Julian Elischer wrote: >>> xorquewasp@googlemail.com wrote: >>>> I'm trying to write a client for the jack audio connection kit >>>> (http://jackaudio.org), have hit an apparent bug and am not sure >>> >>> what revision of FreeBSD? >> >> Ahem, should've mentioned that. >> >> FreeBSD 6.3-RELEASE-p1 #0: Wed Feb 13 02:40:56 UTC 2008 >> root@i386-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC > > http://www.freebsd.org/releases/6.3R/errata.html > http://security.freebsd.org/advisories/FreeBSD-EN-08:01.libpthread.asc I wonder if I'm missing something: $ sudo freebsd-update fetch Looking up update.FreeBSD.org mirrors... 1 mirrors found. Fetching metadata signature for 6.3-RELEASE from update1.FreeBSD.org... done. Fetching metadata index... done. Inspecting system... done. Preparing to download files... done. No updates needed to update system to 6.3-RELEASE-p4. I appear to have that update but the problem persists. -- xw From owner-freebsd-hackers@FreeBSD.ORG Sat Sep 27 05:06:23 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E3FE610656A8 for ; Sat, 27 Sep 2008 05:06:23 +0000 (UTC) (envelope-from deischen@freebsd.org) Received: from mail.netplex.net (mail.netplex.net [204.213.176.10]) by mx1.freebsd.org (Postfix) with ESMTP id A10BF8FC13 for ; Sat, 27 Sep 2008 05:06:23 +0000 (UTC) (envelope-from deischen@freebsd.org) Received: from sea.ntplx.net (sea.ntplx.net [204.213.176.11]) by mail.netplex.net (8.14.3/8.14.3/NETPLEX) with ESMTP id m8R56MM6025684; Sat, 27 Sep 2008 01:06:22 -0400 (EDT) X-Virus-Scanned: by AMaViS and Clam AntiVirus (mail.netplex.net) X-Greylist: Message whitelisted by DRAC access database, not delayed by milter-greylist-4.0 (mail.netplex.net [204.213.176.10]); Sat, 27 Sep 2008 01:06:22 -0400 (EDT) Date: Sat, 27 Sep 2008 01:06:22 -0400 (EDT) From: Daniel Eischen X-X-Sender: eischen@sea.ntplx.net To: xorquewasp@googlemail.com In-Reply-To: <20080927021709.GB60860@logik.internal.network> Message-ID: References: <20080926222711.GA74003@logik.internal.network> <48DD73A9.5000505@elischer.org> <20080926234727.GA60860@logik.internal.network> <20080927021709.GB60860@logik.internal.network> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-hackers@freebsd.org Subject: Re: popen() in multithreaded program - hangs? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Daniel Eischen List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Sep 2008 05:06:24 -0000 On Sat, 27 Sep 2008, xorquewasp@googlemail.com wrote: > On 20080926 21:43:48, Daniel Eischen wrote: >> On Sat, 27 Sep 2008, xorquewasp@googlemail.com wrote: >> >>> On 20080926 16:43:37, Julian Elischer wrote: >>>> xorquewasp@googlemail.com wrote: >>>>> I'm trying to write a client for the jack audio connection kit >>>>> (http://jackaudio.org), have hit an apparent bug and am not sure >>>> >>>> what revision of FreeBSD? >>> >>> Ahem, should've mentioned that. >>> >>> FreeBSD 6.3-RELEASE-p1 #0: Wed Feb 13 02:40:56 UTC 2008 >>> root@i386-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC >> >> http://www.freebsd.org/releases/6.3R/errata.html >> http://security.freebsd.org/advisories/FreeBSD-EN-08:01.libpthread.asc > > I wonder if I'm missing something: > > $ sudo freebsd-update fetch > Looking up update.FreeBSD.org mirrors... 1 mirrors found. > Fetching metadata signature for 6.3-RELEASE from update1.FreeBSD.org... done. > Fetching metadata index... done. > Inspecting system... done. > Preparing to download files... done. > > No updates needed to update system to 6.3-RELEASE-p4. > > I appear to have that update but the problem persists. It's not security related, so I don't know whether it would be in a binary update. You should follow the procedure listed in the links above. -- DE From owner-freebsd-hackers@FreeBSD.ORG Sat Sep 27 06:52:32 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B286C1065687 for ; Sat, 27 Sep 2008 06:52:32 +0000 (UTC) (envelope-from xorquewasp@googlemail.com) Received: from ug-out-1314.google.com (ug-out-1314.google.com [66.249.92.170]) by mx1.freebsd.org (Postfix) with ESMTP id 3A5BC8FC23 for ; Sat, 27 Sep 2008 06:52:32 +0000 (UTC) (envelope-from xorquewasp@googlemail.com) Received: by ug-out-1314.google.com with SMTP id m2so47659uge.39 for ; Fri, 26 Sep 2008 23:52:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=domainkey-signature:received:received:received:date:from:to:cc :subject:message-id:references:mime-version:content-type :content-disposition:in-reply-to; bh=WDlIISW0iSYXkjMCDC3Lvd8ANX+5/2MNB1Wgm6ikkPk=; b=BF22ajLazF/Obby9fLaJA3D/8N8TGsiTLKPIV9Olh/BsokdN/5we+5NGk8JLOHo4sM bw9frov59dlPUQLXbfQqYrO5fsPTBkzbgUSbPxqpnKCYuDb/FokgbkwByMHKQT9KIGIW Qqr52Yhr2vp7lTyHrUP5hqB+utAkuFX8swnzc= DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to; b=apLJCtHfzNhGW0bcWf18mPw9kC5bS+TgD8oswQX3CzjkyvQ5PmTMaD8DpItMwq42m+ ZUi5zxdydWWtR9rR03CgMug03MiTr2iH8hpkj/BcbUZtryrBF+sWnDCcqN8FvqcgkQVR 1zp9UZR/q8U302dFLwqhN38k3cYHkvqJFCyFI= Received: by 10.210.68.17 with SMTP id q17mr442807eba.87.1222498350263; Fri, 26 Sep 2008 23:52:30 -0700 (PDT) Received: from logik.internal.network ( [81.86.41.187]) by mx.google.com with ESMTPS id 23sm5259985eya.7.2008.09.26.23.52.28 (version=TLSv1/SSLv3 cipher=OTHER); Fri, 26 Sep 2008 23:52:29 -0700 (PDT) Received: by logik.internal.network (Postfix, from userid 11001) id 7D13560AA; Sat, 27 Sep 2008 06:52:27 +0000 (UTC) Date: Sat, 27 Sep 2008 07:52:27 +0100 From: xorquewasp@googlemail.com To: Daniel Eischen Message-ID: <20080927065227.GB4416@logik.internal.network> References: <20080926222711.GA74003@logik.internal.network> <48DD73A9.5000505@elischer.org> <20080926234727.GA60860@logik.internal.network> <20080927021709.GB60860@logik.internal.network> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: Cc: freebsd-hackers@freebsd.org, cperciva@freebsd.org Subject: Re: freebsd-update missed? (was: popen() in multithreaded program - hangs?) X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Sep 2008 06:52:32 -0000 On 20080927 01:06:22, Daniel Eischen wrote: > > It's not security related, so I don't know whether it would be in a > binary update. You should follow the procedure listed in the links > above. I'm not sure either. In every description I see of freebsd-update, there's a claim that it installs "binary security and errata updates". I only use freebsd-update to update my machines and I was under the impression that I've been getting errata updates too. Could this have been missed on the system used to build updates? I'd be surprised, but you know, these things happen. I've CCd in cperciva@ to see what he thinks... -- xw From owner-freebsd-hackers@FreeBSD.ORG Sat Sep 27 07:07:59 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 72EEE106568D for ; Sat, 27 Sep 2008 07:07:59 +0000 (UTC) (envelope-from julian@elischer.org) Received: from outL.internet-mail-service.net (outl.internet-mail-service.net [216.240.47.235]) by mx1.freebsd.org (Postfix) with ESMTP id 5873C8FC19 for ; Sat, 27 Sep 2008 07:07:59 +0000 (UTC) (envelope-from julian@elischer.org) Received: from idiom.com (mx0.idiom.com [216.240.32.160]) by out.internet-mail-service.net (Postfix) with ESMTP id E8D022906; Sat, 27 Sep 2008 00:07:59 -0700 (PDT) Received: from julian-mac.elischer.org (localhost [127.0.0.1]) by idiom.com (Postfix) with ESMTP id ED7F22D6016; Sat, 27 Sep 2008 00:07:57 -0700 (PDT) Message-ID: <48DDDBCD.40708@elischer.org> Date: Sat, 27 Sep 2008 00:07:57 -0700 From: Julian Elischer User-Agent: Thunderbird 2.0.0.17 (Macintosh/20080914) MIME-Version: 1.0 To: xorquewasp@googlemail.com References: <20080926222711.GA74003@logik.internal.network> <48DD73A9.5000505@elischer.org> <20080926234727.GA60860@logik.internal.network> <20080927021709.GB60860@logik.internal.network> <20080927065227.GB4416@logik.internal.network> In-Reply-To: <20080927065227.GB4416@logik.internal.network> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: Daniel Eischen , freebsd-hackers@freebsd.org, cperciva@freebsd.org Subject: Re: freebsd-update missed? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Sep 2008 07:07:59 -0000 xorquewasp@googlemail.com wrote: > On 20080927 01:06:22, Daniel Eischen wrote: >> It's not security related, so I don't know whether it would be in a >> binary update. You should follow the procedure listed in the links >> above. > > I'm not sure either. In every description I see of freebsd-update, > there's a claim that it installs "binary security and errata updates". > > I only use freebsd-update to update my machines and I was under the > impression that I've been getting errata updates too. > > Could this have been missed on the system used to build updates? > I'd be surprised, but you know, these things happen. > > I've CCd in cperciva@ to see what he thinks... > > -- > xw > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" I'm sure it's there.. it may be a different problem of course. From owner-freebsd-hackers@FreeBSD.ORG Sat Sep 27 07:20:40 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 483461065678; Sat, 27 Sep 2008 07:20:40 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from cs1.cs.huji.ac.il (cs1.cs.huji.ac.il [132.65.16.10]) by mx1.freebsd.org (Postfix) with ESMTP id EBAFF8FC1B; Sat, 27 Sep 2008 07:20:39 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from pampa.cs.huji.ac.il ([132.65.80.32]) by cs1.cs.huji.ac.il with esmtp id 1KjU6X-0005dk-On; Sat, 27 Sep 2008 10:20:37 +0300 X-Mailer: exmh version 2.7.2 01/07/2005 with nmh-1.2 To: Matthew Dillon In-reply-to: <200809261818.m8QII6jF004333@apollo.backplane.com> References: <20080926081806.GA19055@icarus.home.lan> <20080926095230.GA20789@icarus.home.lan> <20080926143153.GA26978@icarus.home.lan> <200809261818.m8QII6jF004333@apollo.backplane.com> Comments: In-reply-to Matthew Dillon message dated "Fri, 26 Sep 2008 11:18:06 -0700." Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Sat, 27 Sep 2008 10:20:37 +0300 From: Danny Braniss Message-ID: Cc: freebsd-hackers@freebsd.org, Jeremy Chadwick , freebsd-stable@freebsd.org Subject: Re: bad NFS/UDP performance X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Sep 2008 07:20:40 -0000 > > :> -vfs.nfs.realign_test: 22141777 > :> +vfs.nfs.realign_test: 498351 > :> > :> -vfs.nfsrv.realign_test: 5005908 > :> +vfs.nfsrv.realign_test: 0 > :> > :> +vfs.nfsrv.commit_miss: 0 > :> +vfs.nfsrv.commit_blks: 0 > :> > :> changing them did nothing - or at least with respect to nfs throughput :-) > : > :I'm not sure what any of these do, as NFS is a bit out of my league. > ::-) I'll be following this thread though! > : > :-- > :| Jeremy Chadwick jdc at parodius.com | > > A non-zero nfs_realign_count is bad, it means NFS had to copy the > mbuf chain to fix the alignment. nfs_realign_test is just the > number of times it checked. So nfs_realign_test is irrelevant. > it's nfs_realign_count that matters. > it's zero, so I guess I'm ok there. funny though, on my 'good' machine, vfs.nfsrv.realign_test: 5862999 and on the slow one, it's 0 - but then again the good one has been up for several days. > Several things can cause NFS payloads to be improperly aligned. > Anything from older network drivers which can't start DMA on a > 2-byte boundary, resulting in the 14-byte encapsulation header > causing improper alignment of the IP header & payload, to rpc > embedded in NFS TCP streams winding up being misaligned. > > Modern network hardware either support 2-byte-aligned DMA, allowing > the encapsulation to be 2-byte aligned so the payload winds up being > 4-byte aligned, or support DMA chaining allowing the payload to be > placed in its own mbuf, or pad, etc. > > -- > > One thing I would check is to be sure a couple of nfsiod's are running > on the client when doing your tests. If none are running the RPCs wind > up being more synchronous and less pipelined. Another thing I would > check is IP fragment reassembly statistics (for UDP) - there should be > none for TCP connections no matter what the NFS I/O size selected. > ahh, nfsiod, it seems that it's now dynamicaly started! at least none show when host is idle, after i run my tests there are 20! with ppid 0 need to refresh my NFS knowledge. how can I see the IP fragment reassembly statistics? > (It does seem more likely to be scheduler-related, though). > tend to agree, I tried bith ULE/BSD, but the badness is there. > -Matt > thanks, danny From owner-freebsd-hackers@FreeBSD.ORG Sat Sep 27 07:23:50 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CCE261065693; Sat, 27 Sep 2008 07:23:50 +0000 (UTC) (envelope-from dillon@apollo.backplane.com) Received: from apollo.backplane.com (apollo.backplane.com [216.240.41.2]) by mx1.freebsd.org (Postfix) with ESMTP id 83C088FC14; Sat, 27 Sep 2008 07:23:50 +0000 (UTC) (envelope-from dillon@apollo.backplane.com) Received: from apollo.backplane.com (localhost [127.0.0.1]) by apollo.backplane.com (8.14.1/8.14.1) with ESMTP id m8R7Nevi009153; Sat, 27 Sep 2008 00:23:40 -0700 (PDT) Received: (from dillon@localhost) by apollo.backplane.com (8.14.1/8.13.4/Submit) id m8R7NeEv009152; Sat, 27 Sep 2008 00:23:40 -0700 (PDT) Date: Sat, 27 Sep 2008 00:23:40 -0700 (PDT) From: Matthew Dillon Message-Id: <200809270723.m8R7NeEv009152@apollo.backplane.com> To: Danny Braniss References: <20080926081806.GA19055@icarus.home.lan> <20080926095230.GA20789@icarus.home.lan> <20080926143153.GA26978@icarus.home.lan> <200809261818.m8QII6jF004333@apollo.backplane.com> Cc: freebsd-hackers@freebsd.org, Jeremy Chadwick , freebsd-stable@freebsd.org Subject: Re: bad NFS/UDP performance X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Sep 2008 07:23:50 -0000 :how can I see the IP fragment reassembly statistics? : :thanks, : danny netstat -s Also look for unexpected dropped packets, dropped fragments, and errors during the test and such, they are counted in the statistics as well. -Matt Matthew Dillon From owner-freebsd-hackers@FreeBSD.ORG Sat Sep 27 08:12:41 2008 Return-Path: Delivered-To: freebsd-hackers@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 83D43106569C; Sat, 27 Sep 2008 08:12:41 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from cs1.cs.huji.ac.il (cs1.cs.huji.ac.il [132.65.16.10]) by mx1.freebsd.org (Postfix) with ESMTP id 36FAD8FC17; Sat, 27 Sep 2008 08:12:41 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from pampa.cs.huji.ac.il ([132.65.80.32]) by cs1.cs.huji.ac.il with esmtp id 1KjUur-0006DE-GA; Sat, 27 Sep 2008 11:12:37 +0300 X-Mailer: exmh version 2.7.2 01/07/2005 with nmh-1.2 To: "Kevin Oberman" In-reply-to: <20080926221700.1C4AE4500E@ptavv.es.net> References: <20080926221700.1C4AE4500E@ptavv.es.net> Comments: In-reply-to "Kevin Oberman" message dated "Fri, 26 Sep 2008 15:17:00 -0700." Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Sat, 27 Sep 2008 11:12:37 +0300 From: Danny Braniss Message-ID: Cc: David Malone , freebsd-hackers@FreeBSD.org, Jeremy Chadwick , freebsd-stable@FreeBSD.org Subject: Re: bad NFS/UDP performance X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Sep 2008 08:12:41 -0000 > --==_Exmh_1222467420_5817P > Content-Type: text/plain; charset=us-ascii > Content-Disposition: inline > > David, > > You beat me to it. > > Danny, read the iperf man page: > -b, --bandwidth n[KM] > set target bandwidth to n bits/sec (default 1 Mbit/sec). This > setting requires UDP (-u). > > The page needs updating, though. It should read "-b, --bandwidth > n[KMG]. It also does NOT require -u. If you use -b, UDP is assumed. I did RTFM(*), but when i tried it just wouldn't work, I tried today and it's actually working - so don't RTFM before coffee! btw, even though iperf sucks, netperf udp tends to bring the server down to it's knees. danny PS: * - i don't seem to have the iperf man, all I have is iperf -h From owner-freebsd-hackers@FreeBSD.ORG Sat Sep 27 09:17:37 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D0AB7106568C for ; Sat, 27 Sep 2008 09:17:37 +0000 (UTC) (envelope-from xorquewasp@googlemail.com) Received: from ug-out-1314.google.com (ug-out-1314.google.com [66.249.92.175]) by mx1.freebsd.org (Postfix) with ESMTP id 5C7008FC1F for ; Sat, 27 Sep 2008 09:17:37 +0000 (UTC) (envelope-from xorquewasp@googlemail.com) Received: by ug-out-1314.google.com with SMTP id m2so59195uge.39 for ; Sat, 27 Sep 2008 02:17:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=domainkey-signature:received:received:received:date:from:to:cc :subject:message-id:references:mime-version:content-type :content-disposition:in-reply-to; bh=q2RRyvCK1mDuu3qm5gFRqsbSG/bX/XKnRUs0veIkQ5g=; b=pZVdLeEMR/Gb0lhdVHXxVCHSEV61hDq9v1XTkQIFJSnApTQI2gekNIHbE5NUxpWj52 E5mmAcLRZ2qHCgYb+bApJVnD0RP5QtBXogoW7eyO6D9sV0UitIqnp3s26M3hXjRo/6SA OgJF+baYWybfydzRfqYg6O6oGTZS1O4MB7py8= DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to; b=fJjW42THQlg/vjYGt7PMAm1GdTBONb3a9PWdjwKHRx7yMC3gsHXoLhg8vcnXpgD3+D GLoV6qxTOIpgnoI4yO2dXMRbW6TZS6D81bODZsbNBeBHyDt4/MVYSkpXLHsoGHiY1AU3 CI+EjrSUNuL9l4vlctWwuEuoRJS3V02LCxdIw= Received: by 10.210.125.7 with SMTP id x7mr2791592ebc.96.1222507056051; Sat, 27 Sep 2008 02:17:36 -0700 (PDT) Received: from logik.internal.network ( [81.86.41.187]) by mx.google.com with ESMTPS id 23sm5372390eya.7.2008.09.27.02.17.34 (version=TLSv1/SSLv3 cipher=OTHER); Sat, 27 Sep 2008 02:17:35 -0700 (PDT) Received: by logik.internal.network (Postfix, from userid 11001) id 1A05260AA; Sat, 27 Sep 2008 09:17:33 +0000 (UTC) Date: Sat, 27 Sep 2008 10:17:33 +0100 From: xorquewasp@googlemail.com To: Julian Elischer Message-ID: <20080927091733.GA98052@logik.internal.network> References: <20080926222711.GA74003@logik.internal.network> <48DD73A9.5000505@elischer.org> <20080926234727.GA60860@logik.internal.network> <20080927021709.GB60860@logik.internal.network> <20080927065227.GB4416@logik.internal.network> <48DDDBCD.40708@elischer.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <48DDDBCD.40708@elischer.org> Cc: Daniel Eischen , freebsd-hackers@freebsd.org, cperciva@freebsd.org Subject: Re: freebsd-update missed? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Sep 2008 09:17:37 -0000 On 20080927 00:07:57, Julian Elischer wrote: > I'm sure it's there.. > it may be a different problem of course. > I don't know... Checking with ident gives: $FreeBSD: src/lib/libpthread/thread/thr_kern.c,v 1.116.2.1 2006/03/16 23:29:07 deischen Exp $ The patch claims "1.116.2.1.6.1" Are these the same revisions? I mean, if I can determine that I definitely have the patch, then I have another problem to worry about! From owner-freebsd-hackers@FreeBSD.ORG Sat Sep 27 10:15:16 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 18A2A1065694 for ; Sat, 27 Sep 2008 10:15:16 +0000 (UTC) (envelope-from bipolor@gmail.com) Received: from po-out-1718.google.com (po-out-1718.google.com [72.14.252.158]) by mx1.freebsd.org (Postfix) with ESMTP id DDF588FC1E for ; Sat, 27 Sep 2008 10:15:15 +0000 (UTC) (envelope-from bipolor@gmail.com) Received: by po-out-1718.google.com with SMTP id y22so1905223pof.3 for ; Sat, 27 Sep 2008 03:15:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:mime-version:content-type; bh=VAmie3E8Jo/cHSSVvMRsLnbIm82JjAC/z1blSKFTNkY=; b=EUr3q0nh8HJYFfWo5kyktQnZs8mYUBpDvwN93Xjx2A8qqHdUSuqUARGfpq+w1xg98u rnX7bag89Sfw7+WKKqU6Wze0I5UQ+iRAk5rF0Hf2/7RB4y0DUk2ei3OgBKuwwPAxrGeB SVXORZuBKppK7K/rhd8S/fOx2v18WB1tArVKc= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type; b=tPbxjKkbWUu/ShG5UbuSdOqtCvRgRHM3L+mcWtc2nG1ALw+3wDX/Ydd90yL1qwk1Ei L3R+x0aUkyZGyHYNYSWQPsDWlJk7EPkXSXMFDnqj5ZpreZ3r+wVdkK6kHVmIKtw3+Z2r PEmNfKvXVJ+tXJKXYm5iNQfwQln4q+7ynPgsU= Received: by 10.141.162.5 with SMTP id p5mr1267551rvo.113.1222509668376; Sat, 27 Sep 2008 03:01:08 -0700 (PDT) Received: by 10.141.128.12 with HTTP; Sat, 27 Sep 2008 03:01:08 -0700 (PDT) Message-ID: Date: Sat, 27 Sep 2008 03:01:08 -0700 From: "Mike Price" To: freebsd-hackers@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: SSH Tunneling All TCP Traffic X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Sep 2008 10:15:16 -0000 I need to tunnel all of my TCP SSH-2 traffic from my local box to my remote box that I will have an account on. I heard this can be done in one command? ssh -f me@lab.com -L 8888:lab.com:53 -N SOCKS: 8888 SSH2: 53 What am I doing wrong? From owner-freebsd-hackers@FreeBSD.ORG Sat Sep 27 10:16:00 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4FB74106569C; Sat, 27 Sep 2008 10:16:00 +0000 (UTC) (envelope-from rwatson@FreeBSD.org) Received: from cyrus.watson.org (cyrus.watson.org [65.122.17.42]) by mx1.freebsd.org (Postfix) with ESMTP id 26DD48FC27; Sat, 27 Sep 2008 10:16:00 +0000 (UTC) (envelope-from rwatson@FreeBSD.org) Received: from fledge.watson.org (fledge.watson.org [65.122.17.41]) by cyrus.watson.org (Postfix) with ESMTP id B42AE46B46; Sat, 27 Sep 2008 06:15:59 -0400 (EDT) Date: Sat, 27 Sep 2008 11:15:59 +0100 (BST) From: Robert Watson X-X-Sender: robert@fledge.watson.org To: Danny Braniss In-Reply-To: Message-ID: References: <20080926081806.GA19055@icarus.home.lan> <20080926095230.GA20789@icarus.home.lan> User-Agent: Alpine 1.10 (BSF 962 2008-03-14) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-hackers@freebsd.org, Jeremy Chadwick , freebsd-stable@freebsd.org Subject: Re: bad NFS/UDP performance X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Sep 2008 10:16:00 -0000 On Fri, 26 Sep 2008, Danny Braniss wrote: > after more testing, it seems it's related to changes made between Aug 4 and > Aug 29 ie, a kernel built on Aug 4 works fine, Aug 29 is slow. I'l now try > and close the gap. I think this is the best way forward -- skimming August changes, there are a number of candidate commits, including retuning of UDP hashes by mav, my rwlock changes, changes to mbuf chain handling, etc. Thanks, Robert N M Watson Computer Laboratory University of Cambridge From owner-freebsd-hackers@FreeBSD.ORG Sat Sep 27 10:34:59 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C0C601065694 for ; Sat, 27 Sep 2008 10:34:59 +0000 (UTC) (envelope-from mohacsi@niif.hu) Received: from mail.ki.iif.hu (mail.ki.iif.hu [IPv6:2001:738:0:411::241]) by mx1.freebsd.org (Postfix) with ESMTP id 9CFE88FC08 for ; Sat, 27 Sep 2008 10:34:57 +0000 (UTC) (envelope-from mohacsi@niif.hu) Received: from localhost (localhost [IPv6:::1]) by mail.ki.iif.hu (Postfix) with ESMTP id E808184A74; Sat, 27 Sep 2008 12:34:46 +0200 (CEST) X-Virus-Scanned: by amavisd-new at mignon.ki.iif.hu Received: from mail.ki.iif.hu ([127.0.0.1]) by localhost (mignon.ki.iif.hu [127.0.0.1]) (amavisd-new, port 10024) with LMTP id sWYQFgpLS8n8; Sat, 27 Sep 2008 12:34:44 +0200 (CEST) Received: by mail.ki.iif.hu (Postfix, from userid 9002) id 9053D84A6F; Sat, 27 Sep 2008 12:34:44 +0200 (CEST) Received: from localhost (localhost [127.0.0.1]) by mail.ki.iif.hu (Postfix) with ESMTP id 8EE7B8495B; Sat, 27 Sep 2008 12:34:44 +0200 (CEST) Date: Sat, 27 Sep 2008 12:34:44 +0200 (CEST) From: Mohacsi Janos X-X-Sender: mohacsi@mignon.ki.iif.hu To: Mike Price In-Reply-To: Message-ID: References: User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-hackers@freebsd.org Subject: Re: SSH Tunneling All TCP Traffic X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Sep 2008 10:34:59 -0000 On Sat, 27 Sep 2008, Mike Price wrote: > I need to tunnel all of my TCP SSH-2 traffic from my > local box to my remote box that I will have an account on. I heard this can > be done in one command? > > ssh -f me@lab.com -L 8888:lab.com:53 -N > > SOCKS: 8888 > SSH2: 53 If you want you use SOCKS use -D option instead of individual TCP connection forwading. However you need SOCKS capable client. Regards, Janos Mohacsi > > What am I doing wrong? > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" > From owner-freebsd-hackers@FreeBSD.ORG Sat Sep 27 10:59:31 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6EC6A106568A for ; Sat, 27 Sep 2008 10:59:31 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from QMTA03.westchester.pa.mail.comcast.net (qmta03.westchester.pa.mail.comcast.net [76.96.62.32]) by mx1.freebsd.org (Postfix) with ESMTP id 139328FC22 for ; Sat, 27 Sep 2008 10:59:30 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from OMTA02.westchester.pa.mail.comcast.net ([76.96.62.19]) by QMTA03.westchester.pa.mail.comcast.net with comcast id Kms71a00E0QuhwU53mzWQt; Sat, 27 Sep 2008 10:59:30 +0000 Received: from koitsu.dyndns.org ([67.180.253.227]) by OMTA02.westchester.pa.mail.comcast.net with comcast id KmzU1a0094v8bD73NmzVZG; Sat, 27 Sep 2008 10:59:30 +0000 X-Authority-Analysis: v=1.0 c=1 a=6I5d2MoRAAAA:8 a=QycZ5dHgAAAA:8 a=rmp9mP8RiYlgWZyDIa0A:9 a=lRsp8QJbuJQ0fSOtO-IA:7 a=IsgHKcsH9LTQ5vNl7U86Ou3eMDkA:4 a=EoioJ0NPDVgA:10 a=9xyTavCNlvEA:10 a=LY0hPdMaydYA:10 Received: by icarus.home.lan (Postfix, from userid 1000) id 7CC9EC9432; Sat, 27 Sep 2008 03:59:28 -0700 (PDT) Date: Sat, 27 Sep 2008 03:59:28 -0700 From: Jeremy Chadwick To: xorquewasp@googlemail.com Message-ID: <20080927105928.GA49923@icarus.home.lan> References: <20080926222711.GA74003@logik.internal.network> <48DD73A9.5000505@elischer.org> <20080926234727.GA60860@logik.internal.network> <20080927021709.GB60860@logik.internal.network> <20080927065227.GB4416@logik.internal.network> <48DDDBCD.40708@elischer.org> <20080927091733.GA98052@logik.internal.network> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20080927091733.GA98052@logik.internal.network> User-Agent: Mutt/1.5.18 (2008-05-17) Cc: Daniel Eischen , freebsd-hackers@freebsd.org, Julian Elischer , cperciva@freebsd.org Subject: Re: freebsd-update missed? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Sep 2008 10:59:31 -0000 On Sat, Sep 27, 2008 at 10:17:33AM +0100, xorquewasp@googlemail.com wrote: > On 20080927 00:07:57, Julian Elischer wrote: > > I'm sure it's there.. > > it may be a different problem of course. > > > > I don't know... Checking with ident gives: > > $FreeBSD: src/lib/libpthread/thread/thr_kern.c,v 1.116.2.1 2006/03/16 23:29:07 deischen Exp $ > > The patch claims "1.116.2.1.6.1" > > Are these the same revisions? > > I mean, if I can determine that I definitely have the patch, then I have another > problem to worry about! The advisory explicitly goes over what files were changed, and what revisions include the fix. The below versions include the fix. If you have older versions, then the answer is no, you do not have the fix. http://security.freebsd.org/advisories/FreeBSD-EN-08:01.libpthread.asc src/UPDATING 1.416.2.37.2.6 src/sys/conf/newvers.sh 1.69.2.15.2.5 src/lib/libpthread/sys/lock.c 1.9.2.1.8.1 src/lib/libpthread/thread/thr_kern.c 1.116.2.1.6.1 These are for CVS tag RELENG_6_3. I do not use freebsd-update. That said: The man page for it states that it's a binary updater for pieces in the base system, so you looking at your *source* files would indicate absolutely nothing, other than when you last ran csup to update your /usr/src tree. I do not know of a way to verify if your libpthread library actually contains the fix. We will have to wait for Colin's answer. -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-hackers@FreeBSD.ORG Sat Sep 27 11:15:16 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8995C1065694; Sat, 27 Sep 2008 11:15:16 +0000 (UTC) (envelope-from simon@nitro.dk) Received: from mx.nitro.dk (zarniwoop.nitro.dk [83.92.207.38]) by mx1.freebsd.org (Postfix) with ESMTP id 31E918FC1E; Sat, 27 Sep 2008 11:15:16 +0000 (UTC) (envelope-from simon@nitro.dk) Received: from arthur.nitro.dk (arthur.bofh [192.168.2.3]) by mx.nitro.dk (Postfix) with ESMTP id 653E81E8C49; Sat, 27 Sep 2008 11:15:15 +0000 (UTC) Received: by arthur.nitro.dk (Postfix, from userid 1000) id 53CBA5FC5; Sat, 27 Sep 2008 13:15:15 +0200 (CEST) Date: Sat, 27 Sep 2008 13:15:15 +0200 From: "Simon L. Nielsen" To: Jeremy Chadwick Message-ID: <20080927111514.GA1107@arthur.nitro.dk> References: <20080926222711.GA74003@logik.internal.network> <48DD73A9.5000505@elischer.org> <20080926234727.GA60860@logik.internal.network> <20080927021709.GB60860@logik.internal.network> <20080927065227.GB4416@logik.internal.network> <48DDDBCD.40708@elischer.org> <20080927091733.GA98052@logik.internal.network> <20080927105928.GA49923@icarus.home.lan> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20080927105928.GA49923@icarus.home.lan> User-Agent: Mutt/1.5.18 (2008-05-17) Cc: Daniel Eischen , freebsd-hackers@freebsd.org, xorquewasp@googlemail.com, cperciva@freebsd.org, Julian Elischer Subject: Re: freebsd-update missed? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Sep 2008 11:15:16 -0000 On 2008.09.27 03:59:28 -0700, Jeremy Chadwick wrote: > The advisory explicitly goes over what files were changed, and what > revisions include the fix. The below versions include the fix. If you > have older versions, then the answer is no, you do not have the fix. > > http://security.freebsd.org/advisories/FreeBSD-EN-08:01.libpthread.asc > > src/UPDATING 1.416.2.37.2.6 > src/sys/conf/newvers.sh 1.69.2.15.2.5 > src/lib/libpthread/sys/lock.c 1.9.2.1.8.1 > src/lib/libpthread/thread/thr_kern.c 1.116.2.1.6.1 > > These are for CVS tag RELENG_6_3. > > I do not use freebsd-update. That said: > > The man page for it states that it's a binary updater for pieces in the > base system, so you looking at your *source* files would indicate > absolutely nothing, other than when you last ran csup to update your > /usr/src tree. > > I do not know of a way to verify if your libpthread library actually > contains the fix. We will have to wait for Colin's answer. Errata's are distributed with freebsd-update just like advisories. Since freebsd-update 2 (the one in the base system) /usr/src is also updated if it exists. That said, note that freebsd-update does not get's patches from CVS so $FreeBSD$ unfortunatly isn't updated. I just checked, for 6.3 the patch 'EN-08:01.libpthread' is on the freebsd-update build server. -- Simon L. Nielsen Hat: FreeBSD Deputy Security Officer (IE, one of the people making freebsd-update builds) From owner-freebsd-hackers@FreeBSD.ORG Sat Sep 27 11:17:58 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D57C7106568A for ; Sat, 27 Sep 2008 11:17:58 +0000 (UTC) (envelope-from xorquewasp@googlemail.com) Received: from ey-out-2122.google.com (ey-out-2122.google.com [74.125.78.27]) by mx1.freebsd.org (Postfix) with ESMTP id 5D07E8FC20 for ; Sat, 27 Sep 2008 11:17:57 +0000 (UTC) (envelope-from xorquewasp@googlemail.com) Received: by ey-out-2122.google.com with SMTP id 6so352187eyi.7 for ; Sat, 27 Sep 2008 04:17:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=domainkey-signature:received:received:received:date:from:to:cc :subject:message-id:references:mime-version:content-type :content-disposition:in-reply-to; bh=3EcO9yuRq0UB6SidhKoz0/ZsnVFEYCwpBGD+sYQvVAk=; b=YJ+98E9QXIlQkWq/JfQOgUze5W088Cr4VOAEpAfoOfM3a16M+l2YDkQmfKOACyCiM7 GChKYFYwaFEgOsfNETeEYdSyFngzc1NkS6KXTbGed5mOW129xJ4C1U0L23Fako1qIj15 M4rzCWfaYS3JVyDarFbnsqjWrhnLsXnLxgU/U= DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to; b=aDciI+tpyoGqCS7HC/rpKpwjK3Qp1Jwh1LpYSS8VW0XETnwWP2q4EMSoCBsl4c75O7 nmUhvVg+tR/vA/y7LXU5gzOWR6sAVQ3OrU57F77RlBfVLY1kpV0XQUPcaZ7Z2CxyPFXq 9VeJ6le34NVG7tmYsG5fAXtQ1G0QhO05ixptQ= Received: by 10.210.63.5 with SMTP id l5mr453646eba.61.1222514276939; Sat, 27 Sep 2008 04:17:56 -0700 (PDT) Received: from logik.internal.network ( [81.86.41.187]) by mx.google.com with ESMTPS id 23sm5515534eya.7.2008.09.27.04.17.55 (version=TLSv1/SSLv3 cipher=OTHER); Sat, 27 Sep 2008 04:17:55 -0700 (PDT) Received: by logik.internal.network (Postfix, from userid 11001) id E96F460AA; Sat, 27 Sep 2008 11:17:53 +0000 (UTC) Date: Sat, 27 Sep 2008 12:17:53 +0100 From: xorquewasp@googlemail.com To: Jeremy Chadwick Message-ID: <20080927111753.GA32980@logik.internal.network> References: <20080926222711.GA74003@logik.internal.network> <48DD73A9.5000505@elischer.org> <20080926234727.GA60860@logik.internal.network> <20080927021709.GB60860@logik.internal.network> <20080927065227.GB4416@logik.internal.network> <48DDDBCD.40708@elischer.org> <20080927091733.GA98052@logik.internal.network> <20080927105928.GA49923@icarus.home.lan> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20080927105928.GA49923@icarus.home.lan> Cc: freebsd-hackers@freebsd.org Subject: Re: freebsd-update missed? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Sep 2008 11:17:58 -0000 On 20080927 03:59:28, Jeremy Chadwick wrote: > On Sat, Sep 27, 2008 at 10:17:33AM +0100, xorquewasp@googlemail.com wrote: > > The man page for it states that it's a binary updater for pieces in the > base system, so you looking at your *source* files would indicate > absolutely nothing, other than when you last ran csup to update your > /usr/src tree. > > I do not know of a way to verify if your libpthread library actually > contains the fix. We will have to wait for Colin's answer. For the record, I was using ident (1), which I thought was supposed to give me exactly that: $ ident /usr/lib/libpthread.so /usr/lib/libpthread.so: $FreeBSD: src/lib/libpthread/thread/thr_kern.c,v 1.116.2.1 2006/03/16 23:29:07 deischen Exp $ Perhaps patches don't change this value (seems wrong)? -- xw From owner-freebsd-hackers@FreeBSD.ORG Sat Sep 27 11:23:00 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 95C76106568E for ; Sat, 27 Sep 2008 11:23:00 +0000 (UTC) (envelope-from xorquewasp@googlemail.com) Received: from ik-out-1112.google.com (ik-out-1112.google.com [66.249.90.179]) by mx1.freebsd.org (Postfix) with ESMTP id 1E33A8FC29 for ; Sat, 27 Sep 2008 11:22:59 +0000 (UTC) (envelope-from xorquewasp@googlemail.com) Received: by ik-out-1112.google.com with SMTP id c29so832853ika.3 for ; Sat, 27 Sep 2008 04:22:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=domainkey-signature:received:received:received:date:from:to:cc :subject:message-id:references:mime-version:content-type :content-disposition:in-reply-to; bh=DoZZ0Pu1qTCq67QXkub1dmR+xxLdHG2uLJIpZ5hrsCE=; b=A74NFsQRApoO1DYDB/SkGmNg+OzMV8+yUWAuNdiAzMTBkMEdtHsyDQl0221SkMFd7l wiFwArJTRXj3r6yQUX0+628zf9D5TSA87Eu9hqNCcMSZ0jVetYj0F9iyliLX5C4AZg63 fvbcD44kfqPWE641npUwJ7qiLx8YOOUS84xl8= DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to; b=l3GNCAqiyzAN/zKYDfcP+rlan0IGLaTcVsb0Tn0X3sYKurOpU/Aw+xXLtwL0oiC1RB RL5e3YtRbJgG7byd//XxcgxqVknt0W9DBfmA+Mv21Gqs9mBYlRWsa9VpnBVXxAACBjuO Lnjxeu7b9wiDrgUWoKk9Uog6hHGwQybZofvmE= Received: by 10.210.82.7 with SMTP id f7mr2935690ebb.90.1222514578734; Sat, 27 Sep 2008 04:22:58 -0700 (PDT) Received: from logik.internal.network ( [81.86.41.187]) by mx.google.com with ESMTPS id 7sm5524274eyb.1.2008.09.27.04.22.56 (version=TLSv1/SSLv3 cipher=OTHER); Sat, 27 Sep 2008 04:22:57 -0700 (PDT) Received: by logik.internal.network (Postfix, from userid 11001) id 8AF1560AA; Sat, 27 Sep 2008 11:22:55 +0000 (UTC) Date: Sat, 27 Sep 2008 12:22:55 +0100 From: xorquewasp@googlemail.com To: "Simon L. Nielsen" Message-ID: <20080927112255.GB32980@logik.internal.network> References: <48DD73A9.5000505@elischer.org> <20080926234727.GA60860@logik.internal.network> <20080927021709.GB60860@logik.internal.network> <20080927065227.GB4416@logik.internal.network> <48DDDBCD.40708@elischer.org> <20080927091733.GA98052@logik.internal.network> <20080927105928.GA49923@icarus.home.lan> <20080927111514.GA1107@arthur.nitro.dk> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20080927111514.GA1107@arthur.nitro.dk> Cc: freebsd-hackers@freebsd.org Subject: Re: freebsd-update missed? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Sep 2008 11:23:00 -0000 On 20080927 13:15:15, Simon L. Nielsen wrote: > Errata's are distributed with freebsd-update just like advisories. > > Since freebsd-update 2 (the one in the base system) /usr/src is also > updated if it exists. That said, note that freebsd-update does not > get's patches from CVS so $FreeBSD$ unfortunatly isn't updated. > > I just checked, for 6.3 the patch 'EN-08:01.libpthread' is on the > freebsd-update build server. So for now, at least, I have to assume that I do have the patched library and the problem is either still occuring for some unknown reason or this is a new issue with the same or at least similar symptoms. I unfortunately don't have access to anything running > 6.3, so I'll need to set up another box with 7.0 to see if the same thing still occurs. From owner-freebsd-hackers@FreeBSD.ORG Sat Sep 27 11:32:57 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 65F15106568B; Sat, 27 Sep 2008 11:32:57 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from cs1.cs.huji.ac.il (cs1.cs.huji.ac.il [132.65.16.10]) by mx1.freebsd.org (Postfix) with ESMTP id 18DEE8FC1B; Sat, 27 Sep 2008 11:32:56 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from pampa.cs.huji.ac.il ([132.65.80.32]) by cs1.cs.huji.ac.il with esmtp id 1KjY2h-0008GC-PP; Sat, 27 Sep 2008 14:32:55 +0300 X-Mailer: exmh version 2.7.2 01/07/2005 with nmh-1.2 To: Robert Watson In-reply-to: References: <20080926081806.GA19055@icarus.home.lan> <20080926095230.GA20789@icarus.home.lan> Comments: In-reply-to Robert Watson message dated "Sat, 27 Sep 2008 11:15:59 +0100." Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Sat, 27 Sep 2008 14:32:55 +0300 From: Danny Braniss Message-ID: Cc: freebsd-hackers@freebsd.org, Jeremy Chadwick , freebsd-stable@freebsd.org Subject: Re: bad NFS/UDP performance X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Sep 2008 11:32:57 -0000 > On Fri, 26 Sep 2008, Danny Braniss wrote: > > > after more testing, it seems it's related to changes made between Aug 4 and > > Aug 29 ie, a kernel built on Aug 4 works fine, Aug 29 is slow. I'l now try > > and close the gap. > > I think this is the best way forward -- skimming August changes, there are a > number of candidate commits, including retuning of UDP hashes by mav, my > rwlock changes, changes to mbuf chain handling, etc. it more difficult than I expected. for one, the kernel date was missleading, the actual source update is the key, so the window of changes is now 28/July to 19/August. I have the diffs, but nothing yet seems relevant. on the other hand, I tried NFS/TCP, and there things seem ok, ie the 'good' and the 'bad' give the same throughput, which seem to point to UDP changes ... danny From owner-freebsd-hackers@FreeBSD.ORG Sat Sep 27 11:38:55 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx2.freebsd.org (mx2.freebsd.org [IPv6:2001:4f8:fff6::35]) by hub.freebsd.org (Postfix) with ESMTP id 7B86D1065690 for ; Sat, 27 Sep 2008 11:38:55 +0000 (UTC) (envelope-from cperciva@freebsd.org) Received: from xps.daemonology.net (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx2.freebsd.org (Postfix) with SMTP id 7545D1526A8 for ; Sat, 27 Sep 2008 11:38:54 +0000 (UTC) (envelope-from cperciva@freebsd.org) Received: (qmail 42709 invoked from network); 27 Sep 2008 11:38:53 -0000 Received: from unknown (HELO xps.daemonology.net) (127.0.0.1) by localhost with SMTP; 27 Sep 2008 11:38:53 -0000 Message-ID: <48DE1B4D.80608@freebsd.org> Date: Sat, 27 Sep 2008 04:38:53 -0700 From: Colin Percival User-Agent: Thunderbird 2.0.0.16 (X11/20080730) MIME-Version: 1.0 To: xorquewasp@googlemail.com References: <20080926222711.GA74003@logik.internal.network> <48DD73A9.5000505@elischer.org> <20080926234727.GA60860@logik.internal.network> <20080927021709.GB60860@logik.internal.network> <20080927065227.GB4416@logik.internal.network> In-Reply-To: <20080927065227.GB4416@logik.internal.network> X-Enigmail-Version: 0.95.6 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: Daniel Eischen , freebsd-hackers@freebsd.org Subject: Re: freebsd-update missed? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Sep 2008 11:38:55 -0000 xorquewasp@googlemail.com wrote: > I've CCd in cperciva@ to see what he thinks... I missed the beginning of this thread, but looking back in the archives... 1. I'm very confident that FreeBSD Update is distributing the updated libpthread.so. 2. If you run ident on the libpthread.so.2 which FreeBSD Update distributes, or look at the src/lib/libpthread/thread/thr_kern.c which FreeBSD Update distributes, you'll see the old 1.116.2.1 RCS number. This is because FreeBSD Update mimics "start with the released source code and then apply the patches which are signed by the FreeBSD Security Officer" without a detour through CVS -- that detour through CVS would be impossible, in fact, since we build the binary updates before doing CVS (oops, SVN) commits. 3. If you want to check that you have the latest libpthread.so for FreeBSD 6.3, `sha256 /lib/libpthread.so.2` on an i386 system should print SHA256 (/lib/libpthread.so.2) = ff3fc6111331d5b64f939117daef176cc5c511362786ed6325a2333848e80573 4. If your system claims to be running 6.3-RELEASE-p1 but says that there are no updates needed to update to 6.3-RELEASE-p4, it probably means that you installed the updated kernel which came with 6.3-RELEASE-p4 but you haven't rebooted yet. Colin Percival From owner-freebsd-hackers@FreeBSD.ORG Sat Sep 27 12:01:42 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EBFBC10656E4 for ; Sat, 27 Sep 2008 12:01:42 +0000 (UTC) (envelope-from xorquewasp@googlemail.com) Received: from ug-out-1314.google.com (ug-out-1314.google.com [66.249.92.175]) by mx1.freebsd.org (Postfix) with ESMTP id 73AD38FC16 for ; Sat, 27 Sep 2008 12:01:42 +0000 (UTC) (envelope-from xorquewasp@googlemail.com) Received: by ug-out-1314.google.com with SMTP id m2so73528uge.39 for ; Sat, 27 Sep 2008 05:01:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=domainkey-signature:received:received:received:date:from:to:cc :subject:message-id:references:mime-version:content-type :content-disposition:in-reply-to; bh=2nSWlmG4YPwAwaASmeOjKuvUIckXRWyq8hM/FgzuI0w=; b=irajI+tZgBVCbwDPSstaum8tkFXhtPRC1BWJV1xAjMXqMGD0F72HPvAnfokazvcSBI uyRZzU/NNvgKL2+zoEjqGSMJTTXZJIbgaGI+0j6RsiQulf/x9LJa+KjXA0cShLH/JYom 7uCjzpYdJwgbDmrV5rynFT08xC+XMsy0B3gBY= DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to; b=EkZkBEIsjdkmne1HarWvN1ucgwtivw+ZOdw7JPjMZiDiJ4rqGeB2dOGmzd+StAEGje u8BgZ0DzBGrXQ7ws8VbLnagHAk40oGbZ0VeadXLTVlHAPh+yShmoJAImWNtB+sOhpSDG utVZG5mRwoRQ+cb+CyXG5MWavdOgRXTM3jDcc= Received: by 10.210.124.15 with SMTP id w15mr2970001ebc.115.1222516901032; Sat, 27 Sep 2008 05:01:41 -0700 (PDT) Received: from logik.internal.network ( [81.86.41.187]) by mx.google.com with ESMTPS id 7sm5532998eyb.1.2008.09.27.05.01.39 (version=TLSv1/SSLv3 cipher=OTHER); Sat, 27 Sep 2008 05:01:40 -0700 (PDT) Received: by logik.internal.network (Postfix, from userid 11001) id A99CC60AA; Sat, 27 Sep 2008 12:01:37 +0000 (UTC) Date: Sat, 27 Sep 2008 13:01:37 +0100 From: xorquewasp@googlemail.com To: Colin Percival Message-ID: <20080927120137.GA1128@logik.internal.network> References: <20080926222711.GA74003@logik.internal.network> <48DD73A9.5000505@elischer.org> <20080926234727.GA60860@logik.internal.network> <20080927021709.GB60860@logik.internal.network> <20080927065227.GB4416@logik.internal.network> <48DE1B4D.80608@freebsd.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <48DE1B4D.80608@freebsd.org> Cc: freebsd-hackers@freebsd.org Subject: Re: freebsd-update missed? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Sep 2008 12:01:43 -0000 On 20080927 04:38:53, Colin Percival wrote: > I missed the beginning of this thread, but looking back in the archives... > > 1. I'm very confident that FreeBSD Update is distributing the updated > libpthread.so. Right. > 2. If you run ident on the libpthread.so.2 which FreeBSD Update distributes, > or look at the src/lib/libpthread/thread/thr_kern.c which FreeBSD Update > distributes, you'll see the old 1.116.2.1 RCS number. This is because > FreeBSD Update mimics "start with the released source code and then apply > the patches which are signed by the FreeBSD Security Officer" without a > detour through CVS -- that detour through CVS would be impossible, in fact, > since we build the binary updates before doing CVS (oops, SVN) commits. Ok! > 3. If you want to check that you have the latest libpthread.so for FreeBSD > 6.3, `sha256 /lib/libpthread.so.2` on an i386 system should print > SHA256 (/lib/libpthread.so.2) = > ff3fc6111331d5b64f939117daef176cc5c511362786ed6325a2333848e80573 Yes, seems I have the patched version. > 4. If your system claims to be running 6.3-RELEASE-p1 but says that there > are no updates needed to update to 6.3-RELEASE-p4, it probably means that > you installed the updated kernel which came with 6.3-RELEASE-p4 but you > haven't rebooted yet. That seems pretty likely. I tend to reboot on power outages when the UPS doesn't hold out... Thanks for this info. -- xw From owner-freebsd-hackers@FreeBSD.ORG Sat Sep 27 16:40:22 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 789431065694; Sat, 27 Sep 2008 16:40:22 +0000 (UTC) (envelope-from rik@inse.ru) Received: from mail.inse.ru (mail.inse.ru [144.206.128.1]) by mx1.freebsd.org (Postfix) with ESMTP id 3183F8FC1B; Sat, 27 Sep 2008 16:40:22 +0000 (UTC) (envelope-from rik@inse.ru) Received: from www.inse.ru (www.inse.ru [144.206.128.1]) by mail.inse.ru (Postfix) with ESMTPSA id 60CCF33C54; Sat, 27 Sep 2008 20:23:52 +0400 (MSD) Message-ID: <48DE5CC0.9000708@localhost.inse.ru> Date: Sat, 27 Sep 2008 20:18:08 +0400 From: Roman Kurakin User-Agent: Thunderbird 2.0.0.16 (X11/20080723) MIME-Version: 1.0 To: Eygene Ryabinkin References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-hackers@freebsd.org, bug-followup@freebsd.org Subject: Re: ports/126853: ports-mgmt/portaudit: speed up audit of installed packages X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Sep 2008 16:40:22 -0000 Have you also posted this to ports@? rik Eygene Ryabinkin wrote: > Good day. > > A while ago I had created the new utility that serves as VuXML > filter for the installed packages: > http://www.freebsd.org/cgi/query-pr.cgi?pr=ports/126853 > > My primary intention was to speed up the process of auditing the > vulnerable ports: I needed to run portaudit checks with Nagios and to > avoid large timeouts. > > The new utility is called pkg_audit and it serves as a simple text > filter: on input it takes the full VuXML feed and on output it puts > VuXML entries that matches ports that are installed in the system with > port version specification substituted with the actual port versions. > > No harm is done to the actual poartudit -- if pkg_audit is missing, old > code path is activated. > > If someone is interested and will be able to test -- I am all ears. > > Thanks! > From owner-freebsd-hackers@FreeBSD.ORG Sat Sep 27 18:52:29 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 646B61065688; Sat, 27 Sep 2008 18:52:29 +0000 (UTC) (envelope-from dart@es.net) Received: from postal1.es.net (postal1.es.net [198.128.3.205]) by mx1.freebsd.org (Postfix) with ESMTP id 392ED8FC14; Sat, 27 Sep 2008 18:52:29 +0000 (UTC) (envelope-from dart@es.net) Received: from [192.168.13.32] (c-24-4-182-157.hsd1.ca.comcast.net [24.4.182.157]) by postal1.es.net (Postal Node 1) with ASMTP (SSL) id HBR44523; Sat, 27 Sep 2008 11:42:23 -0700 Message-ID: <48DE7E76.8050209@es.net> Date: Sat, 27 Sep 2008 11:41:58 -0700 From: Eli Dart User-Agent: Thunderbird 2.0.0.17 (Windows/20080914) MIME-Version: 1.0 To: Danny Braniss References: <20080926081806.GA19055@icarus.home.lan> <20080926095230.GA20789@icarus.home.lan> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Sender-IP: 24.4.182.157 X-Sender-Domain: es.net X-Recipent: ; ; ; ; X-Sender: X-To_Name: Danny Braniss X-To_Domain: cs.huji.ac.il X-To: Danny Braniss X-To_Email: danny@cs.huji.ac.il X-To_Alias: danny X-Mailman-Approved-At: Sat, 27 Sep 2008 19:03:47 +0000 Cc: freebsd-hackers@freebsd.org, Jeremy Chadwick , freebsd-stable@freebsd.org Subject: Re: bad NFS/UDP performance X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Sep 2008 18:52:29 -0000 Danny Braniss wrote: > I know, but I get about 1mgb, which seems somewhat low :-( If you don't tell iperf how much bandwidth to use for a UDP test, it defaults to 1Mbps. See -b option. http://dast.nlanr.net/projects/Iperf/iperfdocs_1.7.0.php#bandwidth --eli -- Eli Dart ESnet Network Engineering Group Lawrence Berkeley National Laboratory PGP Key fingerprint = C970 F8D3 CFDD 8FFF 5486 343A 2D31 4478 5F82 B2B3 From owner-freebsd-hackers@FreeBSD.ORG Sat Sep 27 23:52:38 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9E9521065691 for ; Sat, 27 Sep 2008 23:52:38 +0000 (UTC) (envelope-from aryeh.friedman@gmail.com) Received: from mta4.srv.hcvlny.cv.net (mta4.srv.hcvlny.cv.net [167.206.4.199]) by mx1.freebsd.org (Postfix) with ESMTP id 769EC8FC0C for ; Sat, 27 Sep 2008 23:52:38 +0000 (UTC) (envelope-from aryeh.friedman@gmail.com) Received: from flosoft.no-ip.biz (ool-435559b8.dyn.optonline.net [67.85.89.184]) by mta4.srv.hcvlny.cv.net (Sun Java System Messaging Server 6.2-8.04 (built Feb 28 2007)) with ESMTP id <0K7V00E0KNLBC9M0@mta4.srv.hcvlny.cv.net> for freebsd-hackers@freebsd.org; Sat, 27 Sep 2008 19:22:24 -0400 (EDT) Received: from flosoft.no-ip.biz (localhost [127.0.0.1]) by flosoft.no-ip.biz (8.14.3/8.14.3) with ESMTP id m8RNMKXL022202; Sat, 27 Sep 2008 19:22:20 -0400 Date: Sat, 27 Sep 2008 19:22:20 -0400 From: "Aryeh M. Friedman" To: freebsd-hackers@freebsd.org Message-id: <48DEC02C.90302@gmail.com> MIME-version: 1.0 Content-type: text/plain; charset=ISO-8859-1; format=flowed Content-transfer-encoding: 7BIT X-Enigmail-Version: 0.95.6 User-Agent: Thunderbird 2.0.0.16 (X11/20080918) Subject: Increasing partition size by removing partitions X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 27 Sep 2008 23:52:38 -0000 I have a disk that is laid out with partion 0 being NTFS and 1 being FreeBSD. I want to remove the NTFS partition and grow the FreeBSD one but all the docs I have seen only talk about how to do this if the new part of the partition is at the end of the partition you wish to grow. How do I go about this?