Date: Thu, 19 Jan 2006 16:03:18 +0100 From: =?ISO-8859-1?Q?Johan_Str=F6m?= <johan@stromnet.org> To: freebsd-stable@freebsd.org Subject: Re: Page fault, GEOM problem?? Message-ID: <268C3DEB-7569-4C18-BC35-1C5F36EF8EC4@stromnet.org> In-Reply-To: <8A4DAD5D-44CF-42DD-A113-340226284533@stromnet.org> References: <991F35AA-151B-4AEA-82BD-5F4AEDF28424@stromnet.org> <a78074950511180117r6d64db25o4ae37c0c5998e002@mail.gmail.com> <74994962-5050-47BD-897B-DE3880B9EBD5@stromnet.org> <a78074950511180943r57fd9d03r64efcc705001bc35@mail.gmail.com> <A6F22EE2-B1E6-44B5-B4C2-E77E1A24FEBB@stromnet.org> <1132353600.903.19.camel@genius1.i.cz> <20051118231351.GA46946@holestein.holy.cow> <1132356649.903.32.camel@genius1.i.cz> <8A4DAD5D-44CF-42DD-A113-340226284533@stromnet.org>
next in thread | previous in thread | raw e-mail | index | archive | help
--Apple-Mail-4-462008945 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=ISO-8859-1; delsp=yes; format=flowed On 29 nov 2005, at 21.10, Johan Str=F6m wrote: > On 19 nov 2005, at 00.30, Michal Mertl wrote: >> Parv wrote: >>> in message <1132353600.903.19.camel@genius1.i.cz>, wrote Michal >>> Mertl thusly... >>>> >>>> Johan Str=F6m wrote: >>>>> >>>>> On 18 nov 2005, at 18.43, Xin LI wrote: >>> ... >>>>> So, it seems it does run savecore after running dumpon and >>>>> mounting disks etc... Is that wrong? >>>> >>>> No, this is normal. When you run savecore you need to have mounted >>>> filesystems. In order to mount the filesystems they may have to be >>>> checked. The fsck program requires big amount of memory to check >>>> larger filesystems so the swap has to be enabled. Core dumps are >>>> written to the dump device (swap) from the end whereas the swap is >>>> normally used from the beginning (or the other way around). >>>> Therefore there's quite a big chance that, even when the swap has >>>> to be used for fsck, the core dump is intact and usable. >>> >>> Is there any formula to calculate the size of swap to account for >>> fsck & core dump while assigning swap size (short of having two swap >>> partitions)? >> >> None that I know of. Someone posted to some FreeBSD mailing list some >> figures about the fsck consumption of memory. I really don't =20 >> remember, >> but I think it was something like some MBs of memory per quite a =20 >> lot of >> GB of file system space. E.g. that the fsck on "normally" sized file >> systems (e.g. at most a couple of hundred GB) doesn't normally cosume >> all of "normally" sized memory (>=3D256MB) and thus doesn't need to =20= >> swap. >> >>>> If the usage of the swap file by fsck corrupts the core dump you >>>> may start after next crash in single user mode and run the >>>> commands manually (without enabling swap). >>> >>> Is that after kernel (re)boots? And would the commands to be >>> executed be savecore followed by swapon? >> >> If the dump got corrupted by fsck, you would have to wait for another >> crash and dump. Then you would reboot and start in single user mode, >> repair the file systems without swap enabled (fsck would crash on the >> large file system(s)) and then run savecore. Swapon is then =20 >> irrelevant, >> you probably don't need swap for savecore. After running savecore you >> can start normally multi user (exit from the single user shell). >> >> I didn't try all of that but I believe it should work. >> >> Michal >> > > I just got another coredump, hadn't had one since the first one. =20 > =46rom messages: > > Nov 29 20:36:54 elfi kernel: subdisk10: detached > Nov 29 20:36:54 elfi kernel: ad10: detached > Nov 29 20:36:54 elfi kernel: unknown: TIMEOUT - READ_DMA48 retrying =20= > (1 retry left) LBA=3D426562704 > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Device gm0s1: provider =20 > ad10s1 disconnected. > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D134356992, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D134373376, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D134389760, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D134438912, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D268591104, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D268607488, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D268623872, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D5966307328, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D5967650816, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D5968355328, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D5968584704, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D5969715200, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D5971795968, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D5972697088, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D16063848960, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D16063865344, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D16063881728, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D16063914496, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D16064324096, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D16064340480, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D16064373248, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D16064471552, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D18761523712, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D18762850816, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D18762867200, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D18762883584, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D18762899968, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D18762949120, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D18762965504, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D18846032384, length=3D131072)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D18846228992, length=3D131072)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D18846441984, length=3D131072)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D18846638592, length=3D131072)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D20110369280, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D20111680000, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D20111696384, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D21073961472, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D21073977856, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D21844845056, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D23003161088, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D27434574336, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D32635757056, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D33406444032, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D34369610240, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[READ(offset=3D34555535872, length=3D131072)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D36874609152, length=3D16384)] > Nov 29 20:36:54 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= > ad10s1[WRITE(offset=3D37645722112, length=3D16384)] > Nov 29 20:46:09 elfi syslogd: kernel boot file is /boot/kernel/kernel > Nov 29 20:46:09 elfi kernel: > Nov 29 20:46:09 elfi kernel: > Nov 29 20:46:09 elfi kernel: Fatal trap 12: page fault while in =20 > kernel mode > Nov 29 20:46:09 elfi kernel: fault virtual address =3D 0x49 > Nov 29 20:46:09 elfi kernel: fault code =3D supervisor read, =20= > page not present > Nov 29 20:46:09 elfi kernel: instruction pointer =3D =20 > 0x20:0xc064cbfa > Nov 29 20:46:09 elfi kernel: stack pointer =3D =20 > 0x28:0xd44a8c9c > Nov 29 20:46:09 elfi kernel: frame pointer =3D =20 > 0x28:0xd44a8c9c > Nov 29 20:46:09 elfi kernel: code segment =3D base 0x0, =20= > limit 0xfffff, type 0x1b > Nov 29 20:46:09 elfi kernel: =3D DPL 0, pres 1, def32 1, gran 1 > Nov 29 20:46:09 elfi kernel: processor eflags =3D interrupt =20 > enabled, resume, IOPL =3D 0 > Nov 29 20:46:09 elfi kernel: current process =3D 35 (swi4: =20= > clock sio) > Nov 29 20:46:09 elfi kernel: trap number =3D 12 > Nov 29 20:46:09 elfi kernel: panic: page fault > Nov 29 20:46:09 elfi kernel: Uptime: 10d9h28m1s > Nov 29 20:46:09 elfi kernel: Copyright (c) 1992-2005 The FreeBSD =20 > Project. > Nov 29 20:46:09 elfi kernel: Copyright (c) 1979, 1980, 1983, 1986, =20 > 1988, 1989, 1991, 1992, 1993, 1994 > Nov 29 20:46:09 elfi kernel: The Regents of the University of =20 > California. All rights reserved. > Nov 29 20:46:09 elfi kernel: FreeBSD 6.0-RELEASE #1: Sat Nov 19 =20 > 03:22:49 CET 2005 > Nov 29 20:46:09 elfi kernel: johan@elfi.stromnet.org:/usr/obj/usr/=20 > src/sys/GENERIC > Nov 29 20:46:09 elfi kernel: ACPI APIC Table: <ASUS A7V333 > > Nov 29 20:46:09 elfi kernel: Timecounter "i8254" frequency 1193182 =20 > Hz quality 0 > Nov 29 20:46:09 elfi kernel: CPU: AMD Athlon(TM) XP 1900+ (1601.96-=20 > MHz 686-class CPU) > Nov 29 20:46:09 elfi kernel: Origin =3D "AuthenticAMD" Id =3D 0x662 =20= > Stepping =3D 2 > Nov 29 20:46:09 elfi kernel: =20 > Features=3D0x383fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PG= =20 > E,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE> > Nov 29 20:46:09 elfi kernel: AMD Features=3D0xc0480800<SYSCALL,MP,MMX=20= > +,3DNow+,3DNow> > Nov 29 20:46:09 elfi kernel: real memory =3D 536854528 (511 MB) > Nov 29 20:46:09 elfi kernel: avail memory =3D 516001792 (492 MB) > Nov 29 20:46:09 elfi kernel: ioapic0: Changing APIC ID to 2 > Nov 29 20:46:09 elfi kernel: ioapic0 <Version 0.2> irqs 0-23 on =20 > motherboard > Nov 29 20:46:09 elfi kernel: npx0: [FAST] > Nov 29 20:46:09 elfi kernel: npx0: <math processor> on motherboard > Nov 29 20:46:09 elfi kernel: npx0: INT 16 interface > Nov 29 20:46:09 elfi kernel: acpi0: <ASUS A7V333> on motherboard > Nov 29 20:46:09 elfi kernel: acpi0: Power Button (fixed) > Nov 29 20:46:09 elfi kernel: pci_link0: <ACPI PCI Link LNKA> irq 11 =20= > on acpi0 > Nov 29 20:46:09 elfi kernel: pci_link1: <ACPI PCI Link LNKB> irq 10 =20= > on acpi0 > Nov 29 20:46:09 elfi kernel: pci_link2: <ACPI PCI Link LNKC> irq 0 =20 > on acpi0 > Nov 29 20:46:09 elfi kernel: pci_link3: <ACPI PCI Link LNKD> irq 12 =20= > on acpi0 > Nov 29 20:46:09 elfi kernel: pci_link4: <ACPI PCI Link LNKE> irq 5 =20 > on acpi0 > Nov 29 20:46:09 elfi kernel: Timecounter "ACPI-fast" frequency =20 > 3579545 Hz quality 1000 > Nov 29 20:46:09 elfi kernel: acpi_timer0: <32-bit timer at =20 > 3.579545MHz> port 0xe408-0xe40b on acpi0 > Nov 29 20:46:09 elfi kernel: cpu0: <ACPI CPU> on acpi0 > Nov 29 20:46:09 elfi kernel: acpi_button0: <Power Button> on acpi0 > Nov 29 20:46:09 elfi kernel: pcib0: <ACPI Host-PCI bridge> port =20 > 0xcf8-0xcff on acpi0 > Nov 29 20:46:09 elfi kernel: pci0: <ACPI PCI bus> on pcib0 > Nov 29 20:46:09 elfi kernel: agp0: <VIA 8367 (KT266/KY266x/KT333) =20 > host to PCI bridge> mem 0xfe000000-0xfe7fffff at device 0.0 on pci0 > Nov 29 20:46:09 elfi kernel: pcib1: <ACPI PCI-PCI bridge> at device =20= > 1.0 on pci0 > Nov 29 20:46:09 elfi kernel: pci1: <ACPI PCI bus> on pcib1 > Nov 29 20:46:09 elfi kernel: pci0: <multimedia, audio> at device =20 > 5.0 (no driver attached) > Nov 29 20:46:09 elfi kernel: fwohci0: <Texas Instruments TSB43AB21/=20 > A/AI/A-EP> mem 0xfd000000-0xfd0007ff,0xfc800000-0xfc803fff irq 17 =20 > at device 7.0 on pci0 > Nov 29 20:46:09 elfi kernel: fwohci0: OHCI version 1.10 (ROM=3D1) > Nov 29 20:46:09 elfi kernel: fwohci0: No. of Isochronous channels =20 > is 4. > Nov 29 20:46:09 elfi kernel: fwohci0: EUI64 00:e0:18:00:00:02:7e:fe > Nov 29 20:46:09 elfi kernel: fwohci0: Phy 1394a available S400, 1 =20 > ports. > Nov 29 20:46:09 elfi kernel: fwohci0: Link S400, max_rec 2048 bytes. > Nov 29 20:46:09 elfi kernel: firewire0: <IEEE1394(FireWire) bus> on =20= > fwohci0 > Nov 29 20:46:09 elfi kernel: fwe0: <Ethernet over FireWire> on =20 > firewire0 > Nov 29 20:46:09 elfi kernel: if_fwe0: Fake Ethernet address: =20 > 02:e0:18:02:7e:fe > Nov 29 20:46:09 elfi kernel: fwe0: Ethernet address: 02:e0:18:02:7e:fe > Nov 29 20:46:09 elfi kernel: fwe0: if_start running deferred for Giant > Nov 29 20:46:09 elfi kernel: sbp0: <SBP-2/SCSI over FireWire> on =20 > firewire0 > Nov 29 20:46:09 elfi kernel: fwohci0: Initiate bus reset > Nov 29 20:46:09 elfi kernel: fwohci0: node_id=3D0xc800ffc0, gen=3D1, =20= > CYCLEMASTER mode > Nov 29 20:46:09 elfi kernel: firewire0: 1 nodes, maxhop <=3D 0, cable =20= > IRM =3D 0 (me) > Nov 29 20:46:09 elfi kernel: firewire0: bus manager 0 (me) > Nov 29 20:46:09 elfi kernel: uhci0: <VIA 83C572 USB controller> =20 > port 0xd400-0xd41f irq 19 at device 9.0 on pci0 > Nov 29 20:46:09 elfi kernel: uhci0: [GIANT-LOCKED] > Nov 29 20:46:09 elfi kernel: usb0: <VIA 83C572 USB controller> on =20 > uhci0 > Nov 29 20:46:09 elfi kernel: usb0: USB revision 1.0 > Nov 29 20:46:09 elfi kernel: uhub0: VIA UHCI root hub, class 9/0, =20 > rev 1.00/1.00, addr 1 > Nov 29 20:46:09 elfi kernel: uhub0: 2 ports with 2 removable, self =20 > powered > Nov 29 20:46:09 elfi kernel: uhci1: <VIA 83C572 USB controller> =20 > port 0xd000-0xd01f irq 16 at device 9.1 on pci0 > Nov 29 20:46:09 elfi kernel: uhci1: [GIANT-LOCKED] > Nov 29 20:46:09 elfi kernel: usb1: <VIA 83C572 USB controller> on =20 > uhci1 > Nov 29 20:46:09 elfi kernel: usb1: USB revision 1.0 > Nov 29 20:46:09 elfi kernel: uhub1: VIA UHCI root hub, class 9/0, =20 > rev 1.00/1.00, addr 1 > Nov 29 20:46:09 elfi kernel: uhub1: 2 ports with 2 removable, self =20 > powered > Nov 29 20:46:09 elfi kernel: ehci0: <VIA VT6202 USB 2.0 controller> =20= > mem 0xfc000000-0xfc0000ff irq 17 at device 9.2 on pci0 > Nov 29 20:46:09 elfi kernel: ehci0: [GIANT-LOCKED] > Nov 29 20:46:09 elfi kernel: usb2: EHCI version 0.95 > Nov 29 20:46:09 elfi kernel: usb2: companion controllers, 2 ports =20 > each: usb0 usb1 > Nov 29 20:46:09 elfi kernel: usb2: <VIA VT6202 USB 2.0 controller> =20 > on ehci0 > Nov 29 20:46:09 elfi kernel: usb2: USB revision 2.0 > Nov 29 20:46:09 elfi kernel: uhub2: VIA EHCI root hub, class 9/0, =20 > rev 2.00/1.00, addr 1 > Nov 29 20:46:09 elfi kernel: uhub2: 4 ports with 4 removable, self =20 > powered > Nov 29 20:46:09 elfi kernel: atapci0: <Promise PDC40518 SATA150 =20 > controller> port 0xb800-0xb87f,0xb400-0xb4ff mem =20 > 0xfb800000-0xfb800fff,0xfb000000-0xfb01ffff irq > 19 at device 12.0 on pci0 > Nov 29 20:46:09 elfi kernel: ata2: <ATA channel 0> on atapci0 > Nov 29 20:46:09 elfi kernel: ata3: <ATA channel 1> on atapci0 > Nov 29 20:46:09 elfi kernel: ata4: <ATA channel 2> on atapci0 > Nov 29 20:46:09 elfi kernel: ata5: <ATA channel 3> on atapci0 > Nov 29 20:46:09 elfi kernel: xl0: <3Com 3c905C-TX Fast Etherlink =20 > XL> port 0xb000-0xb07f mem 0xfa800000-0xfa80007f irq 17 at device =20 > 14.0 on pci0 > Nov 29 20:46:09 elfi kernel: miibus0: <MII bus> on xl0 > Nov 29 20:46:09 elfi kernel: xlphy0: <3c905C 10/100 internal PHY> =20 > on miibus0 > Nov 29 20:46:09 elfi kernel: xlphy0: 10baseT, 10baseT-FDX, =20 > 100baseTX, 100baseTX-FDX, auto > Nov 29 20:46:09 elfi kernel: xl0: Ethernet address: 00:04:76:ef:c6:36 > Nov 29 20:46:09 elfi kernel: pci0: <display, VGA> at device 15.0 =20 > (no driver attached) > Nov 29 20:46:09 elfi kernel: isab0: <PCI-ISA bridge> at device 17.0 =20= > on pci0 > Nov 29 20:46:09 elfi kernel: isa0: <ISA bus> on isab0 > Nov 29 20:46:09 elfi kernel: atapci1: <VIA 8233A UDMA133 =20 > controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xa400-0xa40f =20 > at device 17.1 on pci0 > Nov 29 20:46:09 elfi kernel: ata0: <ATA channel 0> on atapci1 > Nov 29 20:46:09 elfi kernel: ata1: <ATA channel 1> on atapci1 > Nov 29 20:46:09 elfi kernel: uhci2: <VIA 83C572 USB controller> =20 > port 0xa000-0xa01f at device 17.2 on pci0 > Nov 29 20:46:09 elfi kernel: uhci2: [GIANT-LOCKED] > Nov 29 20:46:09 elfi kernel: usb3: <VIA 83C572 USB controller> on =20 > uhci2 > Nov 29 20:46:09 elfi kernel: usb3: USB revision 1.0 > Nov 29 20:46:09 elfi kernel: uhub3: VIA UHCI root hub, class 9/0, =20 > rev 1.00/1.00, addr 1 > Nov 29 20:46:09 elfi kernel: uhub3: 2 ports with 2 removable, self =20 > powered > Nov 29 20:46:09 elfi kernel: uhci3: <VIA 83C572 USB controller> =20 > port 0x9800-0x981f irq 21 at device 17.3 on pci0 > Nov 29 20:46:09 elfi kernel: uhci3: [GIANT-LOCKED] > Nov 29 20:46:09 elfi kernel: usb4: <VIA 83C572 USB controller> on =20 > uhci3 > Nov 29 20:46:09 elfi kernel: usb4: USB revision 1.0 > Nov 29 20:46:09 elfi kernel: uhub4: VIA UHCI root hub, class 9/0, =20 > rev 1.00/1.00, addr 1 > Nov 29 20:46:09 elfi kernel: uhub4: 2 ports with 2 removable, self =20 > powered > Nov 29 20:46:09 elfi kernel: ppc0: <ECP parallel printer port> port =20= > 0x378-0x37f,0x778-0x77b irq 7 drq 3 on acpi0 > Nov 29 20:46:09 elfi kernel: ppc0: SMC-like chipset (ECP/EPP/PS2/=20 > NIBBLE) in COMPATIBLE mode > Nov 29 20:46:09 elfi kernel: ppc0: FIFO with 16/16/9 bytes threshold > Nov 29 20:46:09 elfi kernel: ppbus0: <Parallel port bus> on ppc0 > Nov 29 20:46:09 elfi kernel: plip0: <PLIP network interface> on ppbus0 > Nov 29 20:46:09 elfi kernel: lpt0: <Printer> on ppbus0 > Nov 29 20:46:09 elfi kernel: lpt0: Interrupt-driven port > Nov 29 20:46:09 elfi kernel: ppi0: <Parallel I/O> on ppbus0 > Nov 29 20:46:09 elfi kernel: sio0: <16550A-compatible COM port> =20 > port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 > Nov 29 20:46:09 elfi kernel: sio0: type 16550A > Nov 29 20:46:09 elfi kernel: sio1: <16550A-compatible COM port> =20 > port 0x2f8-0x2ff irq 3 on acpi0 > Nov 29 20:46:09 elfi kernel: sio1: type 16550A > Nov 29 20:46:09 elfi kernel: atkbdc0: <Keyboard controller (i8042)> =20= > port 0x60,0x64 irq 1 on acpi0 > Nov 29 20:46:09 elfi kernel: atkbd0: <AT Keyboard> irq 1 on atkbdc0 > Nov 29 20:46:09 elfi kernel: kbd0 at atkbd0 > Nov 29 20:46:09 elfi kernel: atkbd0: [GIANT-LOCKED] > Nov 29 20:46:09 elfi kernel: pmtimer0 on isa0 > Nov 29 20:46:09 elfi kernel: orm0: <ISA Option ROMs> at iomem =20 > 0xc0000-0xc7fff,0xc8000-0xccfff,0xd0000-0xd07ff on isa0 > Nov 29 20:46:09 elfi kernel: sc0: <System console> at flags 0x100 =20 > on isa0 > Nov 29 20:46:09 elfi kernel: sc0: VGA <16 virtual consoles, =20 > flags=3D0x300> > Nov 29 20:46:09 elfi kernel: vga0: <Generic ISA VGA> at port =20 > 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 > Nov 29 20:46:09 elfi kernel: Timecounter "TSC" frequency 1601962271 =20= > Hz quality 800 > Nov 29 20:46:09 elfi kernel: Timecounters tick every 1.000 msec > Nov 29 20:46:09 elfi kernel: ad0: 2441MB <WDC AC22500L 32.41N35> at =20= > ata0-master UDMA33 > Nov 29 20:46:09 elfi kernel: acd0: CDROM <CD-ROM CDU701-F/1.0q> at =20 > ata1-master PIO4 > Nov 29 20:46:09 elfi kernel: ad6: 286188MB <Maxtor 7L300S0 =20 > BANC1G10> at ata3-master SATA150 > Nov 29 20:46:09 elfi kernel: ad10: 286188MB <Maxtor 7L300S0 =20 > BANC1G10> at ata5-master SATA150 > Nov 29 20:46:09 elfi kernel: GEOM_MIRROR: Device gm0s1 created =20 > (id=3D4118114647). > Nov 29 20:46:09 elfi kernel: GEOM_MIRROR: Device gm0s1: provider =20 > ad6s1 detected. > Nov 29 20:46:09 elfi kernel: GEOM_MIRROR: Device gm0s1: provider =20 > ad10s1 detected. > Nov 29 20:46:09 elfi kernel: Root mount waiting for: GMIRROR > Nov 29 20:46:09 elfi kernel: GEOM_MIRROR: Device gm0s1: provider =20 > ad6s1 activated. > Nov 29 20:46:09 elfi kernel: GEOM_MIRROR: Device gm0s1: provider =20 > mirror/gm0s1 launched. > Nov 29 20:46:09 elfi kernel: GEOM_MIRROR: Device gm0s1: rebuilding =20 > provider ad10s1. > Nov 29 20:46:09 elfi kernel: Trying to mount root from ufs:/dev/=20 > mirror/gm0s1a > Nov 29 20:46:09 elfi kernel: WARNING: / was not properly dismounted > Nov 29 20:46:09 elfi kernel: WARNING: /tmp was not properly dismounted > Nov 29 20:46:09 elfi kernel: WARNING: /usr was not properly dismounted > Nov 29 20:46:09 elfi kernel: /usr: mount pending error: blocks =20 > 23884 files 1 > Nov 29 20:46:09 elfi kernel: WARNING: /var was not properly dismounted > Nov 29 20:46:09 elfi kernel: /var: mount pending error: blocks 56 =20 > files 5 > Nov 29 20:46:09 elfi savecore: no dumps found > > > No core saved?... I'm fairly sure there was a dump device set.. =20 > Should be.. =46rom dmesg -a: > > ... > ad0: 2441MB <WDC AC22500L 32.41N35> at ata0-master UDMA33 > acd0: CDROM <CD-ROM CDU701-F/1.0q> at ata1-master PIO4 > ad6: 286188MB <Maxtor 7L300S0 BANC1G10> at ata3-master SATA150 > ad10: 286188MB <Maxtor 7L300S0 BANC1G10> at ata5-master SATA150 > GEOM_MIRROR: Device gm0s1 created (id=3D4118114647). > GEOM_MIRROR: Device gm0s1: provider ad6s1 detected. > GEOM_MIRROR: Device gm0s1: provider ad10s1 detected. > Root mount waiting for: GMIRROR > GEOM_MIRROR: Device gm0s1: provider ad6s1 activated. > GEOM_MIRROR: Device gm0s1: provider mirror/gm0s1 launched. > GEOM_MIRROR: Device gm0s1: rebuilding provider ad10s1. > Trying to mount root from ufs:/dev/mirror/gm0s1a > WARNING: / was not properly dismounted > Loading configuration files. > kernel dumps on /dev/ad0s1b > Entropy harvesting: > interrupts > ethernet > point_to_point > kickstart > . > > Havent touched the dumpon stuff since last boot, so the dump device =20= > should be active... > > I tried to force savecore: > > root@elfi:/var/log$ savecore -f /var/crash/ /dev/ad0s1b > savecore: unable to force dump - bad magic > savecore: no dumps found > > Some info about from sysclt (dont know if there is anything =20 > relevant)): > > root@elfi:/var/log$ sysctl -a|grep dump > kern.sugid_coredump: 0 > kern.coredump: 1 > kern.nodump_coredump: 0 > <6>pid 78189 (lookupd), uid 0: exited on signal 11 (core dumped) > <6>pid 3790 (yafc), uid 10001: exited on signal 11 (core dumped) > <6>pid 67414 (lookupd), uid 0: exited on signal 11 (core dumped) > <118>kernel dumps on /dev/ad0s1b > <118>Checking for core dump on /dev/ad0s1b... > <118>savecore: no dumps found > <118>Nov 29 21:01:04 elfi savecore: unable to force dump - bad magic > debug.elf32_legacy_coredump: 0 > hw.an.an_dump: off > > Can somebody give me a clue about what to do? > > Btw, the disk speed problem still persists, can't get over ~20Mb/s, =20= > even on a raw disk (remove a disk from gmirror and mount /dev/=20 > ad6s1f for example). > Can there be problems with the mobo/controllercard? Or is it more =20 > likely to be driver realted? Promise lists my motherboard (asus =20 > a7v333) in their manual for the controllercard (promise sataII 150 =20 > TX4). > > Thanks > > Johan Str=F6m > johan@stromnet.org > http://www.stromnet.org/ > Hi again! 40 days of uptime now, not a single crash! Until now... No special =20 load on the server afaik. And still no f..king dump :( Jan 19 15:45:01 elfi kernel: subdisk10: detached Jan 19 15:45:01 elfi kernel: ad10: detached Jan 19 15:45:01 elfi kernel: unknown: TIMEOUT - READ_DMA retrying (1 =20 retry left) LBA=3D70629840 Jan 19 15:45:01 elfi kernel: GEOM_MIRROR: Device gm0s1: provider =20 ad10s1 disconnected. Jan 19 15:45:01 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D134373376, length=3D16384)] Jan 19 15:45:01 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D134438912, length=3D16384)] Jan 19 15:45:01 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D268591104, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D268607488, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D268640256, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D4611383296, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D5960228864, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D5960245248, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D5960261632, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D6731014144, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18761523712, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18762850816, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18762867200, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18762883584, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18762899968, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18826781184, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18831778304, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18833400320, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18835710464, length=3D14336)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18838004224, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18838708736, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18841281024, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18842100224, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18844017152, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18844967424, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18845000192, length=3D65536)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18845276672, length=3D2048)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18850521600, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18853929472, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18854191616, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18855272960, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18857533952, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18859909632, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18859942400, length=3D131072)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18860139008, length=3D131072)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18862711296, length=3D131072)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18862907904, length=3D131072)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18863038976, length=3D131072)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18868183552, length=3D131072)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18868380160, length=3D131072)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18884796928, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18885009920, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18885501440, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D18886156800, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D20110369280, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D20111680000, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D20111696384, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D23001391616, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D27048190464, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[READ(offset=3D27055841792, length=3D6144)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D27433607680, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D33213637120, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D33213899264, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D33599136256, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D33599152640, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D33599185408, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D33599250944, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D33599955456, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D35525845504, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[READ(offset=3D36162462208, length=3D131072)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D37646000640, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[WRITE(offset=3D44004221440, length=3D16384)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[READ(offset=3D95513928192, length=3D131072)] Jan 19 15:45:02 elfi kernel: GEOM_MIRROR: Request failed (error=3D6). =20= ad10s1[READ(offset=3D136122081792, length=3D16384)] Jan 19 15:53:42 elfi syslogd: kernel boot file is /boot/kernel/kernel Jan 19 15:53:42 elfi kernel: Jan 19 15:53:42 elfi kernel: Fatal trap 12: page fault while in =20 kernel mode Jan 19 15:53:42 elfi kernel: fault virtual address =3D 0x53 Jan 19 15:53:42 elfi kernel: fault code =3D supervisor read, =20 page not present Jan 19 15:53:42 elfi kernel: instruction pointer =3D =20 0x20:0xc064cbfa Jan 19 15:53:42 elfi kernel: stack pointer =3D =20 0x28:0xd44a8c9c Jan 19 15:53:42 elfi kernel: frame pointer =3D =20 0x28:0xd44a8c9c Jan 19 15:53:42 elfi kernel: code segment =3D base 0x0, =20= limit 0xfffff, type 0x1b Jan 19 15:53:42 elfi kernel: =3D DPL 0, pres 1, def32 1, gran 1 Jan 19 15:53:42 elfi kernel: processor eflags =3D interrupt enabled, =20= resume, IOPL =3D 0 Jan 19 15:53:42 elfi kernel: current process =3D 35 (swi4: =20= clock sio) Jan 19 15:53:42 elfi kernel: trap number =3D 12 Jan 19 15:53:42 elfi kernel: panic: page fault Jan 19 15:53:42 elfi kernel: Uptime: 40d16h49m35s again, from dmesg -a: ad0: 2441MB <WDC AC22500L 32.41N35> at ata0-master UDMA33 acd0: CDROM <CD-ROM CDU701-F/1.0q> at ata1-master PIO4 ad6: 286188MB <Maxtor 7L300S0 BANC1G10> at ata3-master SATA150 ad10: 286188MB <Maxtor 7L300S0 BANC1G10> at ata5-master SATA150 GEOM_MIRROR: Device gm0s1 created (id=3D4118114647). GEOM_MIRROR: Device gm0s1: provider ad6s1 detected. GEOM_MIRROR: Device gm0s1: provider ad10s1 detected. Root mount waiting for: GMIRROR GEOM_MIRROR: Device gm0s1: provider ad6s1 activated. GEOM_MIRROR: Device gm0s1: provider mirror/gm0s1 launched. GEOM_MIRROR: Device gm0s1: rebuilding provider ad10s1. Trying to mount root from ufs:/dev/mirror/gm0s1a WARNING: / was not properly dismounted Loading configuration files. kernel dumps on /dev/ad0s1b <<<< So wtf wont it dump there!!!... Entropy harvesting: interrupts ethernet point_to_point kickstart . swapon: adding /dev/mirror/gm0s1b as swap device swapon: adding /dev/ad0s1b as swap device Starting file system checks: /dev/mirror/gm0s1a: 2105 files, 39981 used, 213834 free (1426 frags, =20 26551 blocks, 0.6% fragmentation) /dev/mirror/gm0s1e: DEFER FOR BACKGROUND CHECKING /dev/mirror/gm0s1f: DEFER FOR BACKGROUND CHECKING /dev/mirror/gm0s1d: DEFER FOR BACKGROUND CHECKING WARNING: /tmp was not properly dismounted WARNING: /usr was not properly dismounted /usr: mount pending error: blocks 52928 files 0 WARNING: /var was not properly dismounted /var: mount pending error: blocks 48 files 1 ...networking is setup... Starting devd. Mounting NFS file systems: . Creating and/or trimming log files: . Starting syslogd. Checking for core dump on /dev/ad0s1b... savecore: no dumps found Why o why... Anyone got any new ideas?? Thanks! Johan Str=F6m johan@stromnet.org http://www.stromnet.org/ --Apple-Mail-4-462008945--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?268C3DEB-7569-4C18-BC35-1C5F36EF8EC4>