From owner-freebsd-hackers@FreeBSD.ORG Wed Mar 31 05:08:05 2004 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B2BA416A4CE for ; Wed, 31 Mar 2004 05:08:05 -0800 (PST) Received: from addr-mx02.addr.com (addr-mx02.addr.com [209.249.147.146]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9694E43D5F for ; Wed, 31 Mar 2004 05:08:05 -0800 (PST) (envelope-from aanand@addr.com) Received: from proxy1.addr.com (proxy1.addr.com [209.249.147.28]) by addr-mx02.addr.com (8.12.8/8.12.2) with ESMTP id i2VD856j059355 for ; Wed, 31 Mar 2004 05:08:05 -0800 (PST) Received: from admin.addr.com ([203.124.152.29]) by proxy1.addr.com (8.12.8/8.12.8/Submit) with ESMTP id i2VD81Tf071597 for ; Wed, 31 Mar 2004 05:08:02 -0800 (PST) Date: Wed, 31 Mar 2004 18:42:00 +0530 To: "hackers@freebsd.org" From: Ajit Anand Organization: ADDR Technologies Content-Type: multipart/mixed; boundary=----------6nE9c7OnaZKDMNClmNmHgt MIME-Version: 1.0 Message-ID: User-Agent: Opera7.23/FreeBSD M2 build 518 X-ADDRSpamFilter: Passed, probability (23%) Subject: X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 31 Mar 2004 13:08:05 -0000 ------------6nE9c7OnaZKDMNClmNmHgt Content-Type: text/plain; format=flowed; charset=us-ascii Content-Transfer-Encoding: 8bit Hi , Thanks for your reply. I am forwarding the information which you required. Apache Version : Apache/1.3.29 PHP : 4.3.4 Perl : 5.005_03 MySQL : 4.0.15 PHPLive : 2.5.1 I have attached the process list and the kernel configuration. We are not using any cvs. Regards Ajit From: rmkml To: Ajit Anand Subject: Re: Frequent crashes on 4.9STABLE Date: Wed, 31 Mar 2004 12:57:34 +0200 (CEST) Hi Ajit, possible send kernel conf to the list ? what version apache/mysql use ? (php?, perl?, others ?) possible chech memory with memtest86.com ? send ps axwl ? possible sync with cvs ? Regards Rmkml@Wanadoo.fr On Wed, 31 Mar 2004, Ajit Anand wrote: Date: Wed, 31 Mar 2004 17:26:23 +0530 From: Ajit Anand To: hackers@freebsd.org Subject: Frequent crashes on 4.9STABLE Hi, We are facing frequent crashes of our server running Apache,MySQL. The machine is a P4 2.8 GHz with 512 MB RAM and 2 80 GB IDE HDD's. dmesg output is attached in the file. uname -a FreeBSD chatwith.addr.com 4.9-RELEASE FreeBSD 4.9-RELEASE #3: Thu Mar 25 15:39:52 IST 2004 root@chatwith.addr.com:/usr/src/sys/compile/DEBUG i386 Output of gdb with the backtrace of the core #0 dumpsys () at ../../kern/kern_shutdown.c:487 #1 0xc022b1af in boot (howto=256) at ../../kern/kern_shutdown.c:316 #2 0xc022b5ed in panic (fmt=0xc0405acc "%s") at ../../kern/kern_shutdown.c:595 #3 0xc0382493 in trap_fatal (frame=0xdef5fd58, eva=54) at ../../i386/i386/trap.c:974 #4 0xc0382141 in trap_pfault (frame=0xdef5fd58, usermode=0, eva=54) at ../../i386/i386/trap.c:867 #5 0xc0381ce7 in trap (frame={tf_fs = 16, tf_es = 16, tf_ds = -1039728624, tf_edi = -554225664, tf_esi = -1069052468, tf_ebp = -554303944, tf_isp = -554304124, tf_ebx = 0, tf_edx = 0, tf_ecx = -554304249, tf_eax = 1, tf_trapno = 12, tf_err = 2, tf_eip = -1070434902, tf_cs = 8, tf_eflags = 66178, tf_esp = -730867616, tf_ss = -1069052468}) at ../../i386/i386/trap.c:466 #6 0xc03275aa in vm_fault (map=0xc0478dcc, vaddr=3740741632, fault_type=1 '\001', fault_flags=0) at ../../vm/vm_object.h:189 #7 0xc03820ee in trap_pfault (frame=0xdef5feac, usermode=0, eva=3740741632) at ../../i386/i386/trap.c:856 #8 0xc0381ce7 in trap (frame={tf_fs = 462946320, tf_es = 496500752, tf_ds = 16, tf_edi = 1073663755, tf_esi = -1055233972, tf_ebp = -554303652, tf_isp = -554303784, tf_ebx = -1055234048, tf_edx = 746534015, tf_ecx = -554225664, tf_eax = 345135053, tf_trapno = 12, tf_err = 0, tf_eip = -1071100893, tf_cs = 8, tf_eflags = 66178, tf_esp = -1055234048, tf_ss = 4196352}) at ../../i386/i386/trap.c:466 #9 0xc0284c23 in ip_input (m=0xc11a6800) at ../../sys/fnv_hash.h:26 #10 0xc028503b in ipintr () at ../../netinet/ip_input.c:955 #11 0xc0377509 in swi_net_next () Can someone please point me in the right direction to a solution to this problem. TIA, Ajit ------------6nE9c7OnaZKDMNClmNmHgt Content-Disposition: attachment; filename=pslist.txt Content-Type: text/plain; name=pslist.txt Content-Transfer-Encoding: 8bit USER PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND root 8293 0.0 0.1 444 248 p0 R+ 6:30PM 0:00.00 ps auwx root 1 0.0 0.0 552 196 ?? ILs 2:01AM 0:00.01 /sbin/init -- root 2 0.0 0.0 0 0 ?? DL 2:01AM 0:00.00 (taskqueue) root 3 0.0 0.0 0 0 ?? DL 2:01AM 0:00.21 (pagedaemon) root 4 0.0 0.0 0 0 ?? DL 2:01AM 0:00.00 (vmdaemon) root 5 0.0 0.0 0 0 ?? DL 2:01AM 0:00.49 (bufdaemon) root 6 0.0 0.0 0 0 ?? DL 2:01AM 0:10.98 (syncer) root 7 0.0 0.0 0 0 ?? DL 2:01AM 0:00.45 (vnlru) root 21 0.0 0.0 212 68 ?? Is 2:03AM 0:00.00 adjkerntz -i root 109 0.0 0.1 984 580 ?? Ss 8:33PM 0:00.20 /usr/sbin/syslogd -s root 117 0.0 0.1 1080 648 ?? Is 8:34PM 0:00.00 /usr/sbin/inetd -wW root 119 0.0 0.1 1024 612 ?? Is 8:34PM 0:00.14 /usr/sbin/cron root 121 0.0 0.3 3008 1596 ?? Is 8:34PM 0:00.55 /usr/sbin/sshd root 123 0.0 0.1 924 472 ?? Is 8:34PM 0:00.07 /usr/sbin/usbd root 126 0.0 0.4 3028 1832 ?? Ss 8:34PM 0:01.75 sendmail: accepting connections (sendmail) smmsp 129 0.0 0.3 2932 1732 ?? Is 8:34PM 0:00.02 sendmail: Queue runner@00:30:00 for /var/spool/clientmqueue (sendmai root 161 0.0 0.1 648 264 con- I 8:34PM 0:00.01 /bin/sh /usr/local/bin/mysqld_safe --user=mysql --datadir=/var/db/my root 190 0.0 0.3 2876 1316 ?? Is 8:34PM 0:00.02 /sbin/smbd root 194 0.0 0.2 1900 1156 ?? Ss 8:34PM 0:00.46 /sbin/nmbd root 197 0.0 0.1 952 568 v0 Is+ 8:34PM 0:00.00 /usr/libexec/getty Pc ttyv0 root 198 0.0 0.1 952 568 v1 Is+ 8:34PM 0:00.00 /usr/libexec/getty Pc ttyv1 root 199 0.0 0.1 952 568 v2 Is+ 8:34PM 0:00.00 /usr/libexec/getty Pc ttyv2 root 200 0.0 0.1 952 568 v3 Is+ 8:34PM 0:00.00 /usr/libexec/getty Pc ttyv3 root 201 0.0 0.1 952 568 v4 Is+ 8:34PM 0:00.00 /usr/libexec/getty Pc ttyv4 root 202 0.0 0.1 952 568 v5 Is+ 8:34PM 0:00.00 /usr/libexec/getty Pc ttyv5 root 203 0.0 0.1 952 568 v6 Is+ 8:34PM 0:00.00 /usr/libexec/getty Pc ttyv6 root 204 0.0 0.1 952 568 v7 Is+ 8:34PM 0:00.00 /usr/libexec/getty Pc ttyv7 root 205 0.0 0.1 948 540 ?? I 8:34PM 0:00.00 /usr/libexec/getty std.9600 ttyd0 root 6089 0.0 0.4 3440 2160 ?? S 9:42AM 0:03.39 /sbin/smbd root 7069 0.0 0.4 3508 2176 ?? S 1:38PM 0:02.56 /sbin/smbd root 8017 0.0 0.7 5016 3376 ?? Ss 5:35PM 0:00.19 /usr/local/apache/bin/httpd -DSSL nobody 8018 0.0 0.9 6096 4772 ?? S 5:35PM 0:18.73 /usr/local/apache/bin/httpd -DSSL nobody 8019 0.0 0.9 5984 4668 ?? S 5:35PM 0:15.22 /usr/local/apache/bin/httpd -DSSL nobody 8020 0.3 0.9 6104 4780 ?? S 5:35PM 0:25.98 /usr/local/apache/bin/httpd -DSSL nobody 8022 0.0 0.9 5984 4660 ?? S 5:35PM 0:15.46 /usr/local/apache/bin/httpd -DSSL nobody 8025 0.0 0.9 5968 4632 ?? S 5:35PM 0:17.06 /usr/local/apache/bin/httpd -DSSL nobody 8026 0.0 0.9 6000 4716 ?? S 5:35PM 0:19.45 /usr/local/apache/bin/httpd -DSSL nobody 8062 0.0 0.9 5992 4668 ?? S 5:41PM 0:16.70 /usr/local/apache/bin/httpd -DSSL root 8075 0.0 0.4 5664 1964 ?? I 5:43PM 0:00.02 sshd: rbathri [priv] (sshd) rbathri 8081 0.0 0.4 5664 2008 ?? S 5:43PM 0:00.07 sshd: rbathri@ttyp0 (sshd) rbathri 8082 0.0 0.2 1260 832 p0 Is 5:43PM 0:00.01 -tcsh (tcsh) root 8085 0.0 0.2 1332 928 p0 S 5:43PM 0:00.04 -su (csh) mysql 8144 0.0 3.9 52056 20252 ?? S 5:53PM 0:22.87 /usr/local/libexec/mysqld --basedir=/usr/local --datadir=/var/db/mys nobody 8208 0.0 0.8 5312 3928 ?? S 6:16PM 0:00.47 /usr/local/apache/bin/httpd -DSSL nobody 8210 0.1 0.8 5660 4284 ?? S 6:16PM 0:05.90 /usr/local/apache/bin/httpd -DSSL nobody 8225 0.0 0.9 5972 4596 ?? S 6:19PM 0:02.98 /usr/local/apache/bin/httpd -DSSL nobody 8237 0.0 0.8 5700 4328 ?? S 6:21PM 0:03.60 /usr/local/apache/bin/httpd -DSSL nobody 8268 0.0 0.8 5656 4272 ?? S 6:28PM 0:00.91 /usr/local/apache/bin/httpd -DSSL nobody 8287 0.0 0.8 5276 3892 ?? S 6:30PM 0:00.02 /usr/local/apache/bin/httpd -DSSL nobody 8288 0.0 0.8 5276 3888 ?? S 6:30PM 0:00.02 /usr/local/apache/bin/httpd -DSSL nobody 8289 0.0 0.8 5668 4252 ?? S 6:30PM 0:00.03 /usr/local/apache/bin/httpd -DSSL root 0 0.0 0.0 0 0 ?? DLs 2:01AM 0:00.00 (swapper) ------------6nE9c7OnaZKDMNClmNmHgt Content-Disposition: attachment; filename=DEBUG Content-Type: application/octet-stream; name=DEBUG Content-Transfer-Encoding: 8bit # # GENERIC -- Generic kernel configuration file for FreeBSD/i386 # # For more information on this file, please read the handbook section on # Kernel Configuration Files: # # http://www.FreeBSD.org/doc/en_US.ISO8859-1/books/handbook/kernelconfig-config.html # # The handbook is also available locally in /usr/share/doc/handbook # if you've installed the doc distribution, otherwise always see the # FreeBSD World Wide Web server (http://www.FreeBSD.org/) for the # latest information. # # An exhaustive list of options and more detailed explanations of the # device lines is also present in the ./LINT configuration file. If you are # in doubt as to the purpose or necessity of a line, check first in LINT. # # $FreeBSD: src/sys/i386/conf/GENERIC,v 1.246.2.54 2003/04/28 03:41:46 simokawa Exp $ machine i386 cpu I686_CPU ident DEBUG maxusers 0 options DDB makeoptions DEBUG=-g #Build kernel with gdb(1) debug symbols options DDB_UNATTENDED options INET #InterNETworking options FFS #Berkeley Fast Filesystem options FFS_ROOT #FFS usable as root device [keep this!] options SOFTUPDATES #Enable FFS soft updates support options UFS_DIRHASH #Improve performance on big directories options MFS #Memory Filesystem options MD_ROOT #MD is a potential root device options NFS #Network Filesystem options NFS_ROOT #NFS usable as root device, NFS required options MSDOSFS #MSDOS Filesystem options CD9660 #ISO 9660 Filesystem options CD9660_ROOT #CD-ROM usable as root, CD9660 required options PROCFS #Process filesystem options COMPAT_43 #Compatible with BSD 4.3 [KEEP THIS!] options SCSI_DELAY=15000 #Delay (in ms) before probing SCSI options UCONSOLE #Allow users to grab the console options USERCONFIG #boot -c editor options VISUAL_USERCONFIG #visual boot -c editor options KTRACE #ktrace(1) support options SYSVSHM #SYSV-style shared memory options SYSVMSG #SYSV-style message queues options SYSVSEM #SYSV-style semaphores options P1003_1B #Posix P1003_1B real-time extensions options _KPOSIX_PRIORITY_SCHEDULING options ICMP_BANDLIM #Rate limit bad replies options KBD_INSTALL_CDEV # install a CDEV entry in /dev options AHC_REG_PRETTY_PRINT # Print register bitfields in debug # output. Adds ~128k to driver. options AHD_REG_PRETTY_PRINT # Print register bitfields in debug # output. Adds ~215k to driver. # To make an SMP kernel, the next two are needed #options SMP # Symmetric MultiProcessor Kernel #options APIC_IO # Symmetric (APIC) I/O # To support HyperThreading, HTT is needed in addition to SMP and APIC_IO #options HTT # HyperThreading Technology device isa device eisa device pci # Floppy drives device fdc0 at isa? port IO_FD1 irq 6 drq 2 device fd0 at fdc0 drive 0 device fd1 at fdc0 drive 1 # # If you have a Toshiba Libretto with its Y-E Data PCMCIA floppy, # don't use the above line for fdc0 but the following one: #device fdc0 # ATA and ATAPI devices device ata0 at isa? port IO_WD1 irq 14 device ata1 at isa? port IO_WD2 irq 15 device ata device atadisk # ATA disk drives device atapicd # ATAPI CDROM drives device atapifd # ATAPI floppy drives device atapist # ATAPI tape drives options ATA_STATIC_ID #Static device numbering # SCSI Controllers device ahb # EISA AHA1742 family device ahc # AHA2940 and onboard AIC7xxx devices device ahd # AHA39320/29320 and onboard AIC79xx devices device amd # AMD 53C974 (Tekram DC-390(T)) device isp # Qlogic family device mpt # LSI-Logic MPT/Fusion device ncr # NCR/Symbios Logic device sym # NCR/Symbios Logic (newer chipsets) options SYM_SETUP_LP_PROBE_MAP=0x40 # Allow ncr to attach legacy NCR devices when # both sym and ncr are configured device adv0 at isa? device adw device bt0 at isa? device aha0 at isa? device aic0 at isa? device ncv # NCR 53C500 device nsp # Workbit Ninja SCSI-3 device stg # TMC 18C30/18C50 # SCSI peripherals device scbus # SCSI bus (required) device da # Direct Access (disks) device sa # Sequential Access (tape etc) device cd # CD device pass # Passthrough device (direct SCSI access) # RAID controllers interfaced to the SCSI subsystem device asr # DPT SmartRAID V, VI and Adaptec SCSI RAID device dpt # DPT Smartcache - See LINT for options! device iir # Intel Integrated RAID device mly # Mylex AcceleRAID/eXtremeRAID device ciss # Compaq SmartRAID 5* series # RAID controllers device aac # Adaptec FSA RAID, Dell PERC2/PERC3 #device aacp # SCSI passthrough for aac (requires CAM) device ida # Compaq Smart RAID device amr # AMI MegaRAID device mlx # Mylex DAC960 family device twe # 3ware Escalade # atkbdc0 controls both the keyboard and the PS/2 mouse device atkbdc0 at isa? port IO_KBD device atkbd0 at atkbdc? irq 1 flags 0x1 device psm0 at atkbdc? irq 12 device vga0 at isa? # splash screen/screen saver pseudo-device splash # syscons is the default console driver, resembling an SCO console device sc0 at isa? flags 0x100 # Enable this and PCVT_FREEBSD for pcvt vt220 compatible console driver #device vt0 at isa? #options XSERVER # support for X server on a vt console #options FAT_CURSOR # start with block cursor # If you have a ThinkPAD, uncomment this along with the rest of the PCVT lines #options PCVT_SCANSET=2 # IBM keyboards are non-std device agp # support several AGP chipsets # Floating point support - do not disable. device npx0 at nexus? port IO_NPX irq 13 # Power management support (see LINT for more options) device apm0 at nexus? disable flags 0x20 # Advanced Power Management # PCCARD (PCMCIA) support device card device pcic0 at isa? irq 0 port 0x3e0 iomem 0xd0000 device pcic1 at isa? irq 0 port 0x3e2 iomem 0xd4000 disable # Serial (COM) ports device sio0 at isa? port IO_COM1 flags 0x10 irq 4 device sio1 at isa? port IO_COM2 irq 3 device sio2 at isa? disable port IO_COM3 irq 5 device sio3 at isa? disable port IO_COM4 irq 9 # Parallel port device ppc0 at isa? irq 7 device ppbus # Parallel port bus (required) device lpt # Printer device plip # TCP/IP over parallel device ppi # Parallel port interface device #device vpo # Requires scbus and da # PCI Ethernet NICs. device de # DEC/Intel DC21x4x (``Tulip'') device em # Intel PRO/1000 adapter Gigabit Ethernet Card (``Wiseman'') device txp # 3Com 3cR990 (``Typhoon'') device vx # 3Com 3c590, 3c595 (``Vortex'') # PCI Ethernet NICs that use the common MII bus controller code. # NOTE: Be sure to keep the 'device miibus' line in order to use these NICs! device miibus # MII bus support device dc # DEC/Intel 21143 and various workalikes device fxp # Intel EtherExpress PRO/100B (82557, 82558) device pcn # AMD Am79C97x PCI 10/100 NICs device rl # RealTek 8129/8139 device sf # Adaptec AIC-6915 (``Starfire'') device sis # Silicon Integrated Systems SiS 900/SiS 7016 device ste # Sundance ST201 (D-Link DFE-550TX) device tl # Texas Instruments ThunderLAN device tx # SMC EtherPower II (83c170 ``EPIC'') device vr # VIA Rhine, Rhine II device wb # Winbond W89C840F device xl # 3Com 3c90x (``Boomerang'', ``Cyclone'') device bge # Broadcom BCM570x (``Tigon III'') # ISA Ethernet NICs. # 'device ed' requires 'device miibus' device ed0 at isa? disable port 0x280 irq 10 iomem 0xd8000 device ex device ep device fe0 at isa? disable port 0x300 # Xircom Ethernet device xe # PRISM I IEEE 802.11b wireless NIC. device awi # WaveLAN/IEEE 802.11 wireless NICs. Note: the WaveLAN/IEEE really # exists only as a PCMCIA device, so there is no ISA attachment needed # and resources will always be dynamically assigned by the pccard code. device wi # Aironet 4500/4800 802.11 wireless NICs. Note: the declaration below will # work for PCMCIA and PCI cards, as well as ISA cards set to ISA PnP # mode (the factory default). If you set the switches on your ISA # card for a manually chosen I/O address and IRQ, you must specify # those parameters here. device an # The probe order of these is presently determined by i386/isa/isa_compat.c. device ie0 at isa? disable port 0x300 irq 10 iomem 0xd0000 #device le0 at isa? disable port 0x300 irq 5 iomem 0xd0000 device lnc0 at isa? disable port 0x280 irq 10 drq 0 device cs0 at isa? disable port 0x300 device sn0 at isa? disable port 0x300 irq 10 # Pseudo devices - the number indicates how many units to allocate. pseudo-device loop # Network loopback pseudo-device ether # Ethernet support pseudo-device sl 1 # Kernel SLIP pseudo-device ppp 1 # Kernel PPP pseudo-device tun # Packet tunnel. pseudo-device pty # Pseudo-ttys (telnet etc) pseudo-device md # Memory "disks" pseudo-device gif # IPv6 and IPv4 tunneling pseudo-device faith 1 # IPv6-to-IPv4 relaying (translation) # The `bpf' pseudo-device enables the Berkeley Packet Filter. # Be aware of the administrative consequences of enabling this! pseudo-device bpf #Berkeley packet filter # USB support device uhci # UHCI PCI->USB interface device ohci # OHCI PCI->USB interface device usb # USB Bus (required) device ugen # Generic device uhid # "Human Interface Devices" device ukbd # Keyboard device ulpt # Printer device umass # Disks/Mass storage - Requires scbus and da device ums # Mouse device uscanner # Scanners device urio # Diamond Rio MP3 Player # USB Ethernet, requires mii device aue # ADMtek USB ethernet device cue # CATC USB ethernet device kue # Kawasaki LSI USB ethernet # FireWire support device firewire # FireWire bus code device sbp # SCSI over FireWire (Requires scbus and da) device fwe # Ethernet over FireWire (non-standard!) options IPFIREWALL options IPFIREWALL_VERBOSE ------------6nE9c7OnaZKDMNClmNmHgt--