From owner-freebsd-bugs@FreeBSD.ORG Tue Mar 13 13:20:04 2007 Return-Path: X-Original-To: freebsd-bugs@hub.freebsd.org Delivered-To: freebsd-bugs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 4D10D16A400 for ; Tue, 13 Mar 2007 13:20:04 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [69.147.83.40]) by mx1.freebsd.org (Postfix) with ESMTP id 24BA313C484 for ; Tue, 13 Mar 2007 13:20:04 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (gnats@localhost [127.0.0.1]) by freefall.freebsd.org (8.13.4/8.13.4) with ESMTP id l2DDK3XS087985 for ; Tue, 13 Mar 2007 13:20:04 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.13.4/8.13.4/Submit) id l2DDK3Yv087984; Tue, 13 Mar 2007 13:20:03 GMT (envelope-from gnats) Resent-Date: Tue, 13 Mar 2007 13:20:03 GMT Resent-Message-Id: <200703131320.l2DDK3Yv087984@freefall.freebsd.org> Resent-From: FreeBSD-gnats-submit@FreeBSD.org (GNATS Filer) Resent-To: freebsd-bugs@FreeBSD.org Resent-Reply-To: FreeBSD-gnats-submit@FreeBSD.org, Vyacheslav Vovk Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 2048016A401 for ; Tue, 13 Mar 2007 13:10:44 +0000 (UTC) (envelope-from nobody@FreeBSD.org) Received: from www.freebsd.org (www.freebsd.org [69.147.83.33]) by mx1.freebsd.org (Postfix) with ESMTP id 00B3F13C468 for ; Tue, 13 Mar 2007 13:10:44 +0000 (UTC) (envelope-from nobody@FreeBSD.org) Received: from www.freebsd.org (localhost [127.0.0.1]) by www.freebsd.org (8.13.1/8.13.1) with ESMTP id l2DDAh5g049777 for ; Tue, 13 Mar 2007 13:10:43 GMT (envelope-from nobody@www.freebsd.org) Received: (from nobody@localhost) by www.freebsd.org (8.13.1/8.13.1/Submit) id l2DDAhUE049776; Tue, 13 Mar 2007 13:10:43 GMT (envelope-from nobody) Message-Id: <200703131310.l2DDAhUE049776@www.freebsd.org> Date: Tue, 13 Mar 2007 13:10:43 GMT From: Vyacheslav Vovk To: freebsd-gnats-submit@FreeBSD.org X-Send-Pr-Version: www-3.0 Cc: Subject: kern/110267: panic: vm_thread_new: kstack allocation failed X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Mar 2007 13:20:04 -0000 >Number: 110267 >Category: kern >Synopsis: panic: vm_thread_new: kstack allocation failed >Confidential: no >Severity: serious >Priority: medium >Responsible: freebsd-bugs >State: open >Quarter: >Keywords: >Date-Required: >Class: change-request >Submitter-Id: current-users >Arrival-Date: Tue Mar 13 13:20:03 GMT 2007 >Closed-Date: >Last-Modified: >Originator: Vyacheslav Vovk >Release: FreeBSD 6.1-STABLE i386 >Organization: none >Environment: FreeBSD 6.1-STABLE #5: Wed Feb 28 12:02:49 EET 2007 vovk at ic.km.ua:/usr/obj/usr/src/sys/stella >Description: As well as in the above-stated reference there is highly loaded machine, which periodically panic. #kgdb kernel.debug /var/crash/vmcore.4 [GDB will not be able to debug user-mode threads: /usr/lib/libthread_db.so: Undef ined symbol "ps_pglobal_lookup"] GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i386-marcel-freebsd". Unread portion of the kernel message buffer: panic: vm_thread_new: kstack allocation failed cpuid = 3 Uptime: 7d4h30m58s Dumping 2046 MB (2 chunks) chunk 0: 1MB (158 pages) ... ok chunk 1: 2046MB (523744 pages) 2030 2014 1998 1982 1966 1950 1934 1918 1902 188 6 1870 1854 1838 1822 1806 1790 1774 1758 1742 1726 1710 1694 1678 1662 1646 1630 1614 1598 1582 1566 1550 1534 1518 1502 1486 1470 1454 1438 1422 1406 1390 1374 1358 1342 1326 1310 1294 1278 1262 1246 1230 1214 1198 1182 1166 1150 1134 1118 1 102 1086 1070 1054 1038 1022 1006 990 974 958 942 926 910 894 878 862 846 830 814 798 782 766 750 734 718 702 686 670 654 638 622 606 590 574 558 542 526 510 494 478 462 446 430 414 398 382 366 350 334 318 302 286 270 254 238 222 206 190 174 1 58 142 126 110 94 78 62 46 30 14 0 doadump () at pcpu.h:165 165 __asm __volatile("movl %%fs:0,%0" : "=r" (td)); (kgdb) bt #0 doadump () at pcpu.h:165 #1 0xc04e533d in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:409 #2 0xc04e5665 in panic ( fmt=0xc0679bd6 "vm_thread_new: kstack allocation failed") at /usr/src/sys/kern/kern_shutdown.c:565 #3 0xc05f26bb in vm_thread_new (td=0xd2221780, pages=2) at /usr/src/sys/vm/vm_glue.c:347 #4 0xc04ef7c7 in thread_init (mem=0xd2221780, size=372, flags=259) at /usr/src/sys/kern/kern_thread.c:185 #5 0xc05eb29e in slab_zalloc (zone=0xc0c511e0, wait=259) at /usr/src/sys/vm/uma_core.c:861 #6 0xc05ec890 in uma_zone_slab (zone=0xc0c511e0, flags=3) at /usr/src/sys/vm/uma_core.c:2025 #7 0xc05ecac0 in uma_zalloc_bucket (zone=0xc0c511e0, flags=3) at /usr/src/sys/vm/uma_core.c:2134 #8 0xc05ec722 in uma_zalloc_arg (zone=0xc0c511e0, udata=0x0, flags=2) at /usr/src/sys/vm/uma_core.c:1942 #9 0xc04efcb7 in thread_alloc () at uma.h:275 #10 0xc04d3596 in thread_alloc_spare (td=0xd2252d80) at /usr/src/sys/kern/kern_kse.c:1046 #11 0xc04d40e6 in thread_userret (td=0xd2252d80, frame=0xffab5d38) at /usr/src/sys/kern/kern_kse.c:1437 #12 0xc05061da in userret (td=0xd2252d80, frame=0xffab5d38, oticks=0) at /usr/src/sys/kern/subr_trap.c:120 #13 0xc04cecfa in fork_return (td=0xd2252d80, frame=0xffab5d38) at /usr/src/sys/kern/kern_fork.c:834 #14 0xc04cec21 in fork_exit (callout=0xc04cece8 , arg=0xd2252d80, frame=0xffab5d38) at /usr/src/sys/kern/kern_fork.c:805 #15 0xc062909c in fork_trampoline () at /usr/src/sys/i386/i386/exception.s:208 (kgdb) f 3 #3 0xc05f26bb in vm_thread_new (td=0xd2221780, pages=2) at /usr/src/sys/vm/vm_glue.c:347 347 panic("vm_thread_new: kstack allocation failed"); (kgdb) l 342 * Get a kernel virtual address for this thread's kstack. 343 */ 344 ks = kmem_alloc_nofault(kernel_map, 345 (pages + KSTACK_GUARD_PAGES) * PAGE_SIZE); 346 if (ks == 0) 347 panic("vm_thread_new: kstack allocation failed"); 348 if (KSTACK_GUARD_PAGES != 0) { 349 pmap_qremove(ks, KSTACK_GUARD_PAGES); 350 ks += KSTACK_GUARD_PAGES * PAGE_SIZE; 351 } (kgdb) i loc ksobj = 0xd1b25a50 ks = 0 m = 0x0 ma = {0xc1abe450, 0xc26e8498, 0xd201ce20, 0xffab5b90, 0xc05eca91, 0xc0c61d20, 0xd201ce20, 0x102, 0x80, 0x0, 0xc0c61db0, 0xc0c61d20, 0x0, 0xd0d038c0, 0xc05ec539, 0xffab5bac, 0xffab5bac, 0xc04da4b3, 0x40, 0x2, 0xffab5bd0, 0xc04da579, 0xc0699c00, 0x40, 0x2, 0xc0c6caa0, 0xd2221600, 0x0, 0xc04f800a, 0xd2221754, 0x20, 0xd2221600} i = -769517696 (kgdb) #dmesg Copyright (c) 1992-2006 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD 6.1-STABLE #5: Wed Feb 28 12:02:49 EET 2007 vovk at ic.km.ua:/usr/obj/usr/src/sys/stella acpi_alloc_wakeup_handler: can't alloc wake memory ACPI APIC Table: Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Xeon(TM) CPU 2.80GHz (2793.01-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0xf29 Stepping = 9 Features=0xbfebfbff Features2=0x4400> Logical CPUs per core: 2 real memory = 2146304000 (2046 MB) avail memory = 2096357376 (1999 MB) FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 6 cpu3 (AP): APIC ID: 7 ioapic0: Changing APIC ID to 4 ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-47 on motherboard acpi0: on motherboard acpi0: Power Button (fixed) Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 cpu0: on acpi0 cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 acpi_button0: on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 agp0: mem 0xe8000000-0xefffffff at device 0.0 o n pci0 pcib1: at device 1.0 on pci0 pci1: on pcib1 pci1: at device 0.0 (no driver attached) pcib2: at device 3.0 on pci0 pci2: on pcib2 em0: port 0x9000-0x901f m em 0xf7020000-0xf703ffff,0xf7000000-0xf701ffff irq 18 at device 1.0 on pci2 em0: Ethernet address: 00:11:2f:10:3e:14 pcib3: at device 28.0 on pci0 pci3: on pcib3 aac0: mem 0xf0000000-0xf3ffffff irq 25 at device 3.0 on pci3 aac0: New comm. interface enabled aac0: Adaptec Raid Controller 2.0.0-1 aacp0: on aac0 aacp1: on aac0 pci0: at device 29.0 (no driver attached) pci0: at device 29.1 (no driver attached) pci0: at device 29.4 (no driver attached) pci0: at device 29.5 (no driver attached) pci0: at device 29.7 (no driver attached) pcib4: at device 30.0 on pci0 pci4: on pcib4 isab0: at device 31.0 on pci0 isa0: on isab0 atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x 376,0xf000-0xf00f at device 31.1 on pci0 ata0: on atapci0 ata1: on atapci0 ichsmb0: port 0x500-0x51f irq 17 at device 31.3 on pci0 ichsmb0: [GIANT-LOCKED] smbus0: on ichsmb0 acpi_tz0: on acpi0 fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 fdc0: [FAST] fd0: <1440-KB 3.5" drive> on fdc0 drive 0 sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 sio0: type 16550A sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 on acpi0 sio1: type 16550A ppc0: port 0x378-0x37f,0x778-0x77b irq 7 on acpi 0 ppc0: Generic chipset (NIBBLE-only) in COMPATIBLE mode ppbus0: on ppc0 plip0: on ppbus0 lpt0: on ppbus0 lpt0: Interrupt-driven port ppi0: on ppbus0 pmtimer0 on isa0 orm0: at iomem 0xc0000-0xca7ff,0xcc000-0xd07ff on isa0 atkbdc0: at port 0x60,0x64 on isa0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] psm0: irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: model Generic PS/2 mouse, device ID 0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 Timecounters tick every 1.000 msec ipfw2 (+ipv6) initialized, divert loadable, rule-based forwarding disabled, defau lt to deny, logging disabled aacd0: on aac0 aacd0: 69974MB (143307008 sectors) pass0 at aacp0 bus 0 target 0 lun 0 pass0: Fixed unknown SCSI-3 device pass0: 3.300MB/s transfers pass1 at aacp0 bus 0 target 1 lun 0 pass1: Fixed unknown SCSI-3 device pass1: 3.300MB/s transfers SMP: AP CPU #2 Launched! SMP: AP CPU #1 Launched! SMP: AP CPU #3 Launched! Trying to mount root from ufs:/dev/aacd0s1a WARNING: / was not properly dismounted Periodically I update system up to 6.2-STABLE, in hope for correction of the problem, however no changes are present and I returned to *default release=cvs tag=RELENG_6 date=2006.09.06.23.59.59 For the given date system works most stably. soft running on this system [19] [root@ic]~#ls /usr/local/etc/rc.d/ apache.sh mysql-server snmpd squid innd radiusd.sh snmptrapd [20] [root@ic]~#cat /etc/libmap.conf cat: /etc/libmap.conf: No such file or directory >How-To-Repeat: I do not know than traps are caused, therefore I can not tell unequivocally. >Fix: >Release-Note: >Audit-Trail: >Unformatted: