From owner-freebsd-java@FreeBSD.ORG Thu Dec 18 23:08:00 2008 Return-Path: Delivered-To: freebsd-java@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4F5DE1065673 for ; Thu, 18 Dec 2008 23:08:00 +0000 (UTC) (envelope-from snb@threerings.net) Received: from smtp.earth.threerings.net (smtp1.earth.threerings.net [64.127.109.108]) by mx1.freebsd.org (Postfix) with ESMTP id 39AD38FC19 for ; Thu, 18 Dec 2008 23:08:00 +0000 (UTC) (envelope-from snb@threerings.net) Received: from [192.168.54.191] (unknown [192.168.54.191]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: snb) by smtp.earth.threerings.net (Postfix) with ESMTP id D242F62062 for ; Thu, 18 Dec 2008 14:44:20 -0800 (PST) Message-Id: <27DF2370-B1B0-44AA-9DAF-A93AE8B568EC@threerings.net> From: Nick Barkas To: freebsd-java@freebsd.org Content-Type: multipart/signed; protocol="application/pgp-signature"; micalg=pgp-sha1; boundary="Apple-Mail-4-77470170" Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Date: Thu, 18 Dec 2008 14:44:16 -0800 X-Pgp-Agent: GPGMail d52 (v52, Leopard) X-Mailer: Apple Mail (2.929.2) Subject: JVM crash when building an application with Atlassian Bamboo X-BeenThere: freebsd-java@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Porting Java to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Dec 2008 23:08:00 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --Apple-Mail-4-77470170 Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Periodically we've been experiencing JVM crashes while Bamboo builds one of our applications. Bamboo itself does not crash. Rather, it is a JVM invoked by Bamboo to run JUnit tests that crashes. It doesn't happen every time, only about once a week for the last three weeks. We're using java/jdk15 on an AMD64 FreeBSD 6.3 machine. After this happened a couple of times I enabled debugging symbols with the port, but I could not figure out how to make Bamboo invoke $JAVA_HOME/bin/ java_g instead of $JAVA_HOME/bin/java. So, the JVM that crashed is one that seems to be lacking those symbols. Is there any way I can build the java/jdk15 port to install *only* the unstripped binaries so that $JAVA_HOME/bin/java will have the proper symbols? Here's the crash log left behind: # # An unexpected error has been detected by HotSpot Virtual Machine: # # Internal Error (53484152454432554E54494D450E43505001A8), pid=80816, tid=0xc02800 # # Java VM: Java HotSpot(TM) 64-Bit Server VM (1.5.0_14-p8- root_11_dec_2008_16_33 mixed mode) --------------- T H R E A D --------------- Current thread (0x0000000000c02400): JavaThread "pool-1- thread-2" [_thread_in_Java, id=12593152] Stack: [0x00007ffffe6ec000,0x00007ffffe7ec000), sp=0x00007ffffe7ea500, free space=1017k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) V [libjvm.so+0x693e49] V [libjvm.so+0x2f7136] V [libjvm.so+0x60c85f] V [libjvm.so+0x5a1cb2] --------------- P R O C E S S --------------- Java Threads: ( => current thread ) =>0x0000000000c02400 JavaThread "pool-1-thread-2" [_thread_in_Java, id=12593152] 0x0000000000772c00 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=7841792] 0x000000000076cc00 JavaThread "CompilerThread1" daemon [_thread_in_vm, id=7809024] 0x0000000000767c00 JavaThread "CompilerThread0" daemon [_thread_blocked, id=7784448] 0x0000000000758c00 JavaThread "AdapterThread" daemon [_thread_blocked, id=7763968] 0x000000000074dc00 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=7702528] 0x000000000074d000 JavaThread "Finalizer" daemon [_thread_blocked, id=7657472] 0x000000000066d800 JavaThread "Reference Handler" daemon [_thread_blocked, id=6740992] 0x000000000052b000 JavaThread "main" [_thread_blocked, id=5332992] Other Threads: 0x000000000065be00 VMThread [id=6738944] 0x000000000051cc00 WatcherThread [id=7866368] VM state:not at safepoint (normal execution) VM Mutex/Monitor currently owned by a thread: None Heap PSYoungGen total 74688K, used 30761K [0x0000000078190000, 0x000000007d4e0000, 0x000000008d6e0000) eden space 64064K, 48% used [0x0000000078190000,0x0000000079f9a448,0x000000007c020000) from space 10624K, 0% used [0x000000007ca80000,0x000000007ca80000,0x000000007d4e0000) to space 10624K, 0% used [0x000000007c020000,0x000000007c020000,0x000000007ca80000) PSOldGen total 170688K, used 0K [0x000000004d6e0000, 0x0000000057d90000, 0x0000000078190000) object space 170688K, 0% used [0x000000004d6e0000,0x000000004d6e0000,0x0000000057d90000) PSPermGen total 21248K, used 7804K [0x00000000482e0000, 0x00000000497a0000, 0x000000004d6e0000) object space 21248K, 36% used [0x00000000482e0000,0x0000000048a7f318,0x00000000497a0000) Dynamic libraries: 0x0000000000400000 /usr/local/debug-jdk/jdk1.5.0/jre/bin/java 0x000000004063b000 /lib/libz.so.3 0x000000004074f000 /lib/libpthread.so.2 0x000000004087a000 /lib/libc.so.6 0x0000000040a8b000 /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/ server/libjvm.so 0x00000000413c6000 /usr/lib/libstdc++.so.5 0x00000000415bd000 /lib/libm.so.4 0x00000000416d9000 /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/ native_threads/libhpi.so 0x00000000417e5000 /usr/local/lib/nss_ldap.so.1 0x0000000041904000 /usr/local/lib/libldap-2.3.so.2 0x0000000041a3e000 /usr/local/lib/liblber-2.3.so.2 0x0000000041b4c000 /usr/local/lib/libsasl2.so.2 0x0000000041c64000 /usr/lib/libssl.so.4 0x0000000041d9c000 /lib/libcrypto.so.4 0x0000000041fe3000 /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/ libverify.so 0x00000000420f2000 /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/ libjava.so 0x000000004221a000 /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/ libzip.so0x000000008f74f000 /usr/local/debug-jdk/jdk1.5.0/jre/lib/ amd64/libnet.so 0x000000004050a000 /libexec/ld-elf.so.1VM Arguments:jvm_args: - Dpanopticon.test.migration.file=/export/bamboo/bamboo-home/xml-data/ build-dir/PANOPTICON-DEVEL/etc/panopticon-ddl.xml -eajava_command: org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner testsfile=/export/bamboo/bamboo-home/xml-data/b uild-dir/PANOPTICON-DEVEL/junittestcases835921828.properties filtertrace=true haltOnError=false haltOnFailure=false showou tput=false outputtoformatters=true logtestlistenerevents=true formatter=org.apache.tools.ant.taskdefs.optional.junit.XMLJU nitResultFormatter,/export/bamboo/bamboo-home/xml-data/build-dir/ PANOPTICON-DEVEL/dist/tmp/IGNORETHIS.xml crashfile=/expor t/bamboo/bamboo-home/xml-data/build-dir/PANOPTICON-DEVEL/ junitvmwatcher228899536.properties propsfile=/export/bamboo/bambo o-home/xml-data/build-dir/PANOPTICON-DEVEL/ junit2040459509.propertiesLauncher Type: SUN_STANDARD Environment Variables:JAVA_HOME=/usr/local/debug-jdk/jdk1.5.0PATH=/usr/ local/debug-jdk/jdk1.5.0/bin:/sbin:/bin:/usr/sbin:/usr/bin:/usr/games:/ usr/local/sbin:/usr/local/bin:/usr/X11R6/ bin:/home/jayme/bin:/home/jayme/bin USERNAME=root LD_LIBRARY_PATH=/usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/server:/ usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64:/usr/local/ debug-jdk/jdk1.5.0/jre/../lib/amd64:/usr/local/jdk1.5.0/jre/lib/amd64/ server:/usr/local/jdk1.5.0/jre/lib/amd64:/usr/local/ jdk1.5.0/jre/../lib/amd64 SHELL=/usr/local/bin/bash HOSTTYPE=FreeBSD OSTYPE=FreeBSD MACHTYPE=unknown Signal Handlers: SIGSEGV: [libjvm.so+0x694850], sa_mask[0]=0xffffffff, sa_flags=0x00000002 SIGBUS: [libjvm.so+0x694850], sa_mask[0]=0xffffffff, sa_flags=0x00000002 SIGFPE: [libjvm.so+0x5a06c0], sa_mask[0]=0xffffffff, sa_flags=0x00000042 SIGPIPE: [libjvm.so+0x5a06c0], sa_mask[0]=0xffffffff, sa_flags=0x00000042 SIGILL: [libjvm.so+0x5a06c0], sa_mask[0]=0xffffffff, sa_flags=0x00000042 SIGUSR1: [libjvm.so+0x5a0750], sa_mask[0]=0x00000000, sa_flags=0x00000040 SIGUSR2: [libjvm.so+0x5a06c0], sa_mask[0]=0xffffffff, sa_flags=0x00000042 SIGHUP: [libjvm.so+0x59f130], sa_mask[0]=0xffffffff, sa_flags=0x00000002 SIGINT: [libjvm.so+0x59f130], sa_mask[0]=0xffffffff, sa_flags=0x00000002 SIGQUIT: [libjvm.so+0x59f130], sa_mask[0]=0xffffffff, sa_flags=0x00000002 SIGTERM: [libjvm.so+0x59f130], sa_mask[0]=0xffffffff, sa_flags=0x00000002 --------------- S Y S T E M --------------- OS:FreeBSD uname:FreeBSD 6.3-RELEASE-p4 FreeBSD 6.3-RELEASE-p4 #8: Fri Sep 5 10:07:45 PDT 2008 root@build1.earth.threerings.net:/usr/obj/usr/ src/sys/SMP amd64 rlimit: STACK 524288k, CORE infinity, NOFILE 11095 CPU:total 8 em64t ht Memory: 4k page, physical 16380812k vm_info: Java HotSpot(TM) 64-Bit Server VM (1.5.0_14-p8- root_11_dec_2008_16_33) for freebsd-amd64, built on Dec 11 2008 16:55:01 by root with gcc 3.4.6 [FreeBSD] 20060305 And here is what I got from gdb on the core file: > sudo gdb -c 1000-80816-java.core /usr/local/debug-jdk/jdk1.5.0/bin/ java GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"...(no debugging symbols found)... Attaching to program: /usr/local/debug-jdk/jdk1.5.0/bin/java, process 1000 ptrace: No such process. Core was generated by `java'. Program terminated with signal 6, Aborted. Reading symbols from /lib/libz.so.3...(no debugging symbols found)...done. Loaded symbols for /lib/libz.so.3 Reading symbols from /lib/libpthread.so.2...(no debugging symbols found)...done. Loaded symbols for /lib/libpthread.so.2 Reading symbols from /lib/libc.so.6...(no debugging symbols found)...done. Loaded symbols for /lib/libc.so.6 Reading symbols from /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/ server/libjvm.so...(no debugging symbols found)...done. Loaded symbols for /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/server/ libjvm.so Reading symbols from /usr/lib/libstdc++.so.5...(no debugging symbols found)...done. Loaded symbols for /usr/lib/libstdc++.so.5 Reading symbols from /lib/libm.so.4...(no debugging symbols found)...done. Loaded symbols for /lib/libm.so.4 Reading symbols from /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/ native_threads/libhpi.so...(no debugging symbols found)...done. Loaded symbols for /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/ native_threads/libhpi.so Reading symbols from /usr/local/lib/nss_ldap.so.1...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/nss_ldap.so.1 Reading symbols from /usr/local/lib/libldap-2.3.so.2...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/libldap-2.3.so.2 Reading symbols from /usr/local/lib/liblber-2.3.so.2...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/liblber-2.3.so.2 Reading symbols from /usr/local/lib/libsasl2.so.2...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/libsasl2.so.2 Reading symbols from /usr/lib/libssl.so.4...(no debugging symbols found)...done. Loaded symbols for /usr/lib/libssl.so.4 Reading symbols from /lib/libcrypto.so.4...(no debugging symbols found)...done. Loaded symbols for /lib/libcrypto.so.4 Reading symbols from /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/ libverify.so...(no debugging symbols found)...done. Loaded symbols for /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/ libverify.so Reading symbols from /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/ libjava.so...(no debugging symbols found)...done. Loaded symbols for /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/ libjava.so Reading symbols from /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/ libzip.so...(no debugging symbols found)...done. Loaded symbols for /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/libzip.so Reading symbols from /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/ libnet.so...(no debugging symbols found)...done. Loaded symbols for /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/libnet.so Reading symbols from /libexec/ld-elf.so.1...(no debugging symbols found)...done. Loaded symbols for /libexec/ld-elf.so.1 #0 0x000000004076e91c in pthread_testcancel () from /lib/ libpthread.so.2 [New Thread 0xc02800 (LWP 100644)] [New Thread 0x780800 (sleeping)] [New Thread 0x77a800 (sleeping)] [New Thread 0x772800 (sleeping)] [New Thread 0x76c800 (sleeping)] [New Thread 0x767800 (sleeping)] [New Thread 0x758800 (sleeping)] [New Thread 0x74d800 (sleeping)] [New Thread 0x66dc00 (sleeping)] [New Thread 0x66d400 (sleeping)] [New Thread 0x5f6000 (sleeping)] [New Thread 0x5f1400 (sleeping)] [New Thread 0x5ed800 (sleeping)] [New Thread 0x5e5c00 (sleeping)] [New Thread 0x5e5000 (sleeping)] [New Thread 0x5e1400 (sleeping)] [New Thread 0x5dd800 (sleeping)] [New Thread 0x5a6c00 (sleeping)] [New Thread 0x5a6800 (LWP 100605)] [New Thread 0x516000 (sleeping)] (gdb) bt #0 0x000000004076e91c in pthread_testcancel () from /lib/ libpthread.so.2 #1 0x000000004075c5e3 in sigaction () from /lib/libpthread.so.2 #2 0x000000004075e102 in sigaction () from /lib/libpthread.so.2 #3 0x0000000040757db6 in pthread_kill () from /lib/libpthread.so.2 #4 0x0000000040757633 in raise () from /lib/libpthread.so.2 #5 0x000000004094a49d in abort () from /lib/libc.so.6 #6 0x0000000041028df9 in os::abort () from /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/server/libjvm.so #7 0x000000004111f097 in VMError::report_and_die () from /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/server/libjvm.so #8 0x0000000040d82136 in report_fatal () from /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/server/libjvm.so #9 0x000000004109785f in SharedRuntime::continuation_for_implicit_exception () from /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/server/libjvm.so #10 0x000000004102ccb2 in JVM_handle_bsd_signal () from /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/server/libjvm.so #11 0x000000004075dc0f in sigaction () from /lib/libpthread.so.2 #12 0x000000004075e015 in sigaction () from /lib/libpthread.so.2 #13 0x000000004075de73 in sigaction () from /lib/libpthread.so.2 #14 0x0000000040765fa9 in pthread_mutexattr_init () from /lib/ libpthread.so.2 #15 0x000000004076600b in pthread_mutexattr_init () from /lib/ libpthread.so.2 #16 0x00000000408bdf77 in signalcontext () from /lib/libc.so.6 #17 0x00007ffffe7eb5d0 in ?? () #18 0x00007ffffe7eb5b0 in ?? () #19 0x0000000000000000 in ?? () #20 0x00007ffffe7eb570 in ?? () #21 0x00007ffffe7eb5c0 in ?? () #22 0x0000000000000000 in ?? () #23 0x0000000000000000 in ?? () #24 0x0000000000000000 in ?? () #25 0x0000000000000000 in ?? () #26 0x0000000000000000 in ?? () #27 0x0000000000000000 in ?? () #28 0x0000000000000000 in ?? () #29 0x0000000000000000 in ?? () #30 0x0000000000000000 in ?? () #31 0x0000000000000000 in ?? () #32 0x0000000000000004 in ?? () #33 0x0000000000000000 in ?? () #34 0x0000000000000000 in ?? () #35 0x0000000000000000 in ?? () #36 0x0000000000000010 in ?? () #37 0x0000000000000003 in ?? () #38 0x00007ffffe7eb908 in ?? () #39 0x0000000000000000 in ?? () #40 0x000000007962d2b0 in ?? () #41 0x0000000000000000 in ?? () #42 0x00007ffffe7eb980 in ?? () #43 0x00007ffffe7eba40 in ?? () #44 0x00000000413b7000 in AbstractInterpreter::_active_table () from /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/server/libjvm.so #45 0x000000007962d2e0 in ?? () #46 0x0000000000000001 in ?? () ---Type to continue, or q to quit--- #47 0x0000000048a7b422 in ?? () #193 0x00007ffffe7ebb60 in ?? () #194 0x00000000413be720 in StubRoutines::_catch_exception_entry () from /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/server/libjvm.so #195 0x0000000000000001 in ?? () #196 0x0000000000c02400 in ?? () #197 0x00000000452122a9 in ?? () #198 0x00007ffffe7ebb90 in ?? () #199 0x00007ffffe7ebdb8 in ?? () #200 0x000000000000000a in ?? () #201 0x00000000483205f8 in ?? () #202 0x000000004521cb60 in ?? () #203 0x00007ffffe7ebd08 in ?? () #204 0x00007ffffe7ebc10 in ?? () #205 0x0000000040e26bf3 in JavaCalls::call_helper () from /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/server/libjvm.so Previous frame inner to this frame (corrupt stack?) --Apple-Mail-4-77470170 content-type: application/pgp-signature; x-mac-type=70674453; name=PGP.sig content-description: This is a digitally signed message part content-disposition: inline; filename=PGP.sig content-transfer-encoding: 7bit -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (Darwin) iEYEARECAAYFAklK0kAACgkQYO3xN0CxaGoHYACdGLJ8PdZiVhLKEApCA4QaYL+Z Y9EAmgN+1/W2pU3KaUWNJfKyyB2J2Kqj =UUNf -----END PGP SIGNATURE----- --Apple-Mail-4-77470170--