From owner-freebsd-hackers@FreeBSD.ORG Wed Apr 9 10:15:23 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 83184375; Wed, 9 Apr 2014 10:15:23 +0000 (UTC) Received: from mail.tdx.com (mail.tdx.com [62.13.128.18]) by mx1.freebsd.org (Postfix) with ESMTP id 36CC8116E; Wed, 9 Apr 2014 10:15:22 +0000 (UTC) Received: from Mail-PC.tdx.co.uk (storm.tdx.co.uk [62.13.130.251]) (authenticated bits=0) by mail.tdx.com (8.14.3/8.14.3/) with ESMTP id s39AFKxP058681 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Wed, 9 Apr 2014 11:15:21 +0100 (BST) Date: Wed, 09 Apr 2014 11:15:20 +0100 From: Karl Pielorz To: Konstantin Belousov Subject: Re: Stuck CLOSED sockets / sshd / zombies... Message-ID: <2A722BB3B12E0D80CA9FF075@Mail-PC.tdx.co.uk> In-Reply-To: <20140409084951.GE21331@kib.kiev.ua> References: <3FE645E9723756F22EF901AE@Mail-PC.tdx.co.uk> <20140408164353.GB21331@kib.kiev.ua> <277FA3F7B4E7A98921F4D631@study64.tdx.co.uk> <201404081533.53990.jhb@freebsd.org> <92366925229B4C5B21B04D81@study64.tdx.co.uk> <20140408212319.GC21331@kib.kiev.ua> <20140409084951.GE21331@kib.kiev.ua> X-Mailer: Mulberry/4.0.8 (Win32) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline Cc: freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Apr 2014 10:15:23 -0000 --On 09 April 2014 11:49 +0300 Konstantin Belousov wrote: > Hm, I think my instructions were flawed, you have to install with > DEBUG_FLAGS as well: > make install DEBUG_FLAGS=-g > > You do not need to re-run the tests if rtld did not changed after > the installation. Reinstall and get the backtrace again, please. Ok, did that - output below, -Karl --- " [Switching to LWP 100218] 0x00000008038ea89c in __error () from /lib/libthr.so.3 (gdb) bt #0 0x00000008038ea89c in __error () from /lib/libthr.so.3 #1 0x00000008038e104f in __thr_rwlock_rdlock (rwlock=0x803af9480, flags=, tsp=) at /usr/src/lib/libthr/thread/thr_umtx.c:277 #2 0x00000008038e821c in _thr_rtld_rlock_acquire (lock=0x803af9480) at atomic.h:143 #3 0x000000080064f9a2 in digest_dynamic1 (obj=0x80085fe00, early=32767, dyn_rpath=0x80582a93c, dyn_soname=0x80582a93c, dyn_runpath=0x7fffffffba30) at /usr/src/libexec/rtld-elf/rtld.c:1103 #4 0x00000008006498c9 in objlist_call_init (list=, lockstate=0x0) at /usr/src/libexec/rtld-elf/rtld.c:287 #5 0x00000008006470cd in _rtld_bind_start () at /usr/src/libexec/rtld-elf/amd64/rtld_start.S:121 #6 0x000000000041072c in grace_alarm_handler (sig=-17504) at /usr/src/secure/usr.sbin/sshd/../../../crypto/openssh/sshd.c:378 #7 #8 0x00000008038ea89c in __error () from /lib/libthr.so.3 #9 0x00000008038e104f in __thr_rwlock_rdlock (rwlock=0x803af9480, flags=, tsp=) at /usr/src/lib/libthr/thread/thr_umtx.c:277 #10 0x00000008038e821c in _thr_rtld_rlock_acquire (lock=0x803af9480) at atomic.h:143 #11 0x000000080064f9a2 in digest_dynamic1 (obj=0x80085fe00, early=32767, dyn_rpath=0x8038d8e30, dyn_soname=0x100000001, dyn_runpath=0x7fffffffc040) at /usr/src/libexec/rtld-elf/rtld.c:1103 #12 0x00000008006498c9 in objlist_call_init (list=, lockstate=0xffff00001f80) at /usr/src/libexec/rtld-elf/rtld.c:287 #13 0x00000008006470cd in _rtld_bind_start () at /usr/src/libexec/rtld-elf/amd64/rtld_start.S:121 #14 0x000000000042f9dd in sshpam_sigchld_handler (sig=) at /usr/src/secure/usr.sbin/sshd/../../../crypto/openssh/auth-pam.c:152 #15 #16 0x0000000800653aea in lmc_parse () at /usr/src/libexec/rtld-elf/libmap.c:306 #17 0x000000080064a835 in objlist_call_fini () at /usr/src/libexec/rtld-elf/rtld.c:2267 #18 0x000000080064a1eb in symlook_default (req=0x7fffffffd050, refobj=) at /usr/src/libexec/rtld-elf/rtld.c:3620 #19 0x0000000800edd121 in openpam_clear_chains () from /usr/lib/libpam.so.5 #20 0x0000000800edd0bc in openpam_clear_chains () from /usr/lib/libpam.so.5 #21 0x0000000800edd0bc in openpam_clear_chains () from /usr/lib/libpam.so.5 #22 0x0000000800edd061 in openpam_clear_chains () from /usr/lib/libpam.so.5 #23 0x0000000800ed99e7 in pam_end () from /usr/lib/libpam.so.5 #24 0x000000000042e15d in sshpam_cleanup () at /usr/src/secure/usr.sbin/sshd/../../../crypto/openssh/auth-pam.c:614 #25 0x000000000041d58f in do_cleanup (authctxt=0x80401a600) at /usr/src/secure/usr.sbin/sshd/../../../crypto/openssh/session.c:2732 #26 0x000000000041064f in ssh_cleanup_exit (i=255) at /usr/src/secure/usr.sbin/sshd/../../../crypto/openssh/sshd.c:2545 #27 0x0000000000428f83 in mm_request_receive (sock=, m=) at /usr/src/secure/usr.sbin/sshd/../../../crypto/openssh/monitor_wrap.c:153 #28 0x0000000000427e26 in monitor_read (pmonitor=0x804022220, ent=0x6465a0, pent=0x7fffffffd0c0) at /usr/src/secure/usr.sbin/sshd/../../../crypto/openssh/monitor.c:593 #29 0x0000000000427b49 in monitor_child_preauth (_authctxt=, pmonitor=0x804022220) at /usr/src/secure/usr.sbin/sshd/../../../crypto/openssh/monitor.c:387 #30 0x000000000040fd15 in main (ac=, av=) at /usr/src/secure/usr.sbin/sshd/../../../crypto/openssh/sshd.c:679 "