From owner-freebsd-hackers@FreeBSD.ORG Wed Apr 9 08:49:57 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id D11EC95A; Wed, 9 Apr 2014 08:49:57 +0000 (UTC) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 67A0C1780; Wed, 9 Apr 2014 08:49:57 +0000 (UTC) Received: from tom.home (kostik@localhost [127.0.0.1]) by kib.kiev.ua (8.14.8/8.14.8) with ESMTP id s398npg6022232; Wed, 9 Apr 2014 11:49:51 +0300 (EEST) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.8.3 kib.kiev.ua s398npg6022232 Received: (from kostik@localhost) by tom.home (8.14.8/8.14.8/Submit) id s398nptu022231; Wed, 9 Apr 2014 11:49:51 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Wed, 9 Apr 2014 11:49:51 +0300 From: Konstantin Belousov To: Karl Pielorz Subject: Re: Stuck CLOSED sockets / sshd / zombies... Message-ID: <20140409084951.GE21331@kib.kiev.ua> References: <3FE645E9723756F22EF901AE@Mail-PC.tdx.co.uk> <20140408164353.GB21331@kib.kiev.ua> <277FA3F7B4E7A98921F4D631@study64.tdx.co.uk> <201404081533.53990.jhb@freebsd.org> <92366925229B4C5B21B04D81@study64.tdx.co.uk> <20140408212319.GC21331@kib.kiev.ua> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="BhxIwg67zh/LWMpM" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.23 (2014-03-12) X-Spam-Status: No, score=-2.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FREEMAIL_FROM,NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.0 X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on tom.home Cc: freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Apr 2014 08:49:58 -0000 --BhxIwg67zh/LWMpM Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Apr 09, 2014 at 07:48:19AM +0100, Karl Pielorz wrote: >=20 >=20 > --On 9 April 2014 00:23:19 +0300 Konstantin Belousov =20 > wrote: >=20 > > Ok, so the patch sort of worked, but your rtld does not have debugging > > information for compiled .c files. Please, in the patched tree, do > > the following: > ... > > make DEBUG_FLAGS=3D-g DEBUG=3D-DDEBUG > ... >=20 > I only used 'DEBUG_FLAGS=3D-g' the first time round, I've redone now with= =20 > 'DEBUG=3D-DDEBUG' now: >=20 >=20 > " > [Switching to LWP 100218] > 0x00000008038ea89c in __error () from /lib/libthr.so.3 > (gdb) bt > #0 0x00000008038ea89c in __error () from /lib/libthr.so.3 > #1 0x00000008038e104f in __thr_rwlock_rdlock (rwlock=3D0x803af9480,=20 > flags=3D, tsp=3D) > at /usr/src/lib/libthr/thread/thr_umtx.c:277 > #2 0x00000008038e821c in _thr_rtld_rlock_acquire (lock=3D0x803af9480) at= =20 > atomic.h:143 > #3 0x000000080064f9a2 in _rtld_get_stack_prot () from /libexec/ld-elf.so= =2E1 > #4 0x00000008006498c9 in r_debug_state () from /libexec/ld-elf.so.1 > #5 0x00000008006470cd in .text () from /libexec/ld-elf.so.1 > #6 0x000000000041072c in grace_alarm_handler (sig=3D-17504) at=20 > /usr/src/secure/usr.sbin/sshd/../../../crypto/openssh/sshd.c:378 > #7 > #8 0x00000008038ea89c in __error () from /lib/libthr.so.3 > #9 0x00000008038e104f in __thr_rwlock_rdlock (rwlock=3D0x803af9480,=20 > flags=3D, tsp=3D) > at /usr/src/lib/libthr/thread/thr_umtx.c:277 > #10 0x00000008038e821c in _thr_rtld_rlock_acquire (lock=3D0x803af9480) at= =20 > atomic.h:143 > #11 0x000000080064f9a2 in _rtld_get_stack_prot () from /libexec/ld-elf.so= =2E1 > #12 0x00000008006498c9 in r_debug_state () from /libexec/ld-elf.so.1 > #13 0x00000008006470cd in .text () from /libexec/ld-elf.so.1 > #14 0x000000000042f9dd in sshpam_sigchld_handler (sig=3D out>) at=20 > /usr/src/secure/usr.sbin/sshd/../../../crypto/openssh/auth-pam.c:152 > #15 > #16 0x0000000800653aea in _rtld_atfork_post () from /libexec/ld-elf.so.1 > #17 0x000000080064a835 in dlclose () from /libexec/ld-elf.so.1 > #18 0x000000080064a1eb in r_debug_state () from /libexec/ld-elf.so.1 > #19 0x0000000800edd121 in openpam_clear_chains () from /usr/lib/libpam.so= =2E5 > #20 0x0000000800edd0bc in openpam_clear_chains () from /usr/lib/libpam.so= =2E5 > #21 0x0000000800edd0bc in openpam_clear_chains () from /usr/lib/libpam.so= =2E5 > #22 0x0000000800edd061 in openpam_clear_chains () from /usr/lib/libpam.so= =2E5 > #23 0x0000000800ed99e7 in pam_end () from /usr/lib/libpam.so.5 > #24 0x000000000042e15d in sshpam_cleanup () at=20 > /usr/src/secure/usr.sbin/sshd/../../../crypto/openssh/auth-pam.c:614 > #25 0x000000000041d58f in do_cleanup (authctxt=3D0x80401a600) at=20 > /usr/src/secure/usr.sbin/sshd/../../../crypto/openssh/session.c:2732 > #26 0x000000000041064f in ssh_cleanup_exit (i=3D255) at=20 > /usr/src/secure/usr.sbin/sshd/../../../crypto/openssh/sshd.c:2545 > #27 0x0000000000428f83 in mm_request_receive (sock=3D,=20 > m=3D) > at=20 > /usr/src/secure/usr.sbin/sshd/../../../crypto/openssh/monitor_wrap.c:153 > #28 0x0000000000427e26 in monitor_read (pmonitor=3D0x804022220,=20 > ent=3D0x6465a0, pent=3D0x7fffffffd0c0) > at /usr/src/secure/usr.sbin/sshd/../../../crypto/openssh/monitor.c:593 > #29 0x0000000000427b49 in monitor_child_preauth (_authctxt=3D optimized out>, pmonitor=3D0x804022220) > at /usr/src/secure/usr.sbin/sshd/../../../crypto/openssh/monitor.c:387 > #30 0x000000000040fd15 in main (ac=3D, av=3D optimized out>) at=20 > /usr/src/secure/usr.sbin/sshd/../../../crypto/openssh/sshd.c:679 > " >=20 > At a quick/untrained glance the output doesn't look any different? :( Hm, I think my instructions were flawed, you have to install with DEBUG_FLAGS as well: make install DEBUG_FLAGS=3D-g You do not need to re-run the tests if rtld did not changed after the installation. Reinstall and get the backtrace again, please. --BhxIwg67zh/LWMpM Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (FreeBSD) iQIcBAEBAgAGBQJTRQmuAAoJEJDCuSvBvK1BKrUP/i9lyQxoZcxI04eU0B4IML1X YssUgqZM9+q6twuJOhV+l77yn/w065py93DS8h59Oe3Dlkmmz3ZFm5ES/7qxU54X NJjgAE143pt5MI+ItiVUi1Vp5h6GLc0MOJAqaAb9mcQYimp8Pnbs1q5yopdsGKvv 1Sowc0jvxghWejsxWlG49saBlaeffYP/rYIMafdgAd0P6XwpZr+JxKymHzsvwpk4 0jFOfwR4TK3LLWOgz56NIqrg3Hok8TPusjxEVKvbJb1isyBrlw/FOO3ztiDla1KX d9vz0fBytIlC0cypQMIWVsXTlv5Fyw+DH9FSBWOXGRrt5bFOjVB1A0ezd7Fq5yB6 o1VokmTHW5+XCJpPOPKlwdjBtFGG6P0HYJ7dWMHRbGgEm2Am3YLCdwr4n3oFH70G 32XdjHbN48b6eDCCK9ANAhJiA7figo64alINUYro7elD58sHyXVhaXdHV9HRNe2A PzMPt450uSmjXykYRRgLGp/yxS6YTDiCgmKW84r1dJzVqFgYGpJL0Y0WMIIaxm60 zLZib5nuSkSUJJ57jojvvXmgmmq0iLYNuzgTU5oFIzxqKfcQJEaNSS2ofjqUY0pC L0M5n5BiodFwgJS9tJLhZUVUJNv9wJVkoXVgU5EUoxrTUCY+SWjc4TslApcGIhDP yojLkg7nm6+3PTngHcWk =XpLd -----END PGP SIGNATURE----- --BhxIwg67zh/LWMpM--