From owner-freebsd-threads@FreeBSD.ORG Sun Nov 12 15:52:46 2006 Return-Path: X-Original-To: threads@freebsd.org Delivered-To: freebsd-threads@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E5EA116A417; Sun, 12 Nov 2006 15:52:46 +0000 (UTC) (envelope-from julian@elischer.org) Received: from customer-domains.icp-qv1-irony14.iinet.net.au (customer-domains.icp-qv1-irony14.iinet.net.au [203.59.1.169]) by mx1.FreeBSD.org (Postfix) with ESMTP id EBABE43D6A; Sun, 12 Nov 2006 15:52:45 +0000 (GMT) (envelope-from julian@elischer.org) Received: from 203-59-110-253.dyn.iinet.net.au (HELO [10.1.1.3]) ([203.59.110.253]) by iinet-mail.icp-qv1-irony14.iinet.net.au with ESMTP; 12 Nov 2006 23:52:43 +0800 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AgAAAErQVkXLO279VWdsb2JhbAANjDYBKw X-IronPort-AV: i="4.09,414,1157299200"; d="scan'208"; a="24117918:sNHT16434684" Message-ID: <4557434C.7080106@elischer.org> Date: Sun, 12 Nov 2006 07:52:44 -0800 From: Julian Elischer User-Agent: Thunderbird 1.5.0.8 (Macintosh/20061025) MIME-Version: 1.0 To: Chris References: <20061110151247.GA64530@zone3000.net> <3aaaa3a0611111503m319808cu7e1f710970350044@mail.gmail.com> In-Reply-To: <3aaaa3a0611111503m319808cu7e1f710970350044@mail.gmail.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: threads@freebsd.org, freebsd-current@freebsd.org Subject: Re: libpthread vs libthr. X-BeenThere: freebsd-threads@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Threading on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 12 Nov 2006 15:52:47 -0000 Chris wrote: [...] > > > HI I posted in another thread about how my own experiences seem to > differ from all these benchmarks, they are based on 3 heavily loaded > web/mysql servers. > > One is freebsd 6.1 dual core cpu (not htt). 2nd is dual xeon freebsd > 6.1 and 3rd is another dual xeon freebsd 6.1. > > All 3 of these machines perform better as well as more stable under > higher loads using libpthread process scope. > > System scope appears to make mysql hog the system and everything slows > down except of course mysql. Is this libpthread "system scope" or libthr (which has system scope by default)? > > Libthr appears to make mysql very sporadic with some requests fast > others with a unexplained 5-10 sec delay including timeouts. > > Process scope on libpthread gives me the best results not making mysql > starve the server of resources and it has a consistent response time > of under 2 seconds under heavy loads. this is interesting.. there has been a call to remove "fairness" as a threading property as it complicates the scheduler. It has been said by many that they do not consider this as an important feature and it reduces throughput. > > I cant explain other then it maybe that test mysql data isnt a proper > way to test these threading libraries only real work loads can. > > Chris > _______________________________________________ > freebsd-current@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" From owner-freebsd-threads@FreeBSD.ORG Sun Nov 12 19:13:51 2006 Return-Path: X-Original-To: threads@freebsd.org Delivered-To: freebsd-threads@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7476016A415; Sun, 12 Nov 2006 19:13:51 +0000 (UTC) (envelope-from ivoras@freebsd.org) Received: from ls405.htnet.hr (ls405.t-com.hr [195.29.150.135]) by mx1.FreeBSD.org (Postfix) with ESMTP id B4EAE43D7F; Sun, 12 Nov 2006 19:13:23 +0000 (GMT) (envelope-from ivoras@freebsd.org) Received: from ls242.t-com.hr (ls242.t-com.hr [195.29.150.134]) by ls405.htnet.hr (Postfix) with ESMTP id F1FEA14658B; Sun, 12 Nov 2006 20:13:21 +0100 (CET) Received: from ls242.t-com.hr (localhost.localdomain [127.0.0.1]) by ls242.t-com.hr (Qmlai) with ESMTP id D3D7A10F8055; Sun, 12 Nov 2006 20:13:21 +0100 (CET) Received: from ls242.t-com.hr (localhost.localdomain [127.0.0.1]) by ls242.t-com.hr (Qmlai) with ESMTP id BC7BC10F8057; Sun, 12 Nov 2006 20:13:21 +0100 (CET) X-Envelope-Sender-Info: qNMqIwJL6pMxrLsv6Bv6Q+DON6a015vxOcE6sDDdqLFwavEOfecH+Ec8BH2pviS1 X-Envelope-Sender: ivoras@freebsd.org Received: from [10.0.0.100] (89-172-63-161.adsl.net.t-com.hr [89.172.63.161])by ls242.t-com.hr (Qmali) with ESMTP id 95B086C0036; Sun, 12 Nov 2006 20:13:21 +0100 (CET) Message-ID: <4557725B.2060804@freebsd.org> Date: Sun, 12 Nov 2006 20:13:31 +0100 From: Ivan Voras User-Agent: Thunderbird 1.5.0.8 (Windows/20061025) MIME-Version: 1.0 References: <20061110151247.GA64530@zone3000.net> <3aaaa3a0611111503m319808c u7e1f710970350044@mail.gmail.com> <4557434C.7080106@elischer.org> In-Reply-To: <4557434C.7080106@elischer.org> X-Enigmail-Version: 0.94.0.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-imss-version: 2.044 X-imss-result: Passed X-imss-scanInfo: M:P L:N SM:0 X-imss-tmaseResult: TT:0 TS:0.0000 TC:00 TRN:0 TV:3.6.1039(14806.003) X-imss-scores: Clean:6.13759 C:2 M:3 S:5 R:5 X-imss-settings: Baseline:3 C:3 M:3 S:3 R:3 (0.5000 0.5000) Cc: threads@freebsd.org, freebsd-current@freebsd.org Subject: Re: libpthread vs libthr. X-BeenThere: freebsd-threads@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: ivoras@fer.hr List-Id: Threading on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 12 Nov 2006 19:13:51 -0000 Julian Elischer wrote: > this is interesting.. there has been a call to remove "fairness" > as a threading property as it complicates the scheduler. > It has been said by many that they do not consider this as an important > feature and it reduces throughput. IMO both sides are right and fairness should be optional. It will certainly help some workloads and harm others; leaving it as a (default) kernel compile option is fine for now, as long as it's documented how to toggle it (in pthread man page at least). From owner-freebsd-threads@FreeBSD.ORG Mon Nov 13 11:08:41 2006 Return-Path: X-Original-To: freebsd-threads@FreeBSD.org Delivered-To: freebsd-threads@FreeBSD.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4B19A16A492 for ; Mon, 13 Nov 2006 11:08:41 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [216.136.204.21]) by mx1.FreeBSD.org (Postfix) with ESMTP id 15CCA43D5A for ; Mon, 13 Nov 2006 11:08:41 +0000 (GMT) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (linimon@localhost [127.0.0.1]) by freefall.freebsd.org (8.13.4/8.13.4) with ESMTP id kADB8emc091615 for ; Mon, 13 Nov 2006 11:08:40 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from linimon@localhost) by freefall.freebsd.org (8.13.4/8.13.4/Submit) id kADB8diB091610 for freebsd-threads@FreeBSD.org; Mon, 13 Nov 2006 11:08:39 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 13 Nov 2006 11:08:39 GMT Message-Id: <200611131108.kADB8diB091610@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: linimon set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-threads@FreeBSD.org Cc: Subject: Current problem reports assigned to you X-BeenThere: freebsd-threads@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Threading on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 13 Nov 2006 11:08:41 -0000 Current FreeBSD problem reports Critical problems S Tracker Resp. Description -------------------------------------------------------------------------------- s threa/76690 threads fork hang in child for -lc_r 1 problem total. Serious problems S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/20016 threads pthreads: Cannot set scheduling timer/Cannot set virtu s threa/24472 threads libc_r does not honor SO_SNDTIMEO/SO_RCVTIMEO socket o s threa/24632 threads libc_r delicate deviation from libc in handling SIGCHL s bin/32295 threads pthread dont dequeue signals s threa/34536 threads accept() blocks other threads o kern/38549 threads the procces compiled whith pthread stopped in pthread_ s threa/39922 threads [threads] [patch] Threaded applications executed with s threa/48856 threads Setting SIGCHLD to SIG_IGN still leaves zombies under s threa/49087 threads Signals lost in programs linked with libc_r s kern/64313 threads FreeBSD (OpenBSD) pthread implicit set/unset O_NONBLOC o threa/70975 threads unexpected and unreliable behaviour when using SYSV se o threa/72353 threads Assertion fails in /usr/src/lib/libpthread/sys/lock.c, o threa/72429 threads threads blocked in stdio (fgets, etc) are not cancella o threa/72953 threads fork() unblocks blocked signals w/o PTHREAD_SCOPE_SYST o threa/75273 threads FBSD 5.3 libpthread (KSE) bug o threa/75374 threads pthread_kill() ignores SA_SIGINFO flag s threa/76694 threads fork cause hang in dup()/close() function in child (-l o threa/79683 threads svctcp_create() fails if multiple threads call at the o threa/80435 threads panic on high loads o threa/83914 threads [libc] popen() doesn't work in static threaded program s threa/84483 threads problems with devel/nspr and -lc_r on 4.x o threa/85160 threads [libthr] [patch] libobjc + libpthread/libthr crash pro o threa/90278 threads libthr, ULE and -current produces >100% WCPU with apac o kern/91266 threads [threads] Trying sleep, but thread marked as sleeping s threa/94467 threads send(), sendto() and sendmsg() are not correct in libc f threa/98256 threads gnome-system-monitor core dumps from pthread_testcance s threa/100815 threads FBSD 5.5 broke nanosleep in libc_r o threa/101323 threads fork(2) in threaded programs broken. o threa/103975 threads Implicit loading/unloading of libpthread.so may crash 29 problems total. Non-critical problems S Tracker Resp. Description -------------------------------------------------------------------------------- s kern/19247 threads uthread_sigaction.c does not do anything wrt SA_NOCLDW s kern/22190 threads A threaded read(2) from a socketpair(2) fd can sometim s threa/30464 threads pthread mutex attributes -- pshared s threa/37676 threads libc_r: msgsnd(), msgrcv(), pread(), pwrite() need wra s threa/40671 threads pthread_cancel doesn't remove thread from condition qu s threa/69020 threads pthreads library leaks _gc_mutex o threa/74180 threads KSE problem. Applications those riched maximum possibl o threa/79887 threads [patch] freopen() isn't thread-safe o threa/80992 threads abort() sometimes not caught by gdb depending on threa o threa/81534 threads [libc_r] [patch] libc_r close() will fail on any fd ty 10 problems total.