From owner-freebsd-smp@FreeBSD.ORG Mon Feb 13 17:23:31 2006 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D71EC16A422 for ; Mon, 13 Feb 2006 17:23:31 +0000 (GMT) (envelope-from astatech@mail.ru) Received: from f25.mail.ru (f25.mail.ru [194.67.57.151]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2DF5B43D83 for ; Mon, 13 Feb 2006 17:23:20 +0000 (GMT) (envelope-from astatech@mail.ru) Received: from mail by f25.mail.ru with local id 1F8hPz-0005JN-00; Mon, 13 Feb 2006 20:23:19 +0300 Received: from [82.204.131.122] by win.mail.ru with HTTP; Mon, 13 Feb 2006 20:23:19 +0300 From: astatech@mail.ru To: Joseph Koshy Mime-Version: 1.0 X-Mailer: mPOP Web-Mail 2.19 X-Originating-IP: [82.204.131.122] Date: Mon, 13 Feb 2006 20:23:19 +0300 In-Reply-To: <84dead720602081124o651693ccy7920658a54d97e61@mail.gmail.com> Content-Type: text/plain; charset=koi8-r Content-Transfer-Encoding: 8bit Message-Id: Cc: freebsd-smp@freebsd.org Subject: Next iteration X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: astatech@mail.ru List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 13 Feb 2006 17:23:32 -0000 Hi! Sorry for my timeout... I can't start kldstat: root@bsd# kldload hwpmc root@bsd# pmcstat -S k8-bu-cpu-clk-unhalted -O /tmp/logfile pmcstat: ERROR: Initialization of the pmc(3) library failed: No such file or directory What is wrong? What I did: - changed mount uptions to async,noatime. - added to /etc/sysctl.conf vfs.vmiodirenable=1 kern.maxfiles=65536 net.inet.icmp.icmplim=300 kern.ipc.maxsockbuf=2097152 kern.ipc.somaxconn=8192 kern.ipc.maxsockets=16424 net.inet.tcp.rfc1323=1 net.inet.tcp.delayed_ack=0 net.inet.tcp.sendspace=65535 net.inet.tcp.recvspace=65535 net.inet.udp.recvspace=65535 net.inet.udp.maxdgram=57344 net.local.stream.recvspace=65535 net.local.stream.sendspace=65535 vm.exec_map_entries=128 - recompiling mysql with ./configure --prefix=/usr/local/ --without-libedit --without-readline --without-debug --without-bench --enable-thread-safe-client --enable-assembler --with-mysqld-ldflags=-all-static --with-client-ldflags=-all-static --with-extra-charsets=complex --with-named-thread-libs='-lpthread -D_THREAD_SAFE' Throughput improved by 5 times from 30 to 160, but server still have idle cycles. And throughput about 65-70% of Solaris. root@bsd# vmstat 5 99999 procs memory page disks faults cpu r b w avm fre flt re pi po fr sr da0 pa0 in sy cs us sy id 57 7 0 1437664 14685816 15880 0 1 0 15602 0 0 0 751 32946 4527 21 6 73 34 0 0 1414596 14709272 42496 0 0 0 44131 0 17 0 2234 107315 10897 60 15 25 25 18 3 1448772 14681704 45861 0 0 0 44197 0 51 0 2430 128607 14323 59 17 24 115 0 0 1475388 14667744 41516 0 0 0 41086 0 26 0 1893 99250 12311 55 18 27 48 10 2 1468312 14668900 44786 0 0 0 45002 0 21 0 2281 114561 14933 61 15 24 52 0 1 1465544 14663376 36861 0 0 0 36952 0 28 0 2139 106886 13897 51 16 33 40 1 4 1493980 14645444 46600 0 0 0 46322 0 16 0 1986 118531 12362 62 17 22 9 62 0 1433988 14680880 42577 0 0 0 44164 0 26 0 2516 112201 14278 58 15 27 29 22 3 1427156 14686252 41844 0 0 0 42137 0 114 0 2650 100774 12208 53 20 27 61 5 0 1454092 14660264 33276 0 0 0 32187 0 171 0 2345 95594 12969 44 13 43 72 0 0 1464848 14652860 43017 0 0 0 42969 0 13 0 1958 92878 10794 55 20 25 26 14 0 1439668 14668572 47654 0 0 0 48545 0 22 0 2164 122032 12913 60 17 23 60 1 1 1447260 14661812 48921 0 0 0 48618 0 6 0 2308 131291 15413 61 16 23 44 0 0 1464040 14647920 43565 0 0 0 43346 0 25 0 1974 102238 14174 52 17 30 29 1 0 1478040 14641844 48709 0 0 0 48523 0 17 0 2200 108484 10805 61 15 23 51 20 0 1444064 14656948 39772 0 0 0 40836 0 21 0 2223 105965 11112 57 19 23 46 0 0 1448308 14654368 45678 0 0 0 45765 0 13 0 2142 102726 12209 58 15 27 39 9 0 1450852 14646816 45919 0 0 0 46260 0 15 0 2018 113011 12957 59 14 26 89 1 1 1452640 14634792 36423 0 0 0 35692 0 17 0 1987 110922 12942 55 20 24 63 4 0 1442528 14649108 41640 0 0 0 41725 0 17 0 2358 116923 13326 61 14 25 43 0 0 1445940 14647980 47792 0 0 0 48728 0 17 0 2294 113538 13155 59 16 25 50 3 4 1492220 14606172 33088 0 0 0 31201 0 15 0 1771 108095 18050 59 18 23 59 0 1 1437268 14649388 46433 0 0 0 48720 0 16 0 2652 133756 15102 61 16 24 19 2 8 1421944 14656080 40356 0 0 0 40212 0 10 0 1982 113308 15619 61 18 22 root@bsd# top -b -i -s 5 -b -n 50 last pid: 860; load averages: 60.55, 38.98, 20.33 up 0+00:15:38 20:07:14 295 processes: 62 running, 233 sleeping Mem: 823M Active, 56M Inact, 288M Wired, 812K Cache, 214M Buf, 14G Free Swap: 3991M Total, 3991M Free PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 827 mysql 112 20 0 351M 131M kserel 0 8:00 30.13% mysqld 668 nobody 1 4 0 32540K 7928K sbwait 6 0:13 0.73% httpd 625 nobody 1 79 0 33748K 9148K CPU6 7 0:12 0.73% httpd 666 nobody 1 77 0 32640K 8028K RUN 5 0:12 0.73% httpd 655 nobody 1 4 0 33372K 8760K sbwait 4 0:12 0.73% httpd 619 nobody 1 4 0 36348K 10468K sbwait 7 0:12 0.73% httpd 719 nobody 1 4 0 36152K 10272K sbwait 1 0:11 0.73% httpd 687 nobody 1 4 0 35736K 9856K sbwait 2 0:11 0.73% httpd 728 nobody 1 4 0 35580K 9692K sbwait 2 0:11 0.73% httpd 582 nobody 1 -4 0 36368K 10488K RUN 5 0:11 0.73% httpd 710 nobody 1 -4 0 35532K 9644K RUN 5 0:15 0.00% httpd 718 nobody 1 4 0 35484K 9608K sbwait 0 0:14 0.00% httpd 607 nobody 1 -4 0 35788K 9904K RUN 5 0:14 0.00% httpd 610 nobody 1 -4 0 35768K 9888K RUN 5 0:14 0.00% httpd 620 nobody 1 4 0 35488K 9600K sbwait 5 0:14 0.00% httpd 673 nobody 1 -4 0 32800K 8188K RUN 5 0:13 0.00% httpd 709 nobody 1 4 0 35576K 9688K sbwait 6 0:13 0.00% httpd 652 nobody 1 4 0 33432K 8820K sbwait 3 0:13 0.00% httpd 638 nobody 1 4 0 32976K 8372K sbwait 2 0:13 0.00% httpd 616 nobody 1 -4 0 32536K 7932K RUN 5 0:13 0.00% httpd 591 nobody 1 -4 0 33304K 8512K RUN 5 0:13 0.00% httpd 658 nobody 1 4 0 35504K 9628K sbwait 7 0:13 0.00% httpd 589 nobody 1 77 0 35516K 9640K RUN 2 0:13 0.00% httpd 686 nobody 1 4 0 33288K 8684K sbwait 2 0:13 0.00% httpd 617 nobody 1 4 0 33480K 8696K sbwait 6 0:13 0.00% httpd 612 nobody 1 4 0 36212K 10344K sbwait 4 0:13 0.00% httpd 596 nobody 1 4 0 33432K 8816K sbwait 2 0:13 0.00% httpd 593 nobody 1 4 0 36460K 10580K sbwait 0 0:13 0.00% httpd 720 nobody 1 -4 0 36448K 10564K RUN 5 0:13 0.00% httpd 724 nobody 1 4 0 35768K 9892K sbwait 2 0:13 0.00% httpd 676 nobody 1 77 0 35748K 9868K RUN 0 0:13 0.00% httpd 688 nobody 1 4 0 35604K 9720K sbwait 2 0:13 0.00% httpd 665 nobody 1 4 0 33320K 8528K sbwait 5 0:13 0.00% httpd 670 nobody 1 -4 0 35576K 9700K RUN 5 0:13 0.00% httpd 650 nobody 1 -4 0 33480K 8688K RUN 5 0:13 0.00% httpd 600 nobody 1 4 0 35836K 9956K sbwait 6 0:13 0.00% httpd 662 nobody 1 -4 0 33140K 8532K RUN 2 0:13 0.00% httpd 583 nobody 1 -4 0 35760K 9880K RUN 5 0:13 0.00% httpd 590 nobody 1 4 0 35600K 9724K sbwait 2 0:13 0.00% httpd 706 nobody 1 4 0 32440K 7832K sbwait 6 0:13 0.00% httpd 643 nobody 1 -4 0 33252K 8640K RUN 5 0:12 0.00% httpd 622 nobody 1 4 0 35548K 9660K sbwait 0 0:12 0.00% httpd 641 nobody 1 78 0 32704K 8068K CPU3 5 0:12 0.00% httpd 621 nobody 1 4 0 32432K 7820K sbwait 6 0:12 0.00% httpd 671 nobody 1 4 0 32604K 7992K sbwait 7 0:12 0.00% httpd 672 nobody 1 4 0 36064K 10180K sbwait 6 0:12 0.00% httpd 704 nobody 1 4 0 36400K 10524K sbwait 2 0:12 0.00% httpd 680 nobody 1 -4 0 33344K 8560K RUN 5 0:12 0.00% httpd 627 nobody 1 4 0 32604K 8000K sbwait 6 0:12 0.00% httpd 729 nobody 1 4 0 33172K 8556K sbwait 7 0:12 0.00% httpd