Date: Tue, 20 Mar 2001 12:21:56 -0600 From: "Michael C . Wu" <keichii@iteration.net> To: Alfred Perlstein <bright@wintelcom.net> Cc: izero@ms26.hinet.net, cross@math.psu.edu, "Michael C . Wu" <keichii@iteration.net>, dillon@FreeBSD.ORG, grog@FreeBSD.ORG, fs@FreeBSD.ORG, hackers@FreeBSD.ORG Subject: Re: tuning a VERY heavily (30.0) loaded scerver Message-ID: <20010320122156.A53182@peorth.iteration.net> In-Reply-To: <20010320100909.T29888@fw.wintelcom.net>; from bright@wintelcom.net on Tue, Mar 20, 2001 at 10:09:09AM -0800 References: <20010320111144.A51924@peorth.iteration.net> <20010320092717.R29888@fw.wintelcom.net> <20010320113818.B52586@peorth.iteration.net> <20010320120112.C52586@peorth.iteration.net> <20010320100909.T29888@fw.wintelcom.net>
next in thread | previous in thread | raw e-mail | index | archive | help
On Tue, Mar 20, 2001 at 10:09:09AM -0800, Alfred Perlstein scribbled: | * Michael C . Wu <keichii@iteration.net> [010320 10:01] wrote: | > MRTG Graph at | > http://zoonews.ee.ntu.edu.tw/mrtg/zoo.html | > | > | | > | FreeBSD zoo.ee.ntu.edu.tw 4.2-STABLE FreeBSD 4.2-STABLE | > | #0: Tue Mar 20 11:10:46 CST 2001 root@:/usr/src/sys/compile/SimFarm i386 | > | | > | | > system stats at | > | | > http://zoo.ee.ntu.edu.tw/~keichii/ | > | md0/MFS is used for caching the articles that BBS users read. | > | They often read the same articles over and over again, | > | and we find that a 128MB MFS/md0 will have 70% hitrate | > | | > | When our MFS/md0 fills up after long usage, the box easily | > | dies. (We crontab clean the mfs, but sometimes the load | > | shoots up for no reason and is not able to clean the mfs in time.) | > | If we dont do this cache, the data for the bulletin boards | > | | > | > Another problem is that we have around 4000+ processes accessing | > lots of SHM at the same time.. | | How much SHM? Like, what's the combined size of all segments in | the system? You can make SHM non-pageable which results in a lot | of saved memory for attached processes. | ipcs -b Shared Memory: T ID KEY MODE OWNER GROUP SEGSZ m 65536 1304 --rw------- bbs bbs 131076 m 65537 1217 --rw------- bbs wheel 1633728 m 65538 1215 --rw------- bbs wheel 768016 m 65539 1219 --rw------- bbs bbs 2065956 m 65540 1111 --rw------- bbs bbs 12 m 65541 1302 --rw------- bbs bbs 40016 m 65542 1303 --rw------- bbs bbs 40016 m 65543 1201 --rw------- bbs bbs 33328 m 65544 1301 --rw------- bbs bbs 33328 VM_KMEM_SIZE_MAX When we raise this variable, the system dies easily, but on a similiarly configured system (bbs.kkcity.com.tw) at similiar load, It helps a lot to keep the system stable. We have a hashd daemon that uses 4300*2 unix domain sockets written in pthreads. There are eight of these daemons each serving about 500 bbsd's. | Revision 1.3.2.3 / (download) - annotate - [select for diffs], Sun Dec 17 02:05:41 2000 UTC (3 months ago) by alfred | Branch: RELENG_4 | Changes since 1.3.2.2: +37 -32 lines | Diff to previous 1.3.2.2 (colored) to branchpoint 1.3 (colored) next main 1.4 (colored) | | MFC: phys_pager fix for multiple segments | | Then set kern.ipc.shm_use_phys=1 O.K. | > The *UGLY* source code for the BBS is at | > http://zoo.ee.ntu.edu.tw/~keichii/zoo_bbsd_src.tgz | | tis ok, maybe later... though :) Someone asked me in private for this. :) -- +-----------------------------------------------------------+ | keichii@iteration.net | keichii@freebsd.org | | http://iteration.net/~keichii | Yes, BSD is a conspiracy. | +-----------------------------------------------------------+ To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-fs" in the body of the message
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20010320122156.A53182>