Date: Tue, 24 Jun 2008 16:16:05 +0300 From: Stefan Lambrev <stefan.lambrev@moneybookers.com> To: Paul <paul@gtcomm.net> Cc: "freebsd-net@freebsd.org" <freebsd-net@freebsd.org> Subject: Re: jboss4 on freebsd Message-ID: <4860F395.1010000@moneybookers.com> In-Reply-To: <4860F0FA.1010707@gtcomm.net> References: <4860EF76.1050807@moneybookers.com> <4860F0FA.1010707@gtcomm.net>
next in thread | previous in thread | raw e-mail | index | archive | help
Paul wrote: > kern.ipc.nmbclusters=128000 changed - no effect > > Check output from netstat -m, this shows network buffers. 770/8200/8970 mbufs in use (current/cache/total) 768/5426/6194/128000 mbuf clusters in use (current/cache/total/max) 768/5248 mbuf+clusters out of packet secondary zone in use (current/cache) 0/677/677/12800 4k (page size) jumbo clusters in use (current/cache/total/max) 0/0/0/6400 9k jumbo clusters in use (current/cache/total/max) 0/0/0/3200 16k jumbo clusters in use (current/cache/total/max) 1728K/15610K/17338K bytes allocated to network (current/cache/total) 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters) 0/0/0 requests for jumbo clusters denied (4k/9k/16k) 0/0/0 sfbufs in use (current/peak/max) 0 requests for sfbufs denied 0 requests for sfbufs delayed 73 requests for I/O initiated by sendfile 0 calls to protocol drain routines This output is in the same second as I see no buffer space available .. isn't this weird? > > > Stefan Lambrev wrote: >> Greetings, >> >> I'm experimenting with jboss4 cluster under freebsd 7 (amd64). >> In my configuration I have 2 jboss instances which are in cluster and >> they communicate via separate network (used only for shared data) >> When I create some load on the application sometimes I see this error: >> >> 2008-06-24 14:46:21,602 ERROR [org.jgroups.protocols.UDP] failed >> sending message to 10.50.1.1:57680 (59800 bytes) >> java.io.IOException: No buffer space available >> >> It looks very much, that jboss can't handle properly such error as on >> linux there is no such thing as no network buffers ;) - >> http://wiki.freebsd.org/AvoidingLinuxisms >> >> But what really bothers me is that I see "No buffer space available" >> on very low network IO - >> >> input (em2) output >> packets errs bytes packets errs bytes colls >> 144 0 2203390 292 0 2072771 0 >> 1568 0 2329764 63 0 9099 0 >> 76 0 231562 34 0 148306 0 >> 563 0 1152531 1009 0 1768748 0 >> 1625 0 2601502 104 0 229728 0 >> 65 0 467296 85 0 441566 0 >> 464 0 680082 973 0 1439442 0 >> 357 0 1940361 55 0 222484 0 >> 1651 0 2827932 145 0 450265 0 >> >> E.g. traffic between 1-3MB/s. >> >> I'm using: >> em2: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu >> 9000 >> >> options=19b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4> >> ether 00:15:17:60:04:c8 >> inet 10.3.3.117 netmask 0xffffff00 broadcast 10.3.3.255 >> media: Ethernet autoselect (1000baseTX <full-duplex>) >> status: active >> >> em2: <Intel(R) PRO/1000 Network Connection 6.9.5> port 0x2020-0x203f >> mem 0xb8820000-0xb883ffff,0xb8400000-0xb87fffff irq 18 at device 0.0 >> on pci5 >> em2: Using MSI interrupt >> em2: [FILTER] >> >> and my sysctl.conf is: >> kern.maxfiles=65000 >> kern.ipc.shmmax=67108864 >> kern.fallback_elf_brand=3 >> kern.threads.max_threads_per_proc=6000 >> kern.ipc.somaxconn=512 >> #jboss extra >> net.inet.udp.maxdgram=73728 >> kern.ipc.maxsockbuf=1048576 >> net.inet.udp.recvspace=147456 >> kern.ipc.maxsockets=49312 >> >> Any ideas how I can improve things? >> > -- Best Wishes, Stefan Lambrev ICQ# 24134177
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4860F395.1010000>