Date: Wed, 19 Sep 2001 15:00:18 -0700 From: Mark Mayo <mmayo@360networks.net> To: "Gregory (Grisha) Trubetskoy" <grisha@verio.net> Cc: Jesper Skriver <jesper@skriver.dk>, freebsd-hubs@freebsd.org Subject: Re: 4.4 Availability Message-ID: <20010919150018.A40202@360networks.net> In-Reply-To: <Pine.BSF.4.32.0109191610120.99936-100000@localhost>; from grisha@verio.net on Wed, Sep 19, 2001 at 04:23:25PM -0400 References: <20010919220258.F79240@skriver.dk> <Pine.BSF.4.32.0109191610120.99936-100000@localhost>
next in thread | previous in thread | raw e-mail | index | archive | help
On Wed, Sep 19, 2001 at 04:23:25PM -0400, Gregory (Grisha) Trubetskoy wrote:
>
> ftp2 can't really do more than 100Mbps since it's on 100Mb link, but it
> sure tried today to get as close to 100 as it could.
>
> I'm seeing sporadic freezes, during which I get no response for up to 2
> minutes. The machine stays up, but won't even respond to ICMP. This can be
> seen on the graph below.
Sounds just like ftp.ca.freebsd.org :) I ran out of mbufs, which it
would appear you have as well:
> [16:16:42 root@ftp2 /usr/home/grisha]# netstat -m
> 2916/6416/18432 mbufs in use (current/peak/max):
> 2428 mbufs allocated to data
> 488 mbufs allocated to packet headers
> 2243/4608/4608 mbuf clusters in use (current/peak/max)
^^^^^^^^^
I moved to
options NMBCLUSTERS=32768
in my kernel conf, rebooted, and now it's holding up. Machine has a Gig
of RAM and a couple 15k disks in it, and a single 866MHz PII. Moving
between 70 and 80 MBit/sec right now, and it looks like I'll probably
have enough breathing room with the disk/CPU to saturate the 100Mbit/s
ethernet link, if demand grows. Using proftpd, FWIW. A bit of a memory
hog.. should probably switch to stock ftpd with tcpserver.
-Mark
>
> On Wed, 19 Sep 2001, Jesper Skriver wrote:
>
> > On Wed, Sep 19, 2001 at 10:06:46AM -0400, Gregory (Grisha) Trubetskoy wrote:
> > >
> > >
> > > This is fun to watch:
> > >
> > > ftp://ftp2.freebsd.org/etc/traffic-day.gif
> > >
> > > Traffic went from 5 to 35 megabits on ftp2 in the past couple of hours.
> >
> > ftp.FreeBSD.org has pushed between 200 and 260 Mbps most of the
> > day.
> >
> > But there's a problem, when the number of connections increase to
> > more than approx 900, the load skyrockets, often with a loadindex
> > of 150 or more :-(
> >
> > This is using the stock ftpd from FreeBSD - it was worse using
> > dgftp, havn't figured why yet.
> >
> > Currently ftpd is started from tcpserver, which allows to limit
> > the number of concurrent connections, which helps to keep the load
> > under control.
> >
> > A current snapshot:
> >
> > jesper@ftp% vmstat 1
> > procs memory page disks faults cpu
> > r b w avm fre flt re pi po fr sr da0 da1 in sy cs us sy id
> > 137 9 0 375124109428 337 0 0 0 1811 1625 0 224 5390 3322 54380 1 80 19
> > 18415 0 379112 84108 839 0 0 0 6404 0 0 244 14738 6646 283041 1 99 0
> > 23011 0 379764 73868 645 0 0 0 2829 0 1 117 6997 8067 108663 1 99 0
> > 21413 0 379536102636 855 0 0 0 14339 21608 2 180 34044 13818 711264 0 100 0
> > 19616 0 379948 70680 520 0 0 0 7760 0 0 177 18985 4797 399380 1 99 0
> > 21618 0 378992102292 125 7 0 0 2694 10744 0 154 7207 1426 155766 0 100 0
> > 19317 0 379460 88880 388 0 1 0 3269 0 1 177 7419 2344 139995 0 100 0
> > 19119 0 376524105820 567 0 0 0 6599 10775 0 146 15907 3559 353796 0 100 0
> > 17614 0 373716 74020 231 0 0 0 7512 0 0 147 18143 3417 430951 1 99 0
> >
> > jesper@ftp% ps aux | grep ^ftp | wc -l
> > 840
> >
> > PS: It's a dual 800 MHz PIII with 2 GB of memory, storage is raid5
> > using a adaptec 3210 controller, but it's not disk I/O that's
> > the problem.
> >
> > /Jesper
> >
> > --
> > Jesper Skriver, jesper(at)skriver(dot)dk - CCIE #5456
> > Work: Network manager @ AS3292 (Tele Danmark DataNetworks)
> > Private: FreeBSD committer @ AS2109 (A much smaller network ;-)
> >
> > One Unix to rule them all, One Resolver to find them,
> > One IP to bring them all and in the zone to bind them.
> >
>
>
> To Unsubscribe: send mail to majordomo@FreeBSD.org
> with "unsubscribe freebsd-hubs" in the body of the message
To Unsubscribe: send mail to majordomo@FreeBSD.org
with "unsubscribe freebsd-hubs" in the body of the message
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20010919150018.A40202>