Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 5 Oct 2000 09:26:04 -0400 (EDT)
From:      Tom Holmes <tom@thebiz.net>
To:        freebsd-questions@freebsd.org, freebsd-questions@freebsd.org
Subject:   Mysterious Lockups
Message-ID:  <Pine.LNX.4.21.0010050857240.6645-100000@harpua.thebiz.net>

next in thread | raw e-mail | index | archive | help

Hello All,

We have a couple of webservers that are in production that are getting
hosed on a regular basis and I'm at a loss right now on what the problem
is.  At first we thought it was the way that our logserver was dealing
with the logging but we started logging locally and that did not fix the
issue.  This is a compaq Alpha DS10 doing diskless booting.  The apache
setup is basically right out of the box other then the option for mass
virtual hosting and a patch to deal with our hashed style of user
directories.  I've included the output of the netstat right after it got
hosed as well as the kernel and apache information.  

Some other info is that this machine has a few aliased IP adresses to
support other ISPs on the local loopback device.  These machines sit
behind a Foundry ServerIron / FastIron for load balancing.  Public side
goes through the Foundry and the private side goes through a Cisco
Catalyst 4000.

Any help or thoughts on this would be great.  Thanks a bunch!

Server version: Apache/1.3.12 Ben-SSL/1.39 (Unix)
Server built:   May 31 2000 10:07:41

FreeBSD web2.thebiz.net 4.0-RELEASE FreeBSD 4.0-RELEASE #0: Tue Jul 11
13:35:02 EDT 2000
maz@web1.thebiz.net:/usr/src/sys/compile/DISKLESS-DS10  alpha

Active Internet connections (including servers)
Proto Recv-Q Send-Q  Local Address          Foreign Address        (state)
tcp4       0      4  172.16.0.70.23         172.16.0.20.45984      ESTABLISHED
tcp4     481      0  216.238.35.206.80      205.188.209.204.60080  CLOSE_WAIT
tcp4     378      0  216.238.35.204.80      24.95.170.63.1088      ESTABLISHED
tcp4     261      0  216.238.35.204.80      137.165.14.30.1068     ESTABLISHED
tcp4       0      0  216.238.35.204.80      63.166.164.200.61407   CLOSE_WAIT
tcp4       0      0  216.238.35.204.80      209.185.143.138.44638  CLOSE_WAIT
tcp4     166      0  216.238.35.204.80      209.185.143.138.63642  CLOSE_WAIT
tcp4       0      0  216.238.35.204.80      63.21.189.209.1093     CLOSE_WAIT
tcp4     355      0  216.238.35.204.80      63.99.105.163.8847     ESTABLISHED
tcp4     188      0  216.238.35.206.80      216.35.103.51.52629    CLOSE_WAIT
tcp4     332      0  216.238.35.204.80      63.99.105.163.9335     ESTABLISHED
tcp4     335      0  216.238.35.204.80      63.99.105.163.9334     ESTABLISHED
tcp4     340      0  216.238.35.204.80      63.99.105.163.9333     ESTABLISHED
tcp4     335      0  216.238.35.204.80      63.99.105.163.9320     ESTABLISHED
tcp4     335      0  216.238.35.204.80      63.99.105.163.9319     ESTABLISHED
tcp4     347      0  216.238.35.204.80      63.99.105.163.9317     ESTABLISHED
tcp4     148      0  216.238.35.206.80      208.171.252.37.4659    CLOSE_WAIT
tcp4     296      0  216.238.35.204.80      24.29.59.89.2119       CLOSE_WAIT
tcp4     366      0  216.238.35.204.80      12.34.109.82.43747     ESTABLISHED
tcp4     221      0  216.238.35.204.80      209.4.252.235.3592     ESTABLISHED
tcp4     270      0  216.238.35.206.80      149.106.33.22.1062     CLOSE_WAIT
tcp4     335      0  216.238.35.204.80      63.99.105.163.1970     CLOSE_WAIT
tcp4     340      0  216.238.35.204.80      63.99.105.163.1968     CLOSE_WAIT
tcp4     332      0  216.238.35.204.80      63.99.105.163.1967     CLOSE_WAIT
tcp4     197      0  216.238.35.206.80      216.35.103.53.53678    CLOSE_WAIT
tcp4     399      0  216.238.35.204.80      212.125.82.57.18666    ESTABLISHED
tcp4     316      0  216.238.35.204.80      24.29.59.89.2117       CLOSE_WAIT
tcp4     261      0  216.238.35.204.80      208.17.2.40.1033       CLOSE_WAIT
tcp4       0      0  216.238.35.70.80       216.238.9.82.2620      CLOSE_WAIT
tcp4       0      0  216.238.35.204.80      216.238.9.82.2618      CLOSE_WAIT
tcp4      68      0  216.238.35.204.80      216.15.84.168.38018    CLOSE_WAIT
tcp4     326      0  216.238.35.204.80      38.151.70.230.5364     CLOSE_WAIT
tcp4     270      0  216.238.35.206.80      149.106.33.22.1061     CLOSE_WAIT
tcp4     544      0  216.238.35.204.80      202.61.190.5.4021      CLOSE_WAIT
tcp4     187      0  216.238.35.206.80      216.35.103.53.52309    CLOSE_WAIT
tcp4     565      0  216.238.35.206.80      194.201.24.172.20488   CLOSE_WAIT
tcp4     342      0  216.238.35.204.80      63.99.105.163.63617    CLOSE_WAIT
tcp4     355      0  216.238.35.204.80      63.99.105.163.63616    CLOSE_WAIT
tcp4     341      0  216.238.35.204.80      63.99.105.163.63615    CLOSE_WAIT
tcp4     341      0  216.238.35.204.80      63.99.105.163.63613    CLOSE_WAIT
tcp4      68      0  216.238.35.204.80      216.15.84.168.38012    CLOSE_WAIT
tcp4     273      0  216.238.35.204.80      205.188.208.203.9694   CLOSE_WAIT
tcp4     381      0  216.238.35.204.80      207.198.35.37.64434    CLOSE_WAIT
tcp4     187      0  216.238.35.206.80      216.35.103.53.50211    CLOSE_WAIT
tcp4     273      0  216.238.35.204.80      205.188.208.203.6938   CLOSE_WAIT
tcp4     334      0  216.238.35.204.80      216.238.225.56.1403    ESTABLISHED
tcp4      68      0  216.238.35.204.80      216.15.84.168.38007    CLOSE_WAIT
tcp4     424      0  216.238.35.206.80      24.131.134.76.1213     CLOSE_WAIT
tcp4     292      0  216.238.35.204.80      216.238.225.56.1402    CLOSE_WAIT
tcp4     434      0  216.238.35.206.80      212.1.141.191.1570     CLOSE_WAIT
tcp4     149      0  216.238.35.206.80      212.1.128.63.33288     CLOSE_WAIT
tcp4     261      0  216.238.35.204.80      216.175.235.66.1825    CLOSE_WAIT
tcp4     315      0  216.238.35.204.80      209.198.114.237.1263   CLOSE_WAIT
tcp4       0      0  216.238.35.204.80      209.185.143.138.53172  CLOSE_WAIT
tcp4     250      0  216.238.35.204.80      64.41.254.25.1895      CLOSE_WAIT
tcp4     381      0  216.238.35.204.80      207.198.35.37.63567    CLOSE_WAIT
tcp4     216      0  216.238.35.204.80      216.35.116.93.52489    CLOSE_WAIT
tcp4     261      0  216.238.35.204.80      216.238.1.32.2854      CLOSE_WAIT
tcp4     170      0  216.238.35.206.80      209.67.206.127.52954   CLOSE_WAIT
tcp4     170      0  216.238.35.206.80      209.67.206.126.51861   CLOSE_WAIT
tcp4     381      0  216.238.35.204.80      207.198.35.37.63460    CLOSE_WAIT
tcp4     274      0  216.238.35.204.80      205.247.157.99.1614    CLOSE_WAIT
tcp4     182      0  216.238.35.204.80      209.185.143.138.49748  CLOSE_WAIT
tcp4     148      0  216.238.35.206.80      208.171.252.34.4145    CLOSE_WAIT
tcp4     255      0  216.238.35.204.80      205.188.208.203.57187  CLOSE_WAIT
tcp4       0      0  216.238.35.204.80      209.185.143.138.46399  CLOSE_WAIT
tcp4     170      0  216.238.35.204.80      208.184.66.9.1379      CLOSE_WAIT
tcp4     155      0  216.238.35.204.80      208.184.66.9.1378      CLOSE_WAIT
tcp4     320      0  216.238.35.204.80      213.189.83.100.43578   CLOSE_WAIT
tcp4     387      0  216.238.35.204.80      128.119.121.177.1061   CLOSE_WAIT
tcp4     155      0  216.238.35.204.80      208.184.66.9.1094      CLOSE_WAIT
tcp4       0      0  216.238.35.204.80      209.185.143.138.57149  CLOSE_WAIT
tcp4     226      0  216.238.35.204.80      216.35.116.93.51897    CLOSE_WAIT
tcp4     182      0  216.238.35.204.80      209.185.143.138.53529  CLOSE_WAIT
tcp4     387      0  216.238.35.204.80      128.119.121.177.1031   CLOSE_WAIT
tcp4     261      0  216.238.35.204.80      216.175.235.66.1823    CLOSE_WAIT
tcp4     375      0  216.238.35.204.80      199.184.22.2.40832     ESTABLISHED
tcp4     261      0  216.238.35.204.80      208.48.238.149.3535    CLOSE_WAIT
tcp4     261      0  216.238.35.204.80      208.48.238.149.3534    CLOSE_WAIT
tcp4     216      0  216.238.35.204.80      216.35.103.62.62755    CLOSE_WAIT
tcp4     261      0  216.238.35.204.80      208.48.238.149.3533    CLOSE_WAIT
tcp4     180      0  216.238.35.204.80      209.185.143.138.62329  CLOSE_WAIT
tcp4     261      0  216.238.35.204.80      216.175.235.66.1821    CLOSE_WAIT
tcp4     261      0  216.238.35.204.80      216.175.235.66.1819    CLOSE_WAIT
tcp4     261      0  216.238.35.204.80      216.175.235.66.1817    CLOSE_WAIT
tcp4      68      0  216.238.35.204.80      209.133.121.160.57333  CLOSE_WAIT
tcp4     226      0  216.238.35.204.80      216.35.103.62.62049    CLOSE_WAIT
tcp4       0      0  216.238.35.70.80       216.238.9.82.2462      CLOSE_WAIT
tcp4       0      0  216.238.35.204.80      216.238.9.82.2460      CLOSE_WAIT
tcp4     588      0  216.238.35.206.80      211.117.39.52.18604    CLOSE_WAIT
tcp4       0      0  216.238.35.204.80      199.179.123.68.63172   CLOSE_WAIT
tcp4     242      0  216.238.35.206.80      64.196.60.70.1130      CLOSE_WAIT
tcp4     191      0  216.238.35.206.80      216.35.103.56.50988    CLOSE_WAIT
tcp4     357      0  216.238.35.204.80      172.165.74.108.1199    CLOSE_WAIT
tcp4       0  17520  216.238.35.206.80      168.221.7.27.1621      CLOSE_WAIT
tcp4       0   5950  216.238.35.206.80      216.35.103.56.49103    LAST_ACK
tcp4       0    542  216.238.35.204.80      212.7.60.98.1870       LAST_ACK
tcp4       0  17520  216.238.35.206.80      209.240.220.150.59419  CLOSE_WAIT
tcp4       0  11794  216.238.35.204.80      216.175.235.66.1815    LAST_ACK
tcp4       0    307  216.238.35.204.80      208.184.66.9.4700      LAST_ACK
tcp4       0    143  216.238.35.204.80      24.131.134.49.4031     LAST_ACK
tcp4       0    307  216.238.35.204.80      208.184.66.9.4530      LAST_ACK
tcp4       0   2644  216.238.35.206.80      208.171.252.97.2157    LAST_ACK
tcp4       0  17520  216.238.35.206.80      216.35.103.71.50336    LAST_ACK
tcp4       0  10921  216.238.35.204.80      205.247.157.86.1101    LAST_ACK
tcp4       0   4626  216.238.35.206.80      152.163.189.68.34578   LAST_ACK
tcp4       0   8319  216.238.35.204.80      216.35.116.103.50498   LAST_ACK
tcp4       0  11794  216.238.35.204.80      172.165.74.108.1134    LAST_ACK
tcp4       0   4626  216.238.35.206.80      152.163.189.68.31101   LAST_ACK
tcp4       0  11794  216.238.35.204.80      24.29.59.89.2104       LAST_ACK
tcp4       0      0  216.238.35.204.80      216.238.225.56.1399    LAST_ACK
tcp4       0      0  216.238.35.204.80      216.238.225.56.1398    LAST_ACK
tcp4       0      0  216.238.35.204.80      216.238.225.56.1397    LAST_ACK
tcp4       0   4096  216.238.35.204.80      216.238.225.56.1396    LAST_ACK
tcp4       0    458  216.238.35.204.80      216.35.116.103.49617   LAST_ACK
tcp4       0      0  216.238.35.204.80      216.77.225.224.24630   FIN_WAIT_2
tcp4       0    170  216.238.35.204.80      209.185.143.138.47035  LAST_ACK
tcp4       0  11794  216.238.35.204.80      209.133.121.160.57120  LAST_ACK
tcp4       0  11368  216.238.35.204.80      38.240.127.3.1112      LAST_ACK
tcp4       0  17520  216.238.35.206.80      216.238.225.156.1402   LAST_ACK
tcp4       0  11794  216.238.35.204.80      24.29.59.89.2102       LAST_ACK
tcp4       0   4626  216.238.35.206.80      152.163.189.68.27637   LAST_ACK
tcp4       0      0  216.238.35.204.80      216.77.225.224.24631   FIN_WAIT_2
tcp4       0      0  216.238.35.206.80      136.215.199.3.3660     LAST_ACK
tcp4       0   8196  216.238.35.204.80      63.53.78.178.2246      LAST_ACK
tcp4       0   4096  216.238.35.206.80      194.19.141.241.3256    LAST_ACK
tcp4       0   4096  216.238.35.206.80      194.19.141.241.3249    LAST_ACK
tcp4       0      0  216.238.35.204.80      24.29.72.189.1083      LAST_ACK
tcp4       0    540  216.238.35.206.80      216.35.116.108.38090   LAST_ACK
tcp4       0   4096  216.238.35.206.80      194.19.141.241.3167    LAST_ACK
tcp4       0      0  216.238.35.206.80      128.59.142.35.1038     LAST_ACK
tcp4       0      0  216.238.35.206.80      136.215.199.3.1787     LAST_ACK
tcp4       0    170  216.238.35.204.80      209.185.143.138.45445  LAST_ACK
tcp4       0   4096  216.238.35.206.80      194.19.141.241.3146    LAST_ACK
tcp4       0    170  216.238.35.204.80      209.185.143.138.57109  LAST_ACK
tcp4       0  11794  216.238.35.204.80      209.133.121.160.57085  LAST_ACK
tcp4       0      0  216.238.35.204.80      216.238.9.82.2326      LAST_ACK
tcp4       0      0  216.238.35.70.22       *.*                    LISTEN
tcp4       0      0  172.16.0.70.22         *.*                    LISTEN
tcp4       0      0  *.80                   *.*                    LISTEN
tcp4       0      0  *.443                  *.*                    LISTEN
tcp4       0      0  172.16.0.70.23         *.*                    LISTEN
tcp4       0      0  172.16.0.70.21         *.*                    LISTEN
tcp4       0      0  *.111                  *.*                    LISTEN
udp4       0      0  172.16.0.70.985        172.16.0.50.2049       
udp4       0      0  172.16.0.70.994        172.16.0.2.2049        
udp4       0      0  172.16.0.70.1000       172.16.0.2.2049        
udp4       0      0  172.16.0.70.1006       172.16.0.4.2049        
udp4       0      0  172.16.0.70.1012       172.16.0.2.2049        
udp4       0      0  *.111                  *.*                    
udp4       0      0  172.16.0.70.1023       172.16.0.4.2049        
Active UNIX domain sockets
Address  Type   Recv-Q Send-Q    Inode     Conn     Refs  Nextref Addr
fffffe000ec89f80 stream      0      0 fffffe000ec0d120        0        0        0 /tmp/gcache_port


--
Tom Holmes








To Unsubscribe: send mail to majordomo@FreeBSD.org
with "unsubscribe freebsd-questions" in the body of the message




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?Pine.LNX.4.21.0010050857240.6645-100000>