Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 20 Jul 2011 14:33:49 +0200
From:      Clinton Adams <clinton.adams@gmail.com>
To:        Rick Macklem <rmacklem@uoguelph.ca>
Cc:        freebsd-fs@freebsd.org
Subject:   Re: nfsd server cache flooded, try to increase nfsrc_floodlevel
Message-ID:  <CAEuopLb2JBvDQ2WtJhvTCVLnXV=6n676JarStCpFeqhmOj422Q@mail.gmail.com>
In-Reply-To: <732996961.772204.1311116979640.JavaMail.root@erie.cs.uoguelph.ca>
References:  <4E24B266.9050108@votesmart.org> <732996961.772204.1311116979640.JavaMail.root@erie.cs.uoguelph.ca>

next in thread | previous in thread | raw e-mail | index | archive | help
On Wed, Jul 20, 2011 at 1:09 AM, Rick Macklem <rmacklem@uoguelph.ca> wrote:
> Please try the patch, which is at:
> =A0 http://people.freebsd.org/~rmacklem/noopen.patch
> (This patch is against the file in -current, so patch may not like it, bu=
t
> =A0it should be easy to do by hand, if patch fails.)
>
> Again, good luck with it and please let me know how it goes, rick
>

Thanks for your help with this, trying the patches now. Tests with one
client look good so far, values for OpenOwner and CacheSize are more
in line, we'll test with more clients later today. We were hitting the
nfsrc_floodlevel with just three clients before, all using nfs4
mounted home and other directories. Clients are running Ubuntu 10.04.2
LTS.  Usage has been general desktop usage, nothing unusual that we
could see.

Relevant snippet of /proc/mounts on client (rsize,wsize are being
automatically negotiated, not specified in the automount options):
pez.votesmart.org:/public /export/public nfs4
rw,relatime,vers=3D4,rsize=3D65536,wsize=3D65536,namlen=3D255,hard,proto=3D=
tcp,timeo=3D600,retrans=3D2,sec=3Dkrb5,clientaddr=3D192.168.255.112,minorve=
rsion=3D0,addr=3D192.168.255.25
0 0
pez.votesmart.org:/home/clinton /home/clinton nfs4
rw,relatime,vers=3D4,rsize=3D65536,wsize=3D65536,namlen=3D255,hard,proto=3D=
tcp,timeo=3D600,retrans=3D2,sec=3Dkrb5,clientaddr=3D192.168.255.112,minorve=
rsion=3D0,addr=3D192.168.255.25
0 0

nfsstat -e -s, with patches, after some stress testing:
Server Info:
  Getattr   Setattr    Lookup  Readlink      Read     Write    Create    Re=
move
    95334         1     28004        50    297125         2         0      =
   0
   Rename      Link   Symlink     Mkdir     Rmdir   Readdir  RdirPlus    Ac=
cess
        0         0         0         0         0      1242         0      =
1444
    Mknod    Fsstat    Fsinfo  PathConf    Commit   LookupP   SetClId SetCl=
IdCf
        0         0         0         0         2         0         4      =
   4
     Open  OpenAttr OpenDwnGr  OpenCfrm DelePurge   DeleRet     GetFH      =
Lock
   176735         0         0     21175         0         0     49171      =
   0
    LockT     LockU     Close    Verify   NVerify     PutFH  PutPubFH PutRo=
otFH
        0         0     21184         0         0    549853         0      =
  17
    Renew RestoreFH    SaveFH   Secinfo RelLckOwn  V4Create
        0     21186    176735         0         0         0
Server:
Retfailed    Faults   Clients
        0         0         1
OpenOwner     Opens LockOwner     Locks    Delegs
      291         2         0         0         0
Server Cache Stats:
   Inprog      Idem  Non-idem    Misses CacheSize   TCPPeak
        0         0         0    549969       291      2827

nfsstat -e -s, prior to patches, general usage:

Server Info:
  Getattr   Setattr    Lookup  Readlink      Read     Write    Create    Re=
move
  2813477     62661    382636      1419    837492   2115422         0     3=
3976
   Rename      Link   Symlink     Mkdir     Rmdir   Readdir  RdirPlus    Ac=
cess
    31164      1310         0         0         0     15678        10    30=
7236
    Mknod    Fsstat    Fsinfo  PathConf    Commit   LookupP   SetClId SetCl=
IdCf
        0         0         2         1    144550         0        43      =
  43
     Open  OpenAttr OpenDwnGr  OpenCfrm DelePurge   DeleRet     GetFH      =
Lock
  1462595         0       595     11267         0         0    550761    28=
0674
    LockT     LockU     Close    Verify   NVerify     PutFH  PutPubFH PutRo=
otFH
      155    212299    286615         0         0   6651006         0      =
1234
    Renew RestoreFH    SaveFH   Secinfo RelLckOwn  V4Create
   256784    320761   1495805         0         0       738
Server:
Retfailed    Faults   Clients
        0         0         3
OpenOwner     Opens LockOwner     Locks    Delegs
        6       178      8012         2         0
Server Cache Stats:
   Inprog      Idem  Non-idem    Misses CacheSize   TCPPeak
        0         0        96   6876610      8084     13429


> _______________________________________________
> freebsd-fs@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-fs
> To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org"
>



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAEuopLb2JBvDQ2WtJhvTCVLnXV=6n676JarStCpFeqhmOj422Q>