Date: Tue, 9 Jul 2013 23:12:33 +0400 From: Lev Serebryakov <lev@FreeBSD.org> To: Mark Saad <nonesuch@longcount.org> Cc: freebsd-performance@freebsd.org Subject: Re: Samba server performance -- only 33MiB/s with one client on 1G network! Message-ID: <1783952055.20130709231233@serebryakov.spb.ru> In-Reply-To: <CAMXt9NY_AsMB0m%2Bkp4t%2BVU3yo67Tu7eovJRGUox65rPpZoeg0Q@mail.gmail.com> References: <866737084.20130707233704@serebryakov.spb.ru> <1885849141.20130708010224@serebryakov.spb.ru> <987136020.20130709201026@serebryakov.spb.ru> <CAMXt9NY_AsMB0m%2Bkp4t%2BVU3yo67Tu7eovJRGUox65rPpZoeg0Q@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
------------03E0E102612CC4C43
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Hello, Mark.
You wrote 9 =D0=B8=D1=8E=D0=BB=D1=8F 2013 =D0=B3., 20:41:31:
MS> What can you tell us about the system tunings. Can you post a copy of=
your
I need to note, that system as tuned for (a) maximum local read/write speed
and (b) maximum TCP throughput in local network, as seen by "iperf".
Results of these separate tunings could be seen in very first message in
this thread (280MiB/s sustained local read from FS and 820Mbit/s of TCP
throughput to client in question).
MS> 1. sysctl.conf
net.inet.tcp.recvbuf_auto=3D1
net.inet.tcp.recvbuf_inc=3D131072
net.inet.tcp.recvbuf_max=3D1048576
net.inet.tcp.sendbuf_auto=3D1
net.inet.tcp.sendbuf_inc=3D131072
net.inet.tcp.sendbuf_max=3D1048576
net.inet.tcp.maxtcptw=3D102400
net.inet.tcp.mssdflt=3D8800
net.inet.tcp.recvspace=3D262144
net.inet.tcp.sendspace=3D262144
kern.ipc.nmbclusters=3D204800
kern.ipc.nmbjumbop=3D192000
kern.ipc.maxsockbuf=3D2097152
net.inet.ip.intr_queue_maxlen=3D8192
vfs.read_max=3D32
MS> 2. loader.conf
hw.em.rxd=3D4096
hw.em.txd=3D4096
net.link.ifqmaxlen=3D16384
MS> 3. smb.conf
Attached
MS> 4. /etc/fstab
# Device Mountpoint FStype Options Dump Pas=
s#
/dev/label/swap none swap sw 0 0
/dev/ufs/root / ufs rw 1 1
/dev/ufs/tmp /tmp ufs rw 2 2
/dev/ufs/usr /usr ufs rw 2 2
/dev/ufs/var /var ufs rw 2 2
/dev/raid5/storage /usr/home ufs rw 2 2
linproc /compat/linux/proc linprocfs rw 0 =
0
/usr/home /backup/home nullfs rw 0 0
FS in question is "/usr/home" (exported as "storage" SMB share).
MS> Also the output from
MS> 1. pciconf -lv
attached.
MS> 2. dmidecode
dmidecode
MS> 3. ifconfig
ifconfig -v em0
em0: flags=3D8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=3D4219b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,T=
SO4,WOL_MAGIC,VLAN_HWTSO>
ether 00:1e:8c:75:03:0d
inet 192.168.134.2 netmask 0xffffff00 broadcast 192.168.134.255
inet6 fe80::21e:8cff:fe75:30d%em0 prefixlen 64 scopeid 0x1
inet6 2001:470:923f:1:21e:8cff:fe75:30d prefixlen 64 autoconf
nd6 options=3D23<PERFORMNUD,ACCEPT_RTADV,AUTO_LINKLOCAL>
media: Ethernet 1000baseT <full-duplex>
status: active
MS> 4. mount
/dev/ufs/root on / (ufs, local, soft-updates)
devfs on /dev (devfs, local)
/dev/ufs/tmp on /tmp (ufs, local, journaled soft-updates)
/dev/ufs/usr on /usr (ufs, NFS exported, local, journaled soft-updates)
/dev/ufs/var on /var (ufs, local, journaled soft-updates)
/dev/raid5/storage on /usr/home (ufs, NFS exported, local, journaled soft-u=
pdates)
linprocfs on /usr/local/linux/proc (linprocfs, local)
/usr/home on /backup/home (nullfs, local)
--=20
// Black Lion AKA Lev Serebryakov <lev@FreeBSD.org>
------------03E0E102612CC4C43
Content-Type: application/octet-stream;
name="dmidecode.txt.bz2"
Content-transfer-encoding: base64
Content-Disposition: attachment;
filename="dmidecode.txt.bz2"
QlpoOTFBWSZTWZXB/KYAB1pfgF3wWGf/8H//3/C//9/0YBWfeHcFGdyfXoaMHUu96r69s+9d
549fLfTvbL1rRs07nWxrkAdDqFp07ZpR060AGQ10EkhNARoGEZEmxE2gmTTUeieo0aNAA0DR
MgAUxCmj1PJPUaHonpB6gABoAABppTxTUnpNHpGmRoaDQ0AAANAA0NNMJNKJE9E1T9A1TaI0
9IADQDTQAAAAEUgpp6SZoNQp+mjSah41T1M1DNJoabU9TQAACJIgE0JoyEyRp6EBT0gNH6ox
PUAA9QOg/FIbQmyCmwpFCSMAjIEAYpIIgBEEBQiyCMJAWSMEIIxBBkjIERIIsVAUAjGBFUUB
5Z73n93i7g5H0NjLD6cW4hhwcxjAnDOIYKDLKsEPcQrExfD+/Dn+zeH7c+3Z6Pp7fL6/oM0Y
xiiIifNdLW6JixOiz+pufy/jgPY7QCUhLP8CGQeGwPXxTP+kgasQlDC6+rwwhoTM1sbpdAl8
fR2HoyRwrbTzqCAbmMmoOzrxlWniHdXSbONYMSh9rX1333yWtFqq74E0uzZs+Xm6oqJ8tGWn
36UgHj3Vob9za8P6gTdYOaBuRm7q9dxHNnk22ufD1ewOORHAVVKzk5a9CkFzOodN49Sbx6P2
mv+mrVXqk8NIX3BABgzjnI6ux+MLFS8BoA2Ri3qgdAEMNrNWdi57gRklphL4auQeTbJ1DsEU
7fIKCwTD+tyVRwSremVYOpNHhwMr1W2lpmgec1gDgEDAJQYB+8CbHu+vD6vw7/d+XfgG/D57
T37ZYnl0s8KKA0v5RuE/xSxAsRlMUjrGEM3tZzLbaTvvie3HtYwh0Om0rOl3+xbv0vOgqqoK
qKCM9RArABgoKiiiyeP5sBp49rBK+Fhyn/nC1h1r9Aj+6gp8i7t0rBw1haBEImcyQ59M4GBq
gOjZWgUBwIMBowMAkwhxLWrXWpFDMCJve9B+jAa7exJ6jpKUuo2Alne8SJrQOCABIGGHvxb4
UCFAUoFBfbXD6QD4IbidbcOkShXOBPrmx/2D5ldaZoOwOOdwjlN+3biY1C/R1+mvxg7FAqKB
r5PTA3inIAh1EpbF6+wQ1AgoGEDLQNQyoP+se/8a89XK3CAVJm9nVDYMSSBGsFAhmFbnpD1b
sM7NObaVqQ4HBQjT375DwwrKGIXBDLHDlZb4V9lk8snbRhWVg/Vdyg+ZenTHXXp3vMH1DTL4
9ZDeBQVXZd++Bv3RgeHh6ybHwzzW7zzG3TcrkRFMIMYLiFggz1yBuJrmTAsH8sN70JxB7FGI
RQ6lilceNTOf6HmutSEltxWgoE55wkCUINRi+HWuhEvbiUEYlelrS2ECYbODFD8a8PT58sy4
eXCjVDu2Wgd9/2tueQ4iQwooqqWERO6CmhYKJbewFgLQcMLW4Wc1GwX6RPNErqpKwzBA4Swa
pa73pTjcwGfdAvfukG5dq4Qe3vCASBDhRHohFICA4ltB9uQ3Ya87fN9uq/e6cmsd2HJUv79r
7vKT256I+QPeG+ryin8evjHoc1oZOHqx0c6Zxvu9Yt/DnqTwxuFZ1DY8q4ho5M6Orn1rJyyX
TByCgdGh+63CKAgJmyFWDskJJ3eUQEEsJK7F59wJVsikYAL0Ew8jshhByoiXfNAateFwNqYu
iYAUi1hRuOjhvDmCpndq3oh2jrIB3OdQ+MjpuhID0fGaid5ojn24ccd1d9uumYXpSFI2tdXO
Y61Fu9Xuja9BJ53veF6VU5zhB6qq2yaZOMCXp6zXYDkXLN9nMSlrYk0ckRsA0tELNJgbezBB
5UTqYgLBl1XOUebJLods1PYHsRzA4g0/KnMMt8d/wUXdpR79RvzE+z2cCdytYXRAQyzxd1JM
lddCw67t0zc52dSQoB+TILEOsHsmZ7sRP2fOcGJrA/vij+uNA/7QKqqEARIpIIkYxgasJvUB
hBei2QOYxXjEA4wDImSEcZvCok3rKLzhkTZrgCdCqrAIdXIs8xOPoffgK4ert4417a04tURB
R6xRM2ov24pMV3h2aME4sgiRRPQrbEgSOcwzwKBUPQPOCwwwXyNSO5qgPGg4ZjcyLIuNGsjl
LLxnE0I0l0bpZKMrZZ9X3uKSzU4TWaALWswz2qvEzUECElOrkSIExndUAqFiSYWkR7aGcVYZ
pS2xJx5GDlo8sacuzmx19G8m4OZ2dPHHTt2eeTO0XCg+AduKdL+6YSbALLAqbQxSUTxB4ppB
i/G+pqwFvADGGbAMXhYwm+EHF8GqkCQOVV7s7WRgaBnW5v5461LYmMmfAahFV0EceSxvC+Qb
iItGwYsqccwPNe7mTeWBgNaraGcuqBFkogQphAqOArQ7Mee3SLFUUivNYkIGnvkqrrSsd/Lx
yQGeSjPAIMFwzEkxf5mW/NEnRQUpUpARYHPhI99pS0NJJEB8vIPgmSPBl3J2LGC4oMQYRPgc
h5QzAzmmPqsDyQ0sLph0XNGgMz8820Meua0l8kEJYRgKaUhQqqrS66049fR4Ovu113FEjN3C
43hnFCy0JvekSglQWc6S4u++++++gZiGwaUYIhxzgykmQGIPQCfOGbms0ek4cOF+elluBjSw
100JhsxsH4r0zkvfSebPs5J+bLtgM0TJeY4cOv7F7jsbwvy2jUvzE75glKS8a0gYhQUVBIyM
EGBOr0ePvBY8sQwGOYiB1fbywuYLln2z6m2IPjSc4afxHJLEAqlCiQgICTuI/FE6tpXhuUGs
q82QQTMlsznwIDWoNQ/WTBf8mnwYFgKpcZZiIsIhFO/pz8fX5cjyyMu/tpd8R14HdAtvDoVY
A/wgiHAOt7DFIGohJLCEBCikgihfuya+OWvOf2QeUwxx2YzP7jwBbsbgjpJWCzKEgc/wSLSb
xliTJyGNrCoZBYEVA9Ux6ePfepUt38r/SZ8nU8NEq8pLBrn2bck58854aiSTKRIWJSkEA9fR
cTHpwkWKl2ICFAGS7l31MsREEwEJVmVDpjdvMB4mR6HAiBee4DPA+7BEC0gkYQIEiSANZPCH
sesGuZsVWbRO+mK2CDJIkCJDnmQPGqD76ORzqYDXTC6HsDkBmAcV5tM1gqusBCiBXZgVmWKE
0mBCELHtQRGqjaIyKTkH1zOBrgKmMkAns+P27bbbbgyJJ0nN5h6mQmnCkYh2zoE8PLUD2O/I
c4HfHUCJCMgB5dOXnxwDFjIniVbrCNJj54rY5muRffa/BuZJAiVVJvaypSgSygRJCEqik7w3
6Thlew6Y/e513/rNJooRAxddYDCw6lwxsLxrA93Sg6OPRfwW7zs26meym7hSZmNNuZk66SgK
iCDQsKJESAgMhGRjBjGC0oVVYOQQgU0YBwx2IiYZba29tNYvmF8ZkXJKDBAQBRAUYRQJDU8u
7nyTTYShOrm/47DZu2BWCwUwhqneMlGDrbstSIVmk1x1Jou7S7mcO9xF2jGuYsBcGRSwfIfQ
Dc0op4RAnhTShrMvaeS5V7Bzh5C9uFDAD2Qu91Kf8cpojiNYUNcw/UILcON++FQISkn3qYUK
B+lww+lw2wrKjXHIHPp+Z2dzDHAPxVU96cluAaQNwHPhAPQwhcPLm8UCcl/SQbqjpGBkMijP
ILpNM+QDvQHxYKFeY7s0oJK+1nYBZs0BKcksjYIkCAj8OFc9kLUB1XMepEh/QcOgHy4iH6Fk
NQPzsvOJ9gRS+36E50WT38zMsohBMItTeQHcCUFxQIEtkX2zAxAyGzIhYgwM9rwuGQjUSCla
WsT5iajbkQwGNQIwCRFGkjCXfjCTVgCyRVkUkDWWjWtlI0sAYiUjYTYwNUFmvCBtQmSscBKI
Ut8kK0FLWABksB5ilrZ6ZIZgV5Gwej8uOimCwT3NrMlkvAKiz7ipna1yVYxKAQiloO8EGoHQ
zPS2woED6geDYL6BZtUDMHLALzzlEnDA/34TC+e1nPcDeOqn92xqYXQKMogTMKGAFMEJABsk
DUgmhATFhtw2stowz9r23+1bcljw9oB7H2rvwEcjX/7LDQkDoiLX4xflMgmARMfMWr1AtZHV
CgfANK+GFRtTTFIJIEfQXEXTiKBf52OmWu0Mas5cSkC+YhUa9pSJAdPwdyFWFCWEK2QPfK/l
t8adBJNilgE+71HCGMtA9LZdawJcjcxG8kCISPYO5zPYUCwPHIW5ABCG9HgvQChEOK7e5bVt
6kefwy6IYkUEg0sCRGGZ5IagciECBiHSXzj7j8vX0eGQtqMzpIv7XT8n7R1cBeD1CgVOQRxC
9hFY3FlmoZVgqAVDNTMhQwkE3vn34mKaXVE8S2cUmFuX3Hj7vGfr9+9Q6OtcJBIb0PrWCqvo
IJDBqXqDLOgY8F2LTlB+TIM5m0TQspVFKDu7JodceCGRXIWEee8UTCoc4HA7weJtj6Bx7Qe4
scuPqhsdsMBDmIlt8+0J01pceddAc4FvlMhTJFOxBAkgRCRIRZFJJEMzMGb/mkQVFhjKikAG
7dvoaCcWTYBpaqBk+s5pwDPPMDI+rg5No5HVRxxQyAMa8480K8LI2wQz4Yv1JAVJBRIV94UQ
K9O34bm+RDmE6QIGQqIdgiq4JDdxAcm4GRYQhCBxr90xw03NaKBgPOb8PlsOF/Z704XNfku3
XvovxMQqjoEKkYEgwGjgxECQhUwK+vVNLjxqIynYuGOaAhiIBCGEVRfHD6LJowKzawDKFQkf
NkU4CIWYKB2CooJhjiKB8gzDk6LhtKTHTFVSihUwFzPREWiy7EDNFbKtywtwyCSyC1aAHtQk
KLv6JB86Fmu4Iui5XR1C0AgMJcsEtrZASXbzUW9H4A4fz5A3glVx4H1p9JGRJ6n4o8uhiNKb
0Jw7D4e7uTKQNhy2GI6deTRwJB1mxVS0UCu8FLHFbBvERZiGIFjjNOh0Ce3lzD49bjssUCqQ
oBD2iAmpPs+YPzRW444dugaiiUInQRoLeG4caVIPZPIh1BsVtoSKnKg8gmyLVKgqv2k7ntzL
CHESELYk5izqhQvxW4e2264/ZP69qkATghfEROIYfnAuptyqVFw5vPUNMgwiMGRYxBHaygiS
AILBUkEQBRghBCARCCwNR+49a2yDB7KQuIZS/AoB485beFBOKUMKSkSAkkSHzpK+s1CRRlKa
AdSQcjZCw/sMNdOWAECERAgghkGf2ezzDmgcgxTuU0HZT8ADa0JFgC7rEQgQBIJz3G4FxH1q
wTxoMwunW4YAIXGrrlA7qKgYLONrWBcJcqwHeEM6lBlDTDNS17XtWU0xjnE0PcHbNC5bcqrF
wMgPAgUnosC4gmxsk1gUYjyDEx9MjAbwshRjgq9AdxkI0VYG+qBmBparpQIaplahayslpSSS
lAsBgVu5cYmOMsYLiGCpdMFuoFBeXq1NFq4VfBvbIGxmQOuIUFkTTXqvvMA0NU2R96hu77Br
mX4DUW8DhBKiWgFU6hoge+S7t1OYjIZkFIwgkjFiCAqqqrFBVVUkVUBVVVVV0OMRDiHbtIBA
9UeZ5G517+ew9DfonNvhUVHiRcQsErus3gEtcIKSrJimWCT8MBwQRxwFKCALnfHvL+eFhvQ5
AVyx10KgsE44j1QQ6BtmHeaD4imwvcvvOeI+vw3+sXASVSrbn36yF1whMkwF1gWCB3FIoDpF
BCno+8Hwqefu83zo6udDg++C+gEuh0rFsHNiEkoYyQw6aZo9SqMEh4pLCoHln1Vy76K2SotD
4A0UWvXbF8bXcCahhxD7m8ioESQBA+K2V908lEPoB2RfIuf/i7kinChISuD+UwA=
------------03E0E102612CC4C43
Content-Type: application/octet-stream;
name="pciconf.txt.bz2"
Content-transfer-encoding: base64
Content-Disposition: attachment;
filename="pciconf.txt.bz2"
QlpoOTFBWSZTWSv8sC0ABjpfgHAwQOf/8n/n/wA/79/gUAP+OttRCaACElKDIADINNGg0AAA
AADmmJgI0wIwjAAAAEwjASIiEKbxKaaep6ARghiaDEw0CaY5piYCNMCMIwAAABMIwEUkwgIm
yUntTU2iNHk1B6jNIaeg01MTRqoAc6heKHcPgh9u+2xAB5/QVl1wSuPDxkUgjRBAdREMxDxE
Ii8EJoHpFCqnb+uN3KqBp8p8O3TOZEIUEJeg9LPrUu7+aPnv3ffGM+mblTPBV0y3xoFQCAGi
UGncMsNpEPqENdrOIBaCT6qQISE3HQWt87naBIEOt5IFYfgSJL764dWuDGOiScGI/IByk7Gq
CzRA0F1Lbilky2ShMQZhNkmQQQ5bCzVbaIKnYDSPFQhAr5bmUbdFsUPvVU3jyjP1i68Ioe8u
MVx5s5LawxeORC+Z0WSAZHA2Rlwytg0LPPKdEaEgkwGU8qPEQxXG3DAkG6hBQ72EmZSKEQIZ
6W0rlNsWgtdFMsxCo68LWzgNaCyVrShpSgvZWWd9MdMuf5XX4RKW2HbxAIFgaoIMbd9IdWCo
MowoNS2BjERF5W6utWLL4swtrRIJmEiZmRS3M/gSDXAOgTaFxJB67g0AwD8toDQ2IJzLNfEa
2xjNKsiINXB2tYcFFDAHxmrkQmGlAwoIDr0fKJVrSXhBf3+1H2+B8CArN4qeqV8IVgPejna0
o/a56hCDLPYuMriNvle0Hyu1bTlDwAIPXGZGWYSAVm569QmztaeisQeUhtrSkGHmCBsYkEZI
GO9deN0R9UDsnqF0Ie+aG1yhZQrJQ7VD6EQsHxUPcgeKhSx7iJ8yhOqhNJZqGChxHiCayJvs
jY5EKEdyhVW7p8yGJuC/OPpcodChG/K4PIRG3KJSlAYKHs3c/FQ1hF4aCSM1DXhpRO7a/zKS
zULKGuevLEy2EIE3qjzG9XD6qwpU6r+JgpWvNIErZQk899925qCSVmrmYKFn+ADeocDeIfYm
If1dtxwUPsobcxE9t4hr8A1UOKvBQkcvPIQxUN4XqFlOQeFS48isgTpQ3RvBDlKQ7QoRihrG
l0AhiEImHjQ/FA3V43xjh0KEoppMQmTVmSQOnQcEOBRQyUJyUKJCkkjeEuBIl/xdyRThQkCv
8sC0
------------03E0E102612CC4C43
Content-Type: application/octet-stream;
name="smb.conf.bz2"
Content-transfer-encoding: base64
Content-Disposition: attachment;
filename="smb.conf.bz2"
QlpoOTFBWSZTWdqN39UAASR/gAAQAFBKA//yP0ffKr/v3/BAAq62rNFgoaaTRGVPyU9TT1Mg
AAANDamjyQ0CVNMgk9KPJ6oaeoNNAA0A0BpoA5piYAEwATAACYAAmCSFMJoU8intU8JAADQA
AbSNMGM/kbJppyOdB6V9Xr4hyZtONeJEYUdMmasPVlFXkoXZMjKcRzfdHiJXQIXdZIKiSJIO
nPkqfnXc3Yy55cHrUSftYG7dZW1ritUnK8FqxsFixUWgaeB3KWEpFNl1jRfpezlt/VLEdBHr
VXNN9UL5EYs6SBDG90UDWycJTueONKQX3k4OiuG3K+Y1avDMjAdC4C5M2HR03scp1leRIXUO
bK98zfM1pSJcI5BCAvZnGGLqSY0LKy0TnVMaRCcmuo1KQV3HPsvL1yoYoQCigiuzMEIiD2Cg
djtF/vj9Y44YxFV8bwyYNA/depyamEMFrJBKCfOIavBM/dnutrosoXnQDyB1iZ2C+gHc90NL
7hgVfhEdzsIslMeh7UQ0Ag2eRrQIOV8UQuRhehZIUtURqeQNE/4C1QKWPJk79lBnQhCYIBO0
Y9G3Xa0rKa3UE4OClSJjcZ3KuCAXECjzF6SyCkM4yC1iCmXMgzAa5PjbYmEQ+TfEW2J2XSdc
MlpfmfYRmTZhJuv2EwwgOqltVJBUhiYgXwKb2GMEmNtd6PyZancLY08+RfUC51YbZdygyowz
C7RiJIGU4krnCyBlibdXRyz4W9JvLjCy3vYKjHHgWL9KrIZbDcGWJpYkQiu07WROtwSYcZnW
lr6GdGggzDCVZcDiPRYKY4BbV3fSNSMpl0DX8dMzozTYqro0u6N7F/TMyYGqZKxaGhiTGPNi
QWlKxxRyiGSryUaEhiKuuq/XRZC3E7EiAhAUlGeG6VELEqH/F3JFOFCQ2o3f1Q==
------------03E0E102612CC4C43--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1783952055.20130709231233>