Skip site navigation (1)Skip section navigation (2) 
Date:      Mon, 18 Mar 2013 15:50:37 +0100
From:      Davide D'Amico <davide.damico@contactlab.com>
To:        freebsd-fs@freebsd.org
Subject:   FreBSD 9.1 and ZFS v28 performances
Message-ID:  <514729BD.2000608@contactlab.com>
next in thread | raw e-mail | index | archive | help 
Hi all,
I'm trying to use ZFS on a DELL R720 with 2x6-core, 32GB ram, H710 
controller (no JBOD) and 15K rpm SAS HD: I will use it for a mysql 5.6 
server, so I am trying to use ZFS to get L2ARC and ZIL benefits.

I created a RAID10 and used zpool to create a pool on top:

# zpool create DATA mfid3
# zpool add DATA cache mfid1 log mfid2

I have a question on zfs performances. Using:

dd if=/dev/zero of=file.out bs=16k count=1M

I cannot go faster than 400MB/s so I think I'm missing something; I 
tried removing zil, removing l2arc but everything is still the same.

Here my configuration details:

OS: FreeBSD 9.1 amd64 GENERIC

/boot/loader.conf
vfs.zfs.arc_min="4096M"
vfs.zfs.arc_max="15872M"
vm.kmem_size_max="64G"
vm.kmem_size="49152M"
vfs.zfs.write_limit_override=1073741824

/etc/sysctl.conf:
kern.ipc.somaxconn=32768
kern.threads.max_threads_per_proc=16384
kern.maxfiles=262144
kern.maxfilesperproc=131072
kern.ipc.nmbclusters=65536
kern.corefile="/var/coredumps/%U.%N.%P.core"
vfs.zfs.prefetch_disable="1"
kern.maxvnodes=250000

mfiutil show volumes:
mfi0 Volumes:
   Id     Size    Level   Stripe  State   Cache   Name
  mfid0 (  278G) RAID-1      64k OPTIMAL Disabled <BASE>
  mfid1 (  118G) RAID-0      64k OPTIMAL Disabled <L2ARC0>
  mfid2 (  118G) RAID-0      64k OPTIMAL Disabled <ZIL0>
  mfid3 ( 1116G) RAID-10   64k OPTIMAL Disabled <DATA>

zpool status:
   pool: DATA
   state: ONLINE
   scan: none requested
config:

	NAME        STATE     READ WRITE CKSUM
	DATA        ONLINE       0     0     0
	  mfid3     ONLINE       0     0     0
	logs
	  mfid2     ONLINE       0     0     0
	cache
	  mfid1     ONLINE       0     0     0

errors: No known data errors

zfs get all DATA
NAME  PROPERTY              VALUE                  SOURCE
DATA  type                  filesystem             -
DATA  creation              Mon Mar 18 13:41 2013  -
DATA  used                  53.0G                  -
DATA  available             1.02T                  -
DATA  referenced            53.0G                  -
DATA  compressratio         1.00x                  -
DATA  mounted               yes                    -
DATA  quota                 none                   default
DATA  reservation           none                   default
DATA  recordsize            16K                    local
DATA  mountpoint            /DATA                  default
DATA  sharenfs              off                    default
DATA  checksum              on                     default
DATA  compression           off                    default
DATA  atime                 off                    local
DATA  devices               on                     default
DATA  exec                  on                     default
DATA  setuid                on                     default
DATA  readonly              off                    default
DATA  jailed                off                    default
DATA  snapdir               hidden                 default
DATA  aclmode               discard                default
DATA  aclinherit            restricted             default
DATA  canmount              on                     default
DATA  xattr                 off                    temporary
DATA  copies                1                      default
DATA  version               5                      -
DATA  utf8only              off                    -
DATA  normalization         none                   -
DATA  casesensitivity       sensitive              -
DATA  vscan                 off                    default
DATA  nbmand                off                    default
DATA  sharesmb              off                    default
DATA  refquota              none                   default
DATA  refreservation        none                   default
DATA  primarycache          metadata               local
DATA  secondarycache        all                    default
DATA  usedbysnapshots       0                      -
DATA  usedbydataset         53.0G                  -
DATA  usedbychildren        242K                   -
DATA  usedbyrefreservation  0                      -
DATA  logbias               latency                default
DATA  dedup                 off                    default
DATA  mlslabel                                     -
DATA  sync                  standard               default
DATA  refcompressratio      1.00x                  -
DATA  written               53.0G                  -
DATA  zfs:zfs_nocacheflush  1                      local


I'm using recordsize=16k because of mysql.

I am trying to use sysbench (0.5, not in the ports yet) with oltp test 
suite and my performances not so good.

Any advice?

Thanks,
d.

Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?514729BD.2000608>