Date: Wed, 1 Apr 2015 08:42:50 -0600 From: Alan Somers <asomers@freebsd.org> To: Tobias Oberstein <tobias.oberstein@gmail.com> Cc: "freebsd-hackers@freebsd.org" <freebsd-hackers@freebsd.org>, Michael Fuckner <michael@fuckner.net>, kib@freebsd.org, jimharris@freebsd.org Subject: Re: NVMe performance 4x slower than expected Message-ID: <CAOtMX2jVwMHSnQfphAF%2Ba2%2Bo7eLp62nHmUo4t%2BEahrXLWReaFQ@mail.gmail.com> In-Reply-To: <551BC57D.5070101@gmail.com> References: <551BC57D.5070101@gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On Wed, Apr 1, 2015 at 4:16 AM, Tobias Oberstein <tobias.oberstein@gmail.com> wrote: > Hi, > > I am testing performance of a NVMe device (Intel P3700) using FIO at the > block device level and get 4x slower performance than expected: > > 4kB Random Read > > Intel Datasheet FIO Measurement Match > P3700 450,000 107,092 24% > DC S3700 75,000 67,186 90% > > The 2nd line are results for an Intel DC S3700 for comparison (with this > device, I do see the performance expected, but not for the P3700). > > Hardware: > > - 4 sockets, 48 core x86-64, 3TB RAM > - 8 x Intel P3700 2TB > - 12 x Intel DC S3700 800GB (via LSI HBAs) > > Software: > > FreeBSD 11 Current with patches (DMAR and ZFS patches, otherwise the box > doesn't boot at all .. because of 3TB RAM and the amount of periphery). Do you still have WITNESS and INVARIANTS turned on in your kernel config? They're turned on by default for Current, but they do have some performance impact. To turn them off, just build a GENERIC-NODEBUG kernel . > > Complete info and test logs are here: > > https://github.com/oberstet/scratchbox/blob/master/freebsd/cruncher/perftests.md > > Right now I am running Linux on the box (openSUSE 13.2). Using the exact > same FIO control file, the values for the DC S3700 are very close to > FreeBSD, but the values for the P3700 are much higher: > > https://github.com/oberstet/scratchbox/blob/master/freebsd/cruncher/perftests.md#more-numbers-linux > > I am looking for tuning hints or general advice for FreeBSD and NVMe. > > I would like to go with FreeBSD (a major aspect is ZFS), but the performance > issues with NVMe might be a deal breaker. > > Cheers, > /Tobias > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org"
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAOtMX2jVwMHSnQfphAF%2Ba2%2Bo7eLp62nHmUo4t%2BEahrXLWReaFQ>