From owner-freebsd-stable@FreeBSD.ORG Fri Jan 16 08:12:29 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 30EE83AD for ; Fri, 16 Jan 2015 08:12:29 +0000 (UTC) Received: from mail-we0-x233.google.com (mail-we0-x233.google.com [IPv6:2a00:1450:400c:c03::233]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B4E88B36 for ; Fri, 16 Jan 2015 08:12:28 +0000 (UTC) Received: by mail-we0-f179.google.com with SMTP id q59so18863701wes.10 for ; Fri, 16 Jan 2015 00:12:27 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:subject:references :in-reply-to:content-type:content-transfer-encoding; bh=iPv3GyzDYdpsLva1j34S3SnakCZkPTbijboqWGuIt2g=; b=Jho+yjofEZrNHDbMmR008SRU2vm7n8vzYVVWjDC5oUW0dxY/97CcpGyzrualKxTy4m XbmJo08lQ399Y7bg3xKS1LdlDQxbXv27bvx39hqeB4UOjcX62GfAZgBfXPqtP6e+dhz9 2lqhsCXFOq11guLqJAXR9jfRcwfJvkJ7RNszvqGNMy2h45SsuVJSouU9Ll5hysTqZQgH zATQCckjaD6bm+bOZXr14DnedswTUreHUK/EcUKe+vSXrGgZWsJCkiPVucaBm+YkNVuC aZbzSAyMtT59oIjxGKCIvco8iCQ6Y/tm4Ge8la+Sva6uRi9549cd52JXzvF0FEIiXEUe werQ== X-Received: by 10.180.211.169 with SMTP id nd9mr3724440wic.4.1421395947080; Fri, 16 Jan 2015 00:12:27 -0800 (PST) Received: from [192.168.3.105] ([193.148.0.35]) by mx.google.com with ESMTPSA id e18sm5020840wjz.27.2015.01.16.00.12.25 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 16 Jan 2015 00:12:26 -0800 (PST) Message-ID: <54B8C7E9.3030602@gmail.com> Date: Fri, 16 Jan 2015 10:12:25 +0200 From: Mihai Vintila User-Agent: Mozilla/5.0 (Windows NT 6.1; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: freebsd-stable@freebsd.org Subject: Re: Poor performance on Intel P3600 NVME driver References: <54B7F769.40605@gmail.com> <20150115175927.GA19071@zxy.spb.ru> In-Reply-To: <20150115175927.GA19071@zxy.spb.ru> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 Jan 2015 08:12:29 -0000 I've tried to increase it and obtained around 90k iops for write, but now i only get : nvme0: WRITE sqid:6 cid:125 nsid:1 lba:3907028496 len:16 nvme0: WRITE FAULTS (02/80) sqid:6 cid:125 cdw0:0 nvme0: async event occurred (log page id=0x1) nvme0: WRITE sqid:6 cid:126 nsid:1 lba:528 len:16 nvme0: WRITE FAULTS (02/80) sqid:6 cid:126 cdw0:0 nvme0: async event occurred (log page id=0x1) nvme0: WRITE sqid:6 cid:127 nsid:1 lba:3907027984 len:16 nvme0: WRITE FAULTS (02/80) sqid:6 cid:127 cdw0:0 nvme0: async event occurred (log page id=0x1) Best regards, Vintila Mihai Alexandru On 1/15/2015 7:59 PM, Slawa Olhovchenkov wrote: > On Thu, Jan 15, 2015 at 07:22:49PM +0200, Mihai Vintila wrote: > >> /etc/sysctl.conf >> >> net.inet.tcp.fast_finwait2_recycle=1 >> net.inet.ip.portrange.randomized=0 >> net.inet.ip.portrange.first=1024 >> net.inet.ip.portrange.last=65535 >> net.inet.tcp.recvbuf_max=16777216 >> net.inet.tcp.sendbuf_max=16777216 >> net.inet.tcp.recvbuf_inc=65536 >> vfs.zfs.vdev.trim_on_init=0 >> #close time_wait connections at 2*7500ms >> net.inet.tcp.msl=7500 >> kern.ipc.somaxconn=4096 >> net.inet.icmp.icmplim=2000 >> >> #zfs >> vfs.zfs.txg.timeout=5 >> vfs.zfs.prefetch_disable=1 > >> Any help to bring this device to proper speed will be welcomed. > Do you try to increase vfs.zfs.top_maxinflight?