From owner-freebsd-scsi@freebsd.org Wed Aug 17 23:13:09 2016 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CA5A1BBD35B for ; Wed, 17 Aug 2016 23:13:09 +0000 (UTC) (envelope-from maxg@mellanox.com) Received: from EUR01-VE1-obe.outbound.protection.outlook.com (mail-ve1eur01on0081.outbound.protection.outlook.com [104.47.1.81]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT SSL SHA2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id DDEA91686 for ; Wed, 17 Aug 2016 23:13:08 +0000 (UTC) (envelope-from maxg@mellanox.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=qcsrIbizvHzq8RFFOSwu/6K7QOmo6JywUvskwAmI6D0=; b=mvx93Ggixr/DvhXtX2yFaWnOkzZClQDRr0VRdQ+hC0MUVkiOpbqbrxDejV9Vxc2lVRbFo8nYp91U8923CriaX6PcPxe3AJSa6UvX6PTOY0nZYf5NcTqu+1JpmTrC+jOBe2lI1TysUL3JccbvpySBJVys75lkrElvL/hAAhwj9AE= Received: from AM3PR05CA040.eurprd05.prod.outlook.com (10.141.192.50) by VI1PR05MB1005.eurprd05.prod.outlook.com (10.162.11.140) with Microsoft SMTP Server (version=TLS1_0, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA_P384) id 15.1.557.21; Wed, 17 Aug 2016 22:39:49 +0000 Received: from DB3FFO11FD045.protection.gbl (2a01:111:f400:7e04::110) by AM3PR05CA040.outlook.office365.com (2a01:111:e400:882a::50) with Microsoft SMTP Server (version=TLS1_0, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA_P384) id 15.1.557.21 via Frontend Transport; Wed, 17 Aug 2016 22:39:49 +0000 Authentication-Results: spf=pass (sender IP is 193.47.165.134) smtp.mailfrom=mellanox.com; freebsd.org; dkim=none (message not signed) header.d=none;freebsd.org; dmarc=pass action=none header.from=mellanox.com; Received-SPF: Pass (protection.outlook.com: domain of mellanox.com designates 193.47.165.134 as permitted sender) receiver=protection.outlook.com; client-ip=193.47.165.134; helo=mtlcas13.mtl.com; Received: from mtlcas13.mtl.com (193.47.165.134) by DB3FFO11FD045.mail.protection.outlook.com (10.47.217.76) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.577.8 via Frontend Transport; Wed, 17 Aug 2016 22:39:49 +0000 Received: from MTLCAS13.mtl.com (10.0.8.78) by mtlcas13.mtl.com (10.0.8.78) with Microsoft SMTP Server (TLS) id 15.0.1178.4; Thu, 18 Aug 2016 01:39:48 +0300 Received: from MTLCAS01.mtl.com (10.0.8.71) by MTLCAS13.mtl.com (10.0.8.78) with Microsoft SMTP Server (TLS) id 15.0.1178.4 via Frontend Transport; Thu, 18 Aug 2016 01:39:48 +0300 Received: from [172.16.0.110] (172.16.0.110) by MTLCAS01.mtl.com (10.0.8.71) with Microsoft SMTP Server (TLS) id 14.3.301.0; Thu, 18 Aug 2016 01:39:47 +0300 Subject: Re: Help to make iSER working To: Ben RUBSON References: <71E4886B-61C3-4091-A7FF-E5A4F59AEACE@gmail.com> <64d8bc44-b6a3-4c0a-6d13-f919bf26685a@mellanox.com> <41CCC244-A781-4087-A811-B33847EDEC01@gmail.com> <6a464f2c-c048-d29c-e602-c129b35a5d4a@mellanox.com> <621BCC32-4612-410F-B658-D1086A7A3A09@gmail.com> <8207D6A0-3647-48B4-A4E0-3F1FCF3A6723@gmail.com> <6B335920-6818-4A44-A905-2425B4CFA812@gmail.com> CC: "freebsd-scsi@freebsd.org" , Oren Duer , Oded Shanoon , Meny Yossefi , Roy Shterman , Hans Petter Selasky From: Max Gurtovoy Message-ID: <8312894b-dce1-94c0-6faf-121cf2db58e5@mellanox.com> Date: Thu, 18 Aug 2016 01:39:46 +0300 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.2.0 MIME-Version: 1.0 In-Reply-To: <6B335920-6818-4A44-A905-2425B4CFA812@gmail.com> Content-Type: text/plain; charset="windows-1252"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [172.16.0.110] X-EOPAttributedMessage: 0 X-MS-Office365-Filtering-HT: Tenant X-Forefront-Antispam-Report: CIP:193.47.165.134; IPV:NLI; CTRY:IL; EFV:NLI; SFV:NSPM; SFS:(10009020)(6009001)(7916002)(2980300002)(438002)(43784003)(377454003)(189002)(66654002)(199003)(24454002)(45984002)(50466002)(81156014)(11100500001)(81166006)(4326007)(8676002)(33646002)(47776003)(36756003)(92566002)(31696002)(93886004)(83506001)(8936002)(31686004)(2950100001)(106466001)(2906002)(65956001)(19580395003)(65806001)(230700001)(189998001)(305945005)(23746002)(76176999)(110136002)(87936001)(77096005)(4001430100002)(7846002)(3846002)(7736002)(107886002)(6116002)(54356999)(64126003)(586003)(50986999)(86362001)(356003)(4001350100001)(19580405001)(5640300001)(626004)(65826006)(3940600001); DIR:OUT; SFP:1101; SCL:1; SRVR:VI1PR05MB1005; H:mtlcas13.mtl.com; FPR:; SPF:Pass; PTR:mail13.mellanox.com; MX:1; A:1; LANG:en; X-Microsoft-Exchange-Diagnostics: 1; DB3FFO11FD045; 1:Wqk72SkrdgAFxrYQxaStbMw8+TN/2UlT6xMisFICROZz/qNlsOMkgamqyMMXI4zmmZOqcyRFLpE+bm48PzhXSMH9b39sw0jLJICgi7y0HHFKZ+fBF3hOAJHrovnAQHkUeiwoNie0oQ7c5L0xA4REmr/xijwzp+74dNZW8yFvGSBML0gPqASj9okq7zKjFyxYcT4wYb7mmT8cdeJvJj+/XgsnCVm1ubOxfmkcAHdy7b+Q2QTPZ2sFUx2LcbGlVgEwVmFGbCkSiXUcDuAtt0QTh5lDRPo7LFhSYIwJUwqS6N75ryzK9Lg4t3PTzmlmFjd3096O8+CXMA4PGwx3bYsgyK9DJw/mJOMHrT90ur3jNM7gZNVeD4QO1anHXcZyAq88K/mJhc17NiW0wDjboAavGI6W9AnzlQ6lnf67M9ZndbU+60KfXSaT0nB3YAfQESLthg0/JoUphBrP9fwp9qwq9LjvOoQqsbgzBEIzYp4qDLbhxWiGC150eICTNV9MEsB2Yw6/06IZGFU28nDRJGvibs4UW6JqLHxC4Bw4waYfw1w= X-MS-Office365-Filtering-Correlation-Id: a567d782-252c-49e3-a588-08d3c6ef65f9 X-Microsoft-Exchange-Diagnostics: 1; VI1PR05MB1005; 2:/IvvB9JDEoGx+7v0mqH3WVONV8mq8st/3aMRx+e/XS0G0cIGPgAN/0zv17bnPMR7VB7N1bBqEVweIwccsTImTOZfbhSqZkcrdqG0e5/RW48eaN8GUnhABRAQMRX1lF27zYlBJV2cVEhZ8yNWVb+M0zUIO6Ymrut2AbaVOVWb3Q3yP70Eq5In3G0AXz27CefG; 3:ol6iQzWB3dqWR8IduoTkhRJZPwr5/BVgHTUJV5/j1qsuB3h690uE/y5eeEBtTzrTCLlrqwLGD58zopZHjMbBoYkkR8SA0V8mBQIpkV516CoVShEIc7iO6DlnxGs4Qc8k60uuLJnMVC6+P4CyF3jEfs6YqBwemPMBvzieCVYYNt6DlZcIQnTf9WWNwuSKcutUrD9XZH3xPvNt1Y8TDjxdLcykxTuvhdg+YmKAKOSFEvcMqysk/lnHeRIZBS7F32krR2bEAQj1v7Kareceuwq9lg== X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(8251501002); SRVR:VI1PR05MB1005; X-Microsoft-Exchange-Diagnostics: 1; VI1PR05MB1005; 25:xug/SSXzQpHp34hibPq/cBg9tJpejSieFoROReShnW96tmULzFcWWP8rZnONfXlSnsRdZyqnVX6tNpFfTyn9pf8qyY9jHc8FRoiikVrDGRr0HUXYvSMKEyKpsYLZ5jjjXpwF9lgEtU3RzMqNydx71ldCSmRB48vjcbU08ofvrQ0UgTcAXA4N+PsZvbTojtIhWQ7/lDb0mSGGny2wICkVwTdBgyMJ6bBbau7krOIwZYQdKAy1CnAGzhuxbDcmFmPqCeU4CB9xMnOWmXsZqyyyheO9jbzLl0oD/+XNBjsszRCO8+RJn6rXCQ4oguaYU+zYqvgzFKoZfoXSPq7He+7TH0UTLp1h/hKQmm/ziFwXn5Wcgw5oCbNEfiTGwLR/jE2/5W1ZNuLjEZxRp8R78/C9WMBuv4TzyenHI2aNcZPR1ybiCXAb0DlSRhkcWMBpL5Ezy08322OFN37jcRQQElZSgnvZ+vKx4GhNOvbnrCDemJoi0pwlDQ6Vz/mSB4tUapEutFcLXiNFnTj8tdOZzylhmu+WpIaciBOQ22y5P42x0wnf4GC9ZeJ2AdXADaEjYKFFlEDpup0WmtsZ0XZMLYywI89PjPtZzmUvIZnD8WTwc5of6EmgyZc/kUzDjQnpN6kbMyVysK5QQsiRpkhD1Z+mN2EErtm4AsRiwGHFPZGPwGcoMq+mLS01QTjz9Sia9/03ytWCXTnDl55CgLY49EJcDZ6UzbMhCpEbq/aOTDRXuDQ6K6KhBPxJQmfWXTIzEW5J//1KKTFckybV4crfs4pIOg== X-Microsoft-Exchange-Diagnostics: 1; VI1PR05MB1005; 31:lmqRlbRTMSb/U+2qcHf5h6rH3nkozivXTbUBVq25eJnglrOv857lfbSMX+jzrDyTFK9n/RLm09rw7YazQEHLutjDP0ED12di0Zfdzs+ARIUQJ/8fkkBcq7JrHLAGH+sfaCWQP4i1A0kaC2uqXkeafLiKd7/fkyOqa/F/c3frKzSgCuTzMYSNSoQCvvlB+OpzlBP+fR/UP+3NfldDc5kdZuQtNWSkqtJO65pbD8tltvE=; 20:LN8JlKvKdZFgdkCxIDqdfkxe8wJ9N7SBXuVD1JO/kotLDdu9ZVhugt/+vT//j3nCLEXemeT4dHggaeoauR2wlo5u62nv+ICfRNzPoJF8OaHel2/aMVhnw0zTN9pkxYmsXGbw7aY583/YoTGsR+1f/RGkTEcTAeZusFJqJ1c6g6trypJ63ZrkeOryOon5hC8btON5wa1ODBxrXHRkgOqdZ+jcyaV0kmvhmNGD7sNxPsr9Fyef163lRmqBVmBpbIFPeH176s7HUvN2o2dK1THyOjYdniV8wlmYibUI8evFHPjT+A+tSFtwtqqWgBu/YDPRjb7R6IGh8betauGcidLqByBUtrI9zGR9buEN+9azHKkDfKtPfH5biBkiLcrtBHZDw2BT2DMPBosMV8WCXk2G6/Wf0Ma2FRxhLJhDY4ywXMkgriFVFwojp7jZ4VrE8asAxxJzlgO40sw4Z3Q7oRK6E9hnnoCOzZx2zyswPrujslkxQUJ3em7J9zzl81K8kghW X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(6040176)(601004)(2401047)(5005006)(8121501046)(13018025)(13016025)(3002001)(10201501046)(6055026); SRVR:VI1PR05MB1005; BCL:0; PCL:0; RULEID:; SRVR:VI1PR05MB1005; X-Microsoft-Exchange-Diagnostics: 1; VI1PR05MB1005; 4:msDUBikYbmmUaMHPtfVdeUk4qaOOewx9p3bo+zUUWDhkeZ+0jHd3msAVO3Ikncnmg/WK6AZhuNTDtq1eLNa61zq6szxA5tKMlarr/Tt26YG83RkjeGe+rgm1sc4R8iLc98/fSyJzO2LhC5HZr99xZDLIxvBYrLgaMjJsYaC3CULN4eY3D1pNb1fTPW1mlBJYssj9dsbm3ozvklfqUArM+BH6V7Hz0yAnvTWUgijxEKNFYmo0yG81cK/Z7OqpiY75BPn5zXcLzrHN95KThtc3+4i+beMMF/fppNtXvV47f73lCbU04cffUjurf6R/jQvwSTscE3aa5vVGVj1+iqTWl2KC7cwhvR8YUV7vpCIM9BMrqb9nKpd2AWxvGFxD9NkSGLy5vZS2lJhB1tqNkRcHXH8hJg5oAUVMR1NSh6BpVnqsFCGzkYeGRqKBQCL8rvoB X-Forefront-PRVS: 0037FD6480 X-Microsoft-Exchange-Diagnostics: =?Windows-1252?Q?1; VI1PR05MB1005; 23:k705M2pIYdUUS3iSvEYg59F6QRDM1XlDAS8P4?= =?Windows-1252?Q?HP/M0N+pM3GxJMx0kiZxHiV3Y8NYvM1+/oK0nCJgHwyZYx0HoCyROhjf?= =?Windows-1252?Q?tyT6PMNQtguVwd1GojPiJLc5pWneFTF+dK84kVPuQXMqrdVVwycI+WYY?= =?Windows-1252?Q?XPPeH82JTKFEiPllS1XGOr2aEdq4sT/hleZ4hCUTTkkZyXtzD5PUrEk7?= =?Windows-1252?Q?7kYjxRJ++4GQQTgJisc/AUbKAOHaMa76fODduxlfW8Tc+Mgg/IIshk2C?= =?Windows-1252?Q?bqaiWFkSicV4hRUB1VWeZdLEMO1NHKQZseq3P5hMo6sFfrPJMB9yn6iF?= =?Windows-1252?Q?DU+GArCOPlAt58XxFcZYYCIje6Oh+EQMIqyKqWe9PyJrM3MACZz4coMw?= =?Windows-1252?Q?CSMAwUGiTkVp3VMKZXug/h02+dQbaqVk50tVn9q07HZVGqnngcQwAAeH?= =?Windows-1252?Q?OMPSCcJpaqb4Aw6G57GOB2xmAWneUxvSNI/K+S5lYfSEQDfMs7oHVmiF?= =?Windows-1252?Q?1Wg/Af+FEs2JVLsi9Vz7BE8JH+WC0Pcv6bInEfAfzCaoPt2UnFZnbqP2?= =?Windows-1252?Q?Z7BA5qjw5HuM6J+wB1xC7zZIhzizysrAWIa4uVVfunkSNXcw0VbU00AS?= =?Windows-1252?Q?xgMP/lvtVwGyPqpCM8G7sLNLnviG5qESJ2U49vKcN6PrGG6oeBmCf9P9?= =?Windows-1252?Q?S1GVJYFZ/rvfYv3qDej2Bwozi9us8OCCJJ7vH7rjepHzu3Y1bHtLdWvy?= =?Windows-1252?Q?65oGdM1h38hPUTArflhIaAo5uIT0J4ifUwOGzLc1L0xPJ9jUAlIUEmkB?= =?Windows-1252?Q?ZrMez+4Dg5SDqRam+vqYUTwohUCtnUVvi5Y8fRv+zzN/0uYbWSLQsLEz?= =?Windows-1252?Q?ZrBbV4RdK5UsEBdTDeLT+JhjfhnK71OUOAseD5sS9alB71j1GERydkQC?= =?Windows-1252?Q?Y/6km10v0tDQ4cffeaoD287BYYVa3rnKGC36H3rT0QULh+h/v4/d8mE4?= =?Windows-1252?Q?PSaP5La2eaAmbUYKZY4DMVA4VbCIFicXly+faEAIUzJEgY/vSJgtZ/ZG?= =?Windows-1252?Q?gB0qVVrjZRR872FwicWPQFFjgTFegHDZtCvBKJA+YOC5eqsom14or48+?= =?Windows-1252?Q?gnEovGXdglFPlxA7GhfjEFdrm4C4G2v8RF++6oIk0Jn905OKlD/OEvjK?= =?Windows-1252?Q?zQ8FHmEqc+LF94BElD4/vTWLkgnfaDafuH6dXQZErb9qYLbNEwhyECIi?= =?Windows-1252?Q?ZQX7R66ANgrVvek0WN/lu5gmyt+9br7o4mnnVHDQsPI+vJQarL0YMpXh?= =?Windows-1252?Q?0BacihPytGXwgPBGdeeepzZJdxLyHLkPsuJCUAc+7KdS82i9Kw5qzbwG?= =?Windows-1252?Q?N6gfdv0CnenhIadvcnWc/yG2DVNreEqZRtnToH+Jhp/uOGo4jBJUOXei?= =?Windows-1252?Q?QXRiSGO9TrO13KCxGl93bqNJmUYRi0vX292cOTAcgd+zBl8/syIukAzo?= =?Windows-1252?Q?vxJJE7i1+Il9RfqibxcgeJQXcNNoTCjmYjVm/IpTRxwrBgiMQ=3D=3D?= X-Microsoft-Exchange-Diagnostics: 1; VI1PR05MB1005; 6:DyrLGtP0qgGsjm21FxsuFtEyoPzt1axKIGoPM2fvbvvor0oma6r6JFXZMFcqYWSLMZ18kytMddPdOyNtIiNJKqy/AmnFfn+E4TCU08hnIawCF7qwe3g3xRyJcO0CZ0GRKmHULeVm9624pCWB+mU5/ThRbt9UGzM3Sm/gFenex+KgLrJndZOgSXSj/csU7eO1HymdfL0eVRlTxfXiqBUKMRgE0KeqskP0wjKaYArDgqChXilaFlGUvBv/CuRsrm79u9w1Qcga8T9BSqH/eixnWi0JMkgf50GD55pSR4PCQR+2jfjvpn6IYyCXOy75zzM3xCKIUlJI8wFuRK6ZIlbw7A==; 5:C6u7/MbqY6kw09O4YHBkhuezL95yTMCFcDh4BOaPP6mmhH+zrKrn9NJxHiWFh+t7ICPzE82+Ku4mJ1HNJ5MsnXXbmZBjCEwv1QWmJe2uIhZmZ9Vz+C/iLFXziFyDx530OYUouCyDWZR/gT/o5Sb2sw==; 24:ofSJ5WStiYcNgiWFWFwSf4/vNtuQeYwa0jm9Ppn9M33Y219XqMzX5/81vMPmm3PLaXVyLsDBHFWvrYo39kGQ6IzQ+dtLmHT/V56JW92TifI=; 7:I5nxMRmatippQz26MxyczyX/7M2k0M3rlXg1eDiJAWjkg5Isg+QC3Wvnhr4K7mFt1hp08tPdafPpRQXHQsPv07S79GF3+E0K7rl3JBFRw474//0QbJ7QQpH/tBiAQ3UXnlFZGlGBifzEVxMnYYBL/wxVUkfZVc3Q90SdeE0l8e4ZfzaAZsHB0OTyvvTPiafJLnZqFF8AwKwuIB3cXyg03bIysvWFdOIbDmIMp0mqHgvdfmdtqr4O0LeWvsZSFQYF SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 17 Aug 2016 22:39:49.7686 (UTC) X-MS-Exchange-CrossTenant-Id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=a652971c-7d2e-4d9b-a6a4-d149256f461b; Ip=[193.47.165.134]; Helo=[mtlcas13.mtl.com] X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: VI1PR05MB1005 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Aug 2016 23:13:09 -0000 NP. I never tried it on FreeBSD but you can try to build the user space target TGT on it. Maybe you'll need some adaptations but should be easier that adding a new iser target driver from scratch. On 8/16/2016 1:11 PM, Ben RUBSON wrote: > Thank you very much Max for all your advices. > > These tests were really interesting as they demonstrated that iSER can easily improve my iSCSI storage infrastructure throughput. > > Unfortunately, for production purpose, I need FreeBSD as the target system. > I will then keep an eye on future FreeBSD releases related to iSER. > > Thank you again ! > > Ben > > > >> On 16 Aug 2016, at 00:12, Max Gurtovoy wrote: >> >> Good to see that you got a nice progress there. >> You can try the fio tool and see even better performance. >> You can also use Mellanox community site to see how to reach wire spead and leaverage your numbers. The iser posts are mostly for linux users but you can find it helpfull for your needs to. >> >> Thanks, >> Max. >> >> On 8/15/2016 12:11 AM, Ben RUBSON wrote: >>> >>>> On 13 Aug 2016, at 15:12, Ben RUBSON wrote: >>>> >>>> Benchmarks will of course follow. >>> >>> (also posted @freebsd-fs) >>> >>> I then used Linux TGT as a test target. >>> >>> ### Target : local disk throughput, one thread : >>> # dd if=/dev/da8 of=/dev/null bs=$((128*1024)) count=81920 >>> 10737418240 bytes (11 GB) copied, 21.3898 s, 502 MB/s >>> >>> ### Initiator : iscsi disk throughput, one thread : >>> # dd if=/dev/da8 of=/dev/null bs=$((128*1024)) count=81920 >>> 10737418240 bytes transferred in 34.938676 secs (307321843 bytes/sec) - 293 MB/s >>> >>> ### Initiator : iSER disk throughput, one thread : >>> # dd if=/dev/da8 of=/dev/null bs=$((128*1024)) count=81920 >>> 10737418240 bytes transferred in 20.371947 secs (527068838 bytes/sec) - 502 MB/s >>> >>> In my example, iSER allows to reach the raw disk throughput (on one thread), whereas iSCSI/TCP is a bottleneck. >>> >>> I also tested with a target RAM device : >>> >>> ### Initiator : iscsi RAM throughput, one thread : >>> # dd if=/dev/da8 of=/dev/null bs=$((128*1024)) count=81920 >>> 10737418240 bytes transferred in 24.194665 secs (443792803 bytes/sec) - 423 MB/s >>> >>> ### Initiator : iSER RAM throughput, one thread : >>> # dd if=/dev/da8 of=/dev/null bs=$((128*1024)) count=81920 >>> 10737418240 bytes transferred in 10.991094 secs (976919873 bytes/sec) - 932 MB/s >>> (just don't know what is the bottleneck here, of course not the RAM, and network on one thread is around 30GB/s) >>> >>>> On 11 Aug 2016, at 01:13, Max Gurtovoy wrote: >>>> >>>> Regarding plans for the target side, it's not on my plate for the near future (but obviously can be later on :)). >>>> I'm not aware of other contributers plans. >>> >>> >>> Can't wait to see this then :) >>> >>> Many thanks again ! >>> >>> Best regards, >>> >>> Ben >>> >>> >