From owner-freebsd-infiniband@FreeBSD.ORG Tue Aug 19 05:37:19 2014 Return-Path: Delivered-To: freebsd-infiniband@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 2BFFE58A for ; Tue, 19 Aug 2014 05:37:19 +0000 (UTC) Received: from natial.ongs.co.jp (natial.ongs.co.jp [202.216.246.90]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id F41A730CA for ; Tue, 19 Aug 2014 05:37:15 +0000 (UTC) Received: from [192.168.10.31] (unknown [118.22.43.70]) by natial.ongs.co.jp (Postfix) with ESMTPSA id A5EB62744D for ; Tue, 19 Aug 2014 14:27:40 +0900 (JST) From: Daichi GOTO Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Subject: InfiniBand cards and switches FreeBSD can handle Message-Id: <9FA9E7B5-699E-4FA2-AA4E-4D105E2A9289@ongs.co.jp> Date: Tue, 19 Aug 2014 14:27:37 +0900 To: freebsd-infiniband@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) X-Mailer: Apple Mail (2.1878.6) X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 Aug 2014 05:37:19 -0000 I'm looking for new InfiniBand cards and switches that FreeBSD can handle. Do you know anything about? Thanks. Best regards, -- Daichi GOTO CEO | ONGS Inc. 81-42-316-7945 | daichi@ongs.co.jp | http://www.ongs.co.jp LinkedIn: http://linkedin.com/in/daichigoto From owner-freebsd-infiniband@FreeBSD.ORG Tue Aug 19 11:52:24 2014 Return-Path: Delivered-To: freebsd-infiniband@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 2D4D5624 for ; Tue, 19 Aug 2014 11:52:24 +0000 (UTC) Received: from emea01-am1-obe.outbound.protection.outlook.com (mail-am1lrp0012.outbound.protection.outlook.com [213.199.154.12]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "MSIT Machine Auth CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id AD6333501 for ; Tue, 19 Aug 2014 11:52:22 +0000 (UTC) Received: from DB3PR05MB026.eurprd05.prod.outlook.com (10.242.137.13) by DB3PR05MB026.eurprd05.prod.outlook.com (10.242.137.13) with Microsoft SMTP Server (TLS) id 15.0.1005.10; Tue, 19 Aug 2014 11:37:34 +0000 Received: from DB3PR05MB026.eurprd05.prod.outlook.com ([169.254.2.75]) by DB3PR05MB026.eurprd05.prod.outlook.com ([169.254.2.75]) with mapi id 15.00.1005.008; Tue, 19 Aug 2014 11:37:34 +0000 From: Oded Shanoon To: Daichi GOTO , "freebsd-infiniband@freebsd.org" Subject: RE: InfiniBand cards and switches FreeBSD can handle Thread-Topic: InfiniBand cards and switches FreeBSD can handle Thread-Index: AQHPu2/CWWgZiT2N+km4m2WW3t78f5vXzKvw Date: Tue, 19 Aug 2014 11:37:34 +0000 Message-ID: <248cbc55d88343af987a227f5e55ecb6@DB3PR05MB026.eurprd05.prod.outlook.com> References: <9FA9E7B5-699E-4FA2-AA4E-4D105E2A9289@ongs.co.jp> In-Reply-To: <9FA9E7B5-699E-4FA2-AA4E-4D105E2A9289@ongs.co.jp> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [193.47.165.251] x-microsoft-antispam: BCL:0;PCL:0;RULEID:;UriScan:; x-forefront-prvs: 0308EE423E x-forefront-antispam-report: SFV:NSPM; SFS:(10009006)(6009001)(189002)(13464003)(377454003)(199003)(87936001)(15975445006)(76176999)(33646002)(15202345003)(83322001)(85306004)(2656002)(16601075003)(92566001)(54356999)(74316001)(83072002)(81542001)(20776003)(99396002)(15395725005)(76576001)(80022001)(85852003)(21056001)(19580405001)(64706001)(66066001)(76482001)(74662001)(107886001)(107046002)(77982001)(106356001)(74502001)(81342001)(105586002)(46102001)(86362001)(106116001)(4396001)(19580395003)(77096002)(95666004)(50986999)(108616004)(31966008)(101416001)(79102001)(24736002); DIR:OUT; SFP:1101; SCL:1; SRVR:DB3PR05MB026; H:DB3PR05MB026.eurprd05.prod.outlook.com; FPR:; MLV:sfv; PTR:InfoNoRecords; MX:1; A:1; LANG:en; Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: Mellanox.com X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 Aug 2014 11:52:24 -0000 Mellanox have Infiniband cards (ConnectX-3, ConnectX-2, Connect-IB...) and = switches. What exactly do you need? Regards, Oded Shanoon OFED-FreeBSD Team Leader Mellanox Technologies, Raanana -----Original Message----- From: owner-freebsd-infiniband@freebsd.org [mailto:owner-freebsd-infiniband= @freebsd.org] On Behalf Of Daichi GOTO Sent: Tuesday, August 19, 2014 8:28 AM To: freebsd-infiniband@freebsd.org Subject: InfiniBand cards and switches FreeBSD can handle I'm looking for new InfiniBand cards and switches that FreeBSD can handle. Do you know anything about? Thanks. Best regards, -- Daichi GOTO CEO | ONGS Inc. 81-42-316-7945 | daichi@ongs.co.jp | http://www.ongs.co.jp LinkedIn: http://linkedin.com/in/daichigoto _______________________________________________ freebsd-infiniband@freebsd.org mailing list http://lists.freebsd.org/mailma= n/listinfo/freebsd-infiniband To unsubscribe, send any mail to "freebsd-infiniband-unsubscribe@freebsd.or= g" From owner-freebsd-infiniband@FreeBSD.ORG Tue Aug 19 12:02:07 2014 Return-Path: Delivered-To: freebsd-infiniband@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id F1F78A8B for ; Tue, 19 Aug 2014 12:02:07 +0000 (UTC) Received: from eu1sys200aog103.obsmtp.com (eu1sys200aog103.obsmtp.com [207.126.144.115]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 247DC35F7 for ; Tue, 19 Aug 2014 12:02:06 +0000 (UTC) Received: from MTLCAS02.mtl.com ([193.47.165.155]) (using TLSv1) by eu1sys200aob103.postini.com ([207.126.147.11]) with SMTP ID DSNKU/M8uo1Dwhr5x8drsS9fFlq5BVOv3rm4@postini.com; Tue, 19 Aug 2014 12:02:07 UTC Received: from MTLDAG02.mtl.com ([10.0.8.76]) by MTLCAS02.mtl.com ([10.0.8.72]) with mapi id 14.03.0123.003; Tue, 19 Aug 2014 14:55:26 +0300 From: Yoni Luzon To: Oded Shanoon , Daichi GOTO , "freebsd-infiniband@freebsd.org" , "Chris Tsumura" Subject: RE: InfiniBand cards and switches FreeBSD can handle Thread-Topic: InfiniBand cards and switches FreeBSD can handle Thread-Index: AQHPu2/CWWgZiT2N+km4m2WW3t78f5vXzKvwgAAFF0A= Date: Tue, 19 Aug 2014 11:55:25 +0000 Message-ID: References: <9FA9E7B5-699E-4FA2-AA4E-4D105E2A9289@ongs.co.jp> <248cbc55d88343af987a227f5e55ecb6@DB3PR05MB026.eurprd05.prod.outlook.com> In-Reply-To: <248cbc55d88343af987a227f5e55ecb6@DB3PR05MB026.eurprd05.prod.outlook.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.0.13.1] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 Aug 2014 12:02:08 -0000 + Chris: Japan Sales Manager. Regards, Yoni -----Original Message----- From: Oded Shanoon=20 Sent: Tuesday, August 19, 2014 14:38 To: Daichi GOTO; freebsd-infiniband@freebsd.org Subject: RE: InfiniBand cards and switches FreeBSD can handle Mellanox have Infiniband cards (ConnectX-3, ConnectX-2, Connect-IB...) and = switches. What exactly do you need? Regards, Oded Shanoon OFED-FreeBSD Team Leader Mellanox Technologies, Raanana -----Original Message----- From: owner-freebsd-infiniband@freebsd.org [mailto:owner-freebsd-infiniband= @freebsd.org] On Behalf Of Daichi GOTO Sent: Tuesday, August 19, 2014 8:28 AM To: freebsd-infiniband@freebsd.org Subject: InfiniBand cards and switches FreeBSD can handle I'm looking for new InfiniBand cards and switches that FreeBSD can handle. Do you know anything about? Thanks. Best regards, -- Daichi GOTO CEO | ONGS Inc. 81-42-316-7945 | daichi@ongs.co.jp | http://www.ongs.co.jp LinkedIn: http://linkedin.com/in/daichigoto _______________________________________________ freebsd-infiniband@freebsd.org mailing list http://lists.freebsd.org/mailma= n/listinfo/freebsd-infiniband To unsubscribe, send any mail to "freebsd-infiniband-unsubscribe@freebsd.or= g" From owner-freebsd-infiniband@FreeBSD.ORG Wed Aug 20 03:29:56 2014 Return-Path: Delivered-To: freebsd-infiniband@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 502DCA1 for ; Wed, 20 Aug 2014 03:29:56 +0000 (UTC) Received: from natial.ongs.co.jp (natial.ongs.co.jp [202.216.246.90]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 191E63220 for ; Wed, 20 Aug 2014 03:29:55 +0000 (UTC) Received: from [192.168.1.106] (dullmdaler.ongs.co.jp [202.216.246.94]) by natial.ongs.co.jp (Postfix) with ESMTPSA id 3DF362744D; Wed, 20 Aug 2014 12:29:52 +0900 (JST) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: InfiniBand cards and switches FreeBSD can handle From: Daichi GOTO In-Reply-To: Date: Wed, 20 Aug 2014 12:29:51 +0900 Content-Transfer-Encoding: quoted-printable Message-Id: References: <9FA9E7B5-699E-4FA2-AA4E-4D105E2A9289@ongs.co.jp> <248cbc55d88343af987a227f5e55ecb6@DB3PR05MB026.eurprd05.prod.outlook.com> To: Yoni Luzon X-Mailer: Apple Mail (2.1878.6) Cc: Chris Tsumura , "freebsd-infiniband@freebsd.org" X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 20 Aug 2014 03:29:56 -0000 Thank you Oded,=20 We are planning to build-up an InfiniBand-connected cluster as=20 HPC platform using 6 PCs (1 master and 5 slaves, each has at least a PCIe x16 slot). ------ |MASTER| ------ | ----------------- | switch | ----------------- | | | | | - - - - - |S| |S| |S| |S| |S| - - - - - We already have two clusters, one is using InfiniBand / Linux /=20 OpenMPI, another is 10GbE / FreeBSD / TCP (connection architecture is the same as above). Of course, the Linux/InfiniBand cluster is=20 faster than the 10GbE/FreeBSD version. We want to build-up FreeBSD InfiniBand version cluster as fast as Linux version. So we need fastest InfiniBand cards and switches that FreeBSD can = handle. What cards and switches do you recommend? 2014/08/19 20:55=E3=80=81Yoni Luzon : > + Chris: Japan Sales Manager. >=20 >=20 > Regards, > Yoni >=20 > -----Original Message----- > From: Oded Shanoon=20 > Sent: Tuesday, August 19, 2014 14:38 > To: Daichi GOTO; freebsd-infiniband@freebsd.org > Subject: RE: InfiniBand cards and switches FreeBSD can handle >=20 > Mellanox have Infiniband cards (ConnectX-3, ConnectX-2, Connect-IB...) = and switches. > What exactly do you need? >=20 >=20 > Regards, >=20 > Oded Shanoon > OFED-FreeBSD Team Leader > Mellanox Technologies, Raanana >=20 >=20 > -----Original Message----- > From: owner-freebsd-infiniband@freebsd.org = [mailto:owner-freebsd-infiniband@freebsd.org] On Behalf Of Daichi GOTO > Sent: Tuesday, August 19, 2014 8:28 AM > To: freebsd-infiniband@freebsd.org > Subject: InfiniBand cards and switches FreeBSD can handle >=20 > I'm looking for new InfiniBand cards and switches that FreeBSD can = handle. > Do you know anything about? Thanks. >=20 > Best regards, >=20 > -- > Daichi GOTO > CEO | ONGS Inc. > 81-42-316-7945 | daichi@ongs.co.jp | http://www.ongs.co.jp > LinkedIn: http://linkedin.com/in/daichigoto >=20 > _______________________________________________ > freebsd-infiniband@freebsd.org mailing list = http://lists.freebsd.org/mailman/listinfo/freebsd-infiniband > To unsubscribe, send any mail to = "freebsd-infiniband-unsubscribe@freebsd.org" >=20 -- =E5=BE=8C=E8=97=A4=E5=A4=A7=E5=9C=B0 =E4=BB=A3=E8=A1=A8=E5=8F=96=E7=B7=A0=E5=BD=B9 | =E6=9C=89=E9=99=90=E4=BC=9A= =E7=A4=BE=E3=82=AA=E3=83=B3=E3=82=B0=E3=82=B9 042-316-7945 | daichi@ongs.co.jp | http://www.ongs.co.jp LinkedIn: http://linkedin.com/in/daichigoto From owner-freebsd-infiniband@FreeBSD.ORG Wed Aug 20 09:47:27 2014 Return-Path: Delivered-To: freebsd-infiniband@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C11DABD5 for ; Wed, 20 Aug 2014 09:47:27 +0000 (UTC) Received: from biz112.inmotionhosting.com (biz112.inmotionhosting.com [205.134.249.19]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A47FA35A1 for ; Wed, 20 Aug 2014 09:47:27 +0000 (UTC) Received: from 75-37-200-187.lightspeed.snmtca.sbcglobal.net ([75.37.200.187]:53243 helo=SB2) by biz112.inmotionhosting.com with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.82) (envelope-from ) id 1XJdKy-0008RN-EM; Mon, 18 Aug 2014 23:56:12 -0700 From: "Sven Brehmer" To: "'Daichi GOTO'" , References: <9FA9E7B5-699E-4FA2-AA4E-4D105E2A9289@ongs.co.jp> In-Reply-To: <9FA9E7B5-699E-4FA2-AA4E-4D105E2A9289@ongs.co.jp> Subject: RE: InfiniBand cards and switches FreeBSD can handle Date: Mon, 18 Aug 2014 23:56:11 -0700 Message-ID: <076c01cfbb7a$a9341240$fb9c36c0$@polycoresoftware.com> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Outlook 15.0 Thread-Index: AQNKrQuI+AjgK/ESpbPH6TfdhFC4z5jhmW+Q Content-Language: en-us X-OutGoing-Spam-Status: No, score=-102.9 X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - biz112.inmotionhosting.com X-AntiAbuse: Original Domain - freebsd.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - polycoresoftware.com X-Get-Message-Sender-Via: biz112.inmotionhosting.com: authenticated_id: sven@polycoresoftware.com X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 20 Aug 2014 09:47:27 -0000 Hello GOTO-san, Mellanox MHQH29-XTC cards works fine. Regards, Sven Brehmer -----Original Message----- From: owner-freebsd-infiniband@freebsd.org [mailto:owner-freebsd-infiniband@freebsd.org] On Behalf Of Daichi GOTO Sent: Monday, August 18, 2014 22:28 To: freebsd-infiniband@freebsd.org Subject: InfiniBand cards and switches FreeBSD can handle I'm looking for new InfiniBand cards and switches that FreeBSD can handle. Do you know anything about? Thanks. Best regards, -- Daichi GOTO CEO | ONGS Inc. 81-42-316-7945 | daichi@ongs.co.jp | http://www.ongs.co.jp LinkedIn: http://linkedin.com/in/daichigoto _______________________________________________ freebsd-infiniband@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-infiniband To unsubscribe, send any mail to "freebsd-infiniband-unsubscribe@freebsd.org" From owner-freebsd-infiniband@FreeBSD.ORG Sat Aug 23 06:24:15 2014 Return-Path: Delivered-To: freebsd-infiniband@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 6FF1CD23 for ; Sat, 23 Aug 2014 06:24:15 +0000 (UTC) Received: from natial.ongs.co.jp (natial.ongs.co.jp [202.216.246.90]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3F5CF3485 for ; Sat, 23 Aug 2014 06:24:14 +0000 (UTC) Received: from [192.168.1.106] (dullmdaler.ongs.co.jp [202.216.246.94]) by natial.ongs.co.jp (Postfix) with ESMTPSA id 8B2972744D; Sat, 23 Aug 2014 15:24:04 +0900 (JST) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: InfiniBand cards and switches FreeBSD can handle From: Daichi GOTO In-Reply-To: <076c01cfbb7a$a9341240$fb9c36c0$@polycoresoftware.com> Date: Sat, 23 Aug 2014 15:24:03 +0900 Content-Transfer-Encoding: quoted-printable Message-Id: References: <9FA9E7B5-699E-4FA2-AA4E-4D105E2A9289@ongs.co.jp> <076c01cfbb7a$a9341240$fb9c36c0$@polycoresoftware.com> To: Sven Brehmer X-Mailer: Apple Mail (2.1878.6) Cc: freebsd-infiniband@freebsd.org X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 23 Aug 2014 06:24:15 -0000 Thanks Sven, I know that it's difficult to obtain ConnectX cards in the now. I expect that ConnectIB or ConnectX-3 cards are easy to buy. Do someone use any ConnectIB or ConnectX-3 cards by FreeBSD 10.0? Best regards, 2014/08/19 15:56=E3=80=81Sven Brehmer = =E3=81=AE=E3=83=A1=E3=83=BC=E3=83=AB=EF=BC=9A > Hello GOTO-san, >=20 > Mellanox MHQH29-XTC cards works fine. >=20 > Regards, > Sven Brehmer >=20 > -----Original Message----- > From: owner-freebsd-infiniband@freebsd.org > [mailto:owner-freebsd-infiniband@freebsd.org] On Behalf Of Daichi GOTO > Sent: Monday, August 18, 2014 22:28 > To: freebsd-infiniband@freebsd.org > Subject: InfiniBand cards and switches FreeBSD can handle >=20 > I'm looking for new InfiniBand cards and switches that FreeBSD can = handle. > Do you know anything about? Thanks. >=20 > Best regards, >=20 > -- > Daichi GOTO > CEO | ONGS Inc. > 81-42-316-7945 | daichi@ongs.co.jp | http://www.ongs.co.jp > LinkedIn: http://linkedin.com/in/daichigoto >=20 > _______________________________________________ > freebsd-infiniband@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-infiniband > To unsubscribe, send any mail to > "freebsd-infiniband-unsubscribe@freebsd.org" >=20 -- Daichi GOTO CEO | ONGS Inc. 81-42-316-7945 | daichi@ongs.co.jp | http://www.ongs.co.jp LinkedIn: http://linkedin.com/in/daichigoto