Date: Tue, 24 Dec 2013 15:46:30 -0600 From: iamatt <iamatt@gmail.com> To: Dennis Glatting <freebsd@pki2.com> Cc: FreeBSD Mailing List <freebsd-questions@freebsd.org> Subject: Re: InfiniBand in 10.0? Message-ID: <CAEeRwNU1nM%2BueRz-yAAOf0XNZMJ8ZqFYNAH8ZsFX_jqy33A-dw@mail.gmail.com> In-Reply-To: <1387920273.71651.119.camel@btw.pki2.com> References: <1387915155.71651.118.camel@btw.pki2.com> <CAEeRwNXsxT_pbqOOF3tfHSecjFzRqqb6tgxZVc5nwMWqoyBOxw@mail.gmail.com> <1387920273.71651.119.camel@btw.pki2.com>
next in thread | previous in thread | raw e-mail | index | archive | help
A good batch of mellanox cables. Melanic had a bad run of FDR early in the year. Most FDR centers have been plagued with them. Even the back end of our DDN lustres has had issues. They typically do not just fail but downgrade to QDR rate. On Dec 24, 2013 3:24 PM, "Dennis Glatting" <freebsd@pki2.com> wrote: > On Tue, 2013-12-24 at 14:43 -0600, iamatt wrote: > > Not sure if I would even bother with running IB on BSD. We have enough > > problems just getting things stable with Linux and mellanox ofed . Add > all > > of the documented build problems with the mellanox FDR cables and recalls > > and you are guaranteed a nightmare. TACC, navy, and almost every center > I > > am aware of has replaced all or most or some of their FDR, including us. > > > > Replaced them with what? > > > > As far as cards go it's all mellanox. Qlogic lost the game, still > dealing > > with a 12800 qlogic switch which is a total nightmare. Stick with > > mellanox. Different vendors used to make their own fabric managers in > the > > early time of IB but now its best to stick with open ibd. > > > > FreeBSD and IB gives me the chills just thinking about it. > > On Dec 24, 2013 1:59 PM, "Dennis Glatting" <freebsd@pki2.com> wrote: > > > > > > > > This site appears dated: > > > > > > https://wiki.freebsd.org/InfiniBand > > > > > > I have a couple of questions. > > > > > > 1) Under 10.0-RC2, is InfiniBand a part of GENERIC or did I still have > > > to modify the conf as specified in the wiki? I don't see any of the > > > options from the wiki in 10.0-RC2 GENERIC. > > > > > > 2) Any recommendation on cards? What works, what doesn't? > > > > > > 3) What things to watch out for? > > > > > > > > > Thanks. > > > > > > > > > > > > > > > _______________________________________________ > > > freebsd-questions@freebsd.org mailing list > > > http://lists.freebsd.org/mailman/listinfo/freebsd-questions > > > To unsubscribe, send any mail to " > > > freebsd-questions-unsubscribe@freebsd.org" > > > > > _______________________________________________ > > freebsd-questions@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-questions > > To unsubscribe, send any mail to " > freebsd-questions-unsubscribe@freebsd.org" > > >
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAEeRwNU1nM%2BueRz-yAAOf0XNZMJ8ZqFYNAH8ZsFX_jqy33A-dw>