From owner-freebsd-amd64@FreeBSD.ORG Sat Oct 11 16:52:54 2008 Return-Path: Delivered-To: freebsd-amd64@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 45A671065689 for ; Sat, 11 Oct 2008 16:52:54 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from QMTA05.westchester.pa.mail.comcast.net (qmta05.westchester.pa.mail.comcast.net [76.96.62.48]) by mx1.freebsd.org (Postfix) with ESMTP id DF6A78FC19 for ; Sat, 11 Oct 2008 16:52:53 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from OMTA06.westchester.pa.mail.comcast.net ([76.96.62.51]) by QMTA05.westchester.pa.mail.comcast.net with comcast id RRFl1a00216LCl055Ustpz; Sat, 11 Oct 2008 16:52:53 +0000 Received: from koitsu.dyndns.org ([69.181.141.110]) by OMTA06.westchester.pa.mail.comcast.net with comcast id RUsr1a0042P6wsM3SUsrf4; Sat, 11 Oct 2008 16:52:52 +0000 X-Authority-Analysis: v=1.0 c=1 a=n07WsRzhiL8A:10 a=ORw6YhE72dwA:10 a=QycZ5dHgAAAA:8 a=7CmD_XufCLgEyoOZWfMA:9 a=hKMjRJ4M_swmQLkAslwA:7 a=ZSM8IFsSkkB_ANeY9_Z9tSkhchYA:4 a=EoioJ0NPDVgA:10 a=SV7veod9ZcQA:10 a=LY0hPdMaydYA:10 Received: by icarus.home.lan (Postfix, from userid 1000) id D13FAC9419; Sat, 11 Oct 2008 09:52:50 -0700 (PDT) Date: Sat, 11 Oct 2008 09:52:50 -0700 From: Jeremy Chadwick To: Adam McDougall Message-ID: <20081011165250.GA67552@icarus.home.lan> References: <200810101429.37244.joao@matik.com.br> <20081011113057.7402300c@ernst.jennejohn.org> <20081011101316.GA58119@icarus.home.lan> <20081011164529.198f32c6@ernst.jennejohn.org> <20081011144817.GB64861@icarus.home.lan> <48F0D3B5.6070602@egr.msu.edu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <48F0D3B5.6070602@egr.msu.edu> User-Agent: Mutt/1.5.18 (2008-05-17) X-Mailman-Approved-At: Sat, 11 Oct 2008 18:41:23 +0000 Cc: Scott Long , freebsd-stable@freebsd.org, freebsd-amd64@freebsd.org Subject: Re: am2 MBs - 4g + SCSI wipes out root partition X-BeenThere: freebsd-amd64@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Porting FreeBSD to the AMD64 platform List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Oct 2008 16:52:54 -0000 On Sat, Oct 11, 2008 at 12:26:29PM -0400, Adam McDougall wrote: > Jeremy Chadwick wrote: >> On Sat, Oct 11, 2008 at 04:45:29PM +0200, Gary Jennejohn wrote: >>> On Sat, 11 Oct 2008 03:13:16 -0700 >>> Jeremy Chadwick wrote: >>> >>>> On Sat, Oct 11, 2008 at 11:30:57AM +0200, Gary Jennejohn wrote: >>>>> On Fri, 10 Oct 2008 14:29:37 -0300 >>>>> JoaoBR wrote: >>>>> >>>>>> I tried MBs as Asus, Abit and Gigabyte all same result >>>>>> >>>>>> Same hardware with SATA works perfect >>>>>> >>>>>> Same hardware with scsi up to 3.5Gigs installed works perfect >>>>>> >>>>>> what calls my attention that all this MBs do not have the >>>>>> memroy hole remapping feature so the complete 4gigs are >>>>>> available what normally was not the case with amd64 Mbs for the >>>>>> Athlon 64 CPUs >>>>>> >>>>>> some has an opinion if this is a freebsd issue or MB falure or >>>>>> scsi drv problem? >>>>>> >>>>> It's a driver problem. If you want to use SCSI then you'll have to limit >>>>> memory to 3.5 GB. >>>> What you're saying is that Adaptec and LSI Logic SCSI controllers behave >>>> badly (and can cause data loss) on amd64 systems which contain more than >>>> 3.5GB of RAM. This is a very big claim. >>>> >>>> Have you talked to Scott Long about this? >>>> >>>> Please expand on this, and provide evidence or references. I need to >>>> document this in my Wiki if it is indeed true. >>>> >>> See the freebsd-scsi thread with Subject "data corruption with ahc driver >>> and 4GB of memory using a FBSD-8 64-bit installation?" from Wed, 30 Jan >>> 2008. >>> >>> This was for ahc, but the bit-rot which Scott mentions in his reply might >>> also apply to the LSI Logic controllers. >>> >>> Basically the driver doesn't correctly handle DMA above 4GB. Since the PCI >>> hole gets mapped above 4GB it causes problems. the (S)ATA drivers don't seem >>> to have this problem. >> >> Thank you -- this is the exact information I was looking for. >> >> I will update my Wiki page to reflect this quite major problem. >> > > I am using some LSI (mpt driver) ultra4 (U320 scsi) and LSI SAS > controllers in FreeBSD 7.x amd64 with 20G of ram, and Adaptec (aac > driver) with a 5th generation RAID card with 8G of ram, both have no > such corruption problems. Providing this as a counter-example just to > document some evidence of which products seem to work fine. Is your LSI SAS controller driven by mpt(4) or mfi(4)? Let's break down what we know for sure at this point: aac(4) - not affected aha(4) - unknown ahb(4) - unknown ahc(4) - affected ahd(4) - unknown; no one answered the OP's question in the thread asr(4) - unknown ips(4) - unknown mpt(4) - not affected mfi(4) - unknown sym(4) - unknown Could the problem be specific to certain firmware revisions on the cards? Also adding Scott Long to the CC list. -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB |