From owner-freebsd-stable@FreeBSD.ORG Fri Oct 17 11:50:10 2008 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EDC231065697; Fri, 17 Oct 2008 11:50:09 +0000 (UTC) (envelope-from 000.fbsd@quip.cz) Received: from elsa.codelab.cz (elsa.codelab.cz [91.103.162.4]) by mx1.freebsd.org (Postfix) with ESMTP id 770F08FC12; Fri, 17 Oct 2008 11:50:09 +0000 (UTC) (envelope-from 000.fbsd@quip.cz) Received: from localhost (localhost.codelab.cz [127.0.0.1]) by elsa.codelab.cz (Postfix) with ESMTP id 1A61719E023; Fri, 17 Oct 2008 13:50:07 +0200 (CEST) Received: from [192.168.1.2] (r5bb235.net.upc.cz [86.49.61.235]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by elsa.codelab.cz (Postfix) with ESMTPSA id C4EEF19E019; Fri, 17 Oct 2008 13:50:04 +0200 (CEST) Message-ID: <48F87C0E.8060404@quip.cz> Date: Fri, 17 Oct 2008 13:50:38 +0200 From: Miroslav Lachman <000.fbsd@quip.cz> User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.7.12) Gecko/20050915 X-Accept-Language: cz, cs, en, en-us MIME-Version: 1.0 To: Jeremy Chadwick References: <20080927051413.GA42700@icarus.home.lan> <765067435.20080926223557@takeda.tk> <20080927064417.GA43638@icarus.home.lan> <20080927202250.GA60980@icarus.home.lan> <48E0DB7E.20804@quip.cz> <1222699642.24339.12.camel@buffy.york.ac.uk> <48E0F36C.1080400@quip.cz> <20080929153220.GA11459@icarus.home.lan> <48F7964C.4060309@quip.cz> <20081016202322.GA2429@icarus.home.lan> In-Reply-To: <20081016202322.GA2429@icarus.home.lan> Content-Type: multipart/mixed; boundary="------------060206040901040307060008" Cc: Gavin Atkinson , freebsd-stable@FreeBSD.org Subject: Re: Recommendations for servers running SATA drives [hot-swap] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 17 Oct 2008 11:50:10 -0000 This is a multi-part message in MIME format. --------------060206040901040307060008 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Jeremy Chadwick wrote: > On Thu, Oct 16, 2008 at 09:30:20PM +0200, Miroslav Lachman wrote: > >>Today I was replacing disk in one Sun Fire X2100 M2 so I tried >>hot-swapping. It was as you said: atacontrol detach ata3, replace the >>HDD, atacontrol attach ata3 and new disk is in the system. I tried it 3 >>times to be sure that it was not coincidence - no panic was produced ;o) >>So in this case, hot-swapping on Sun Fire X2100 M2 with FreeBSD 7.0 i386 >>works. > > > That's excellent news. So it seems possibly the problem I was seeing > was with "reinit" causing some sort of chaos. I'll have to check things > on my testbox here at home to see how I caused the panic last time. > > Thanks for providing feedback, as usual! :-) Unfortunately there is one problem - I see a lot of interrupts after disk swapping (about 193k of atapci1) Interrupts 197k total ohci0 21 ehci0 22 193k atapci1 23 2001 cpu0: time 1 bge1 273 2001 cpu1: time Full output of systat -vm 2 is attached. It is shown in top as 50% interrupt (CPU state) and load 1 until I rebooted the machine (I can provide MRTG graphs). The system was not in production load, but almost idle. (I will put it in production tomorrow). After reboot, everything is OK. Can somebody test hot-swapping with SATA drives and confirm this behavior? (I can't test it now, because machine is in datacenter) Miroslav Lachman --------------060206040901040307060008 Content-Type: text/plain; name="systat_vm.txt" Content-Transfer-Encoding: 7bit Content-Disposition: inline; filename="systat_vm.txt" 2 users Load 1.00 1.00 0.99 Oct 17 00:25 Mem:KB REAL VIRTUAL VN PAGER SWAP PAGER Tot Share Tot Share Free in out in out Act 40032 6212 118412 9352 509928 count All 70200 7884 4370000 16700 pages Proc: Interrupts r p d s w Csw Trp Sys Int Sof Flt cow 197k total 3 45 387k 6 75 193k 187 zfod ohci0 21 ozfod ehci0 22 0.7%Sys 45.9%Intr 0.0%User 0.0%Nice 53.4%Idle %ozfod 193k atapci1 23 | | | | | | | | | | | daefr 2001 cpu0: time +++++++++++++++++++++++ prcfr 1 bge1 273 10 dtbuf totfr 2001 cpu1: time Namei Name-cache Dir-cache 68955 desvn react Calls hits % hits % 58041 numvn pdwak 17234 frevn pdpgs intrn Disks ad4 ad6 191128 wire KB/t 0.00 0.00 59664 act tps 0 0 242588 inact MB/s 0.00 0.00 46108 cache %busy 0 0 463820 free 113488 buf --------------060206040901040307060008--