From owner-freebsd-stable@FreeBSD.ORG Sat Mar 26 17:52:11 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4A289106566C; Sat, 26 Mar 2011 17:52:11 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from mail-gy0-f182.google.com (mail-gy0-f182.google.com [209.85.160.182]) by mx1.freebsd.org (Postfix) with ESMTP id BE5728FC08; Sat, 26 Mar 2011 17:52:10 +0000 (UTC) Received: by gyg13 with SMTP id 13so903155gyg.13 for ; Sat, 26 Mar 2011 10:52:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=gFl7RXhTCF8VJI6KIcXXSFCS9Qk5RulCOlbde51Lu/0=; b=LT7Z8b/aTUd8DvcwEg6iyrKfTQvpEe9INway8SFNAa0ZzVqNbqMxWPs42qa/EFFP1H VOfjVxtsigkeBCvTtR6ICEJCF8b/kOWZyYkFaxmKCIZP6mwHixgQYcI5kOj7FzaAvPwT RD20E7zEr6LetwpRoQA1P/5eqfjyt4XoP3rFY= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; b=PrRNaStGCnBFTshNjJ/LcYL+Ha3OoiTXQbGhN3vTgAfZGf3ZxWA0JDTFB1yiOtv3fM PCtMyFl1T0yFOruccZ+diU9Kp2SPaX1/G98DSQKajmxkaiuSFmw5tpOfiG8zvpB3QoGH nkeEg/yV4nErnRlbnkKab5AtOVJngQyPCSV9w= MIME-Version: 1.0 Received: by 10.91.20.12 with SMTP id x12mr2205661agi.100.1301161928939; Sat, 26 Mar 2011 10:52:08 -0700 (PDT) Received: by 10.90.100.10 with HTTP; Sat, 26 Mar 2011 10:52:08 -0700 (PDT) In-Reply-To: <20110325075541.GA1742@garage.freebsd.pl> References: <20110325075541.GA1742@garage.freebsd.pl> Date: Sat, 26 Mar 2011 10:52:08 -0700 Message-ID: From: Freddie Cash To: Pawel Jakub Dawidek Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: FreeBSD Filesystems , FreeBSD-Current , FreeBSD Stable Subject: Re: Any success stories for HAST + ZFS? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 26 Mar 2011 17:52:11 -0000 On Fri, Mar 25, 2011 at 12:55 AM, Pawel Jakub Dawidek wro= te: > On Thu, Mar 24, 2011 at 01:36:32PM -0700, Freddie Cash wrote: >> I've tried with FreeBSD 8.2-RELEASE, 8-STABLE, 8-STABLE w/ZFSv28 >> patches, and 9-CURRENT (after the ZFSv28 commit). =C2=A0Things work well >> until I start hastd. =C2=A0Then either the system locks up, or hastd cau= ses >> a kernel panic, or hastd dumps core. > > The minimum amount of information (as always) would be backtrace from > the kernel and also hastd backtrace when it coredumps. There is really > decent logging in hast, so I'm also sure it does log something > interesting on primary or secondary. Another useful thing would be to > turn on debugging in hast (single -d option for hastd). > > The best you can do is to give me the simplest and quickest procedure to > reproduce the issue, eg. configure two hast resources, put ZFS mirror on > top, start rsync /usr/src to the file system on top of hast and switch > roles. The simpler the better. FreeBSD 8-STABLE r219754 with the ZFSv28 patches applied. hast.conf: resource disk-a1 { local /dev/label/disk-a1 on omegadrive { remote tcp4://10.20.0.102 } on alphadrive { remote tcp4://10.20.0.101 } } resource disk-a2 { local /dev/label/disk-a2 on omegadrive { remote tcp4://10.20.0.102 } on alphadrive { remote tcp4://10.20.0.101 } } Following will crash hastd: service hastd onestart hastctl create disk-a1 hastctl create disk-a2 hastctl role primary all hastd backtrace is here: http://www.sd73.bc.ca/downloads/crash/hast-backtrace.png I'll try running it with -d to see if there's anything interesting there. Sure, running it with -d and -F, output to a log file, everything works well using 2 disks. Hrm, running it with all 24 disks, I can't make it crash now. However, I did change the kernel hz from 100 to 1000. I'll see if I can switch it back to 100 and try the tests again using -dF. The backtrace listed above is with kern.hz=3D100. --=20 Freddie Cash fjwcash@gmail.com