Date: Mon, 21 Nov 2016 12:58:58 -0500 From: Mark Saad <nonesuch@longcount.org> To: FreeBSD-Stable ML <freebsd-stable@freebsd.org> Subject: Re: Help! two machines ran out of swap and corrupted their zpools! Message-ID: <CAMXt9NZBewFQokB4srfe04CUpivcZCGCkStYiktmW8Y2CbP1dQ@mail.gmail.com> In-Reply-To: <b4f47d3b-3e35-9135-f322-fbed0a4e4636@rlwinm.de> References: <E1c8sgj-0003Q2-It@dilbert.ingresso.co.uk> <b4f47d3b-3e35-9135-f322-fbed0a4e4636@rlwinm.de>
next in thread | previous in thread | raw e-mail | index | archive | help
On Mon, Nov 21, 2016 at 12:50 PM, Jan Bramkamp <crest@rlwinm.de> wrote: > On 21/11/2016 18:47, Pete French wrote: >> >> So, I am off sick and my colleagues decided to load test our set of five >> servers excesively. All ran out of swap. So far so irritating, but whats >> has >> happened is that twoof them now will not boot, as it appears the ZFS pool >> they are booting from has become corrupted. >> >> One starts to boot, then crases importing the root pool. The other doenst >> even get that far with gptzfsboot saying it can't find the pool to boot >> from! >> >> Now I can recover these, but I am a bit worried, that it got like this at >> all, as I havent ever seen ZFS corrupt a pool like this. Anyone got any >> insights, >> or suggstions as to how to stop it happening again ? >> >> We are swapping to a separate partition, not to the pool by theway. > > > How much trust do you put in your hardware? Have you ever put the hardware > under full load for extended periods before e.g. run poudriere to build pkg > repos? > > -- Jan Bramkamp > > _________ Pete I am thinking like Jan, that this points to a hardware issue. What can you tell us about the servers ? What sort of cpu, do you have ecc ram ? How much ram what was running at the time ? Do you use a slog, l2arc , whats the zpool status -v show? ______________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" -- mark saad | nonesuch@longcount.org
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAMXt9NZBewFQokB4srfe04CUpivcZCGCkStYiktmW8Y2CbP1dQ>