From owner-freebsd-fs@freebsd.org Sat Sep 2 16:40:17 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id ECDEAE1B5B7 for ; Sat, 2 Sep 2017 16:40:17 +0000 (UTC) (envelope-from bsd@vink.pl) Received: from mail-qk0-x22b.google.com (mail-qk0-x22b.google.com [IPv6:2607:f8b0:400d:c09::22b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A976B685BD for ; Sat, 2 Sep 2017 16:40:17 +0000 (UTC) (envelope-from bsd@vink.pl) Received: by mail-qk0-x22b.google.com with SMTP id p67so10728082qkd.2 for ; Sat, 02 Sep 2017 09:40:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=vink-pl.20150623.gappssmtp.com; s=20150623; h=mime-version:from:date:message-id:subject:to; bh=UUggcenKkHFtyjts4hR1K8R9ZjHsvZSHsDtSrHMcd2g=; b=DsNyj0BLJGEBRdmSx7h8SPNj47GhfUhw3MCOJQ7o3pGDu8oZaGwUo4a9G6Pv2kgv1c MMKkLyRygBieHEk3fZbu1580DGI5424pza2hHXv6NIm4BbLE3H7ALCfvW1dhkQI11odZ m9LTkzH2NYYaGi5pIY0fGfI8lwgj9mgKLI3RNioemhKMp/ZyJ+fYwwtF+DQbSDBiLPGe 5t+GpvBsSh5h3QrBkXBhyr1/46H5C9cPzQtBj/88sdgAyFdpR7boQ/IAkLJUKF1CdQql 5HZz+c6SUL4knDUXL9NyaNy176NPzoSUG16tSV9xm8b/GqS7rc1tgU2bjmkJ+5nz23+c 9GFg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=UUggcenKkHFtyjts4hR1K8R9ZjHsvZSHsDtSrHMcd2g=; b=AqRUJJ7raCtad5YFUjhE45JnfoH/5cSscNXs6T9QWRcY4MfhO2n6sNqYbjxpu5MniU uZsQNFza2IFVJHtflNvA7nWVRFUhtztxRU6DP3PThxNkDX1R4z/VDImmn/Cx2swtPTY8 ia93KV4h8xYM/PxoK0shxkWKachC2azFCz+JeidNd3XQxYoGsBil20muXvxiiLHkj9St 3jANbccwikQYgkhRXMeSwlS7+xQy4gxLLDI8hEMhlmsvz0TPUk/efZ3LyR8eG60eHHxi 1OvZcIfCQKMITya8GQaQ9j1/T0vpSSkfFySTr0q50DtIUYHXSrfTyB4/WJubE9xd2ce0 95cw== X-Gm-Message-State: AHPjjUg+yTW+QitEQYFT96XNqBGD5cVV/P4ouau9ERHXHcIdQDUUJsxH sOqSPmDeGwFzM0L08B0= X-Received: by 10.55.118.132 with SMTP id r126mr7570777qkc.169.1504370416305; Sat, 02 Sep 2017 09:40:16 -0700 (PDT) Received: from mail-qk0-f177.google.com (mail-qk0-f177.google.com. [209.85.220.177]) by smtp.gmail.com with ESMTPSA id s127sm1030899qkh.63.2017.09.02.09.40.16 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 02 Sep 2017 09:40:16 -0700 (PDT) Received: by mail-qk0-f177.google.com with SMTP id l65so10780225qkc.0 for ; Sat, 02 Sep 2017 09:40:16 -0700 (PDT) X-Google-Smtp-Source: ADKCNb4qR/owGMoahU2CILwnUxNg5xGQWS3qgP8Hx5aX0OIK4YBhrvMDpacjrZiE1g20+21NG/gSC+oR+BdHD5Y7iDk= X-Received: by 10.55.75.216 with SMTP id y207mr7952016qka.140.1504370415649; Sat, 02 Sep 2017 09:40:15 -0700 (PDT) MIME-Version: 1.0 Received: by 10.12.156.197 with HTTP; Sat, 2 Sep 2017 09:40:15 -0700 (PDT) From: Wiktor Niesiobedzki Date: Sat, 2 Sep 2017 18:40:15 +0200 X-Gmail-Original-Message-ID: Message-ID: Subject: Resolving errors with ZVOL-s To: freebsd-fs Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 02 Sep 2017 16:40:18 -0000 Hi, I have recently encountered errors on my ZFS Pool on my 11.1-R: $ uname -a FreeBSD kadlubek 11.1-RELEASE-p1 FreeBSD 11.1-RELEASE-p1 #0: Wed Aug 9 11:55:48 UTC 2017 root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64 # zpool status -v tank pool: tank state: ONLINE status: One or more devices has experienced an error resulting in data corruption. Applications may be affected. action: Restore the file in question if possible. Otherwise restore the entire pool from backup. see: http://illumos.org/msg/ZFS-8000-8A scan: scrub repaired 0 in 5h27m with 0 errors on Sat Sep 2 15:30:59 2017 config: NAME STATE READ WRITE CKSUM tank ONLINE 0 0 98 mirror-0 ONLINE 0 0 196 gpt/tank1.eli ONLINE 0 0 196 gpt/tank2.eli ONLINE 0 0 196 errors: Permanent errors have been detected in the following files: dkr-test:<0x1> dkr-test is ZVOL that I use within bhyve and indeed - within bhyve I have noticed I/O errors on this volume. This ZVOL did not have any snapshots. Following the advice mentioned in action I tried to restore the ZVOL: # zfs desroy tank/dkr-test But still errors are mentioned in zpool status: errors: Permanent errors have been detected in the following files: <0x5095>:<0x1> I can't find any reference to this dataset in zdb: # zdb -d tank | grep 5095 # zdb -d tank | grep 20629 I tried also getting statistics about metadata in this pool: # zdb -b tank Traversing all blocks to verify nothing leaked ... loading space map for vdev 0 of 1, metaslab 159 of 174 ... 94.5G completed (1059MB/s) estimated time remaining: 0hr 25min 47sec And now to my questions: 1. Do I interpret correctly, that this situation is probably due to error during write, and both copies of the block got checksum mismatching their data? 2. Is there any way to