From owner-freebsd-stable@freebsd.org Mon Aug 14 08:34:06 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7DADCDDCD2B for ; Mon, 14 Aug 2017 08:34:06 +0000 (UTC) (envelope-from tsuroerusu@gmail.com) Received: from mail-ua0-x232.google.com (mail-ua0-x232.google.com [IPv6:2607:f8b0:400c:c08::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 492B2733DB for ; Mon, 14 Aug 2017 08:34:06 +0000 (UTC) (envelope-from tsuroerusu@gmail.com) Received: by mail-ua0-x232.google.com with SMTP id f9so34111503uaf.4 for ; Mon, 14 Aug 2017 01:34:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=4EgrZjB9LIfJGaro/5UBIdvf80YKaOdCBJV3icnOr+c=; b=C6UhRfFVXIutChgGCMURc66VoTZsO48bgx5K7+SsTf7VQHWmBIOMnktVhDEDAIG411 Dv997DxKB3FiB80j8s2XKRwc2FdGVCRXNWvhkC90hIbOokGfrUozszMMLSApEP9kDK+k EcxVgpTH+5E8TgrG0Rx14AdpEUbD2Onk7OmxCXLs/4JwqT0uCE8QIYhj9EAuuJIDZ4V9 YqoXmc8JmAA6ochfZLbtJgr1lal4wSjOnJ5UQRaVkft4Y1cjF5BOwlBRi67lVekn+Wqc s1fi6zW9UGgWxfy0iDw/KSGQv1v1PXY14AoGpKuEyGj2/DIHqTa8NsadegdsaCu3VqjI V4tw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=4EgrZjB9LIfJGaro/5UBIdvf80YKaOdCBJV3icnOr+c=; b=U8e2oUlSdE77vhNK8JdxcSWFXV9xxxv1BCkM+D5GLQAq9yB0914qlKUO3BK7B7mpqq wIb3f4F4fbj3BT+3d4Ns/2QPX6rzkAsqoS8M7AmvqssGTmaOYb3tLpNVoMb/ZCuUK/nH Y65Qcf79eGDKXEyfdJQBCBCb105bzq/vh27NpDHMdAQYq797npHUf8BJbst7kj3IGOkc 12WyC823iujLJm7t2EXMwNfVNKcLltqA1qsWDJWIYtjrRIjYMFKE/GLQQHIWRGyGFced fHVQqltMBNjrZFi/J+romGGs5+iZLdtVdnbTMnha516OKxQLdfjco4lW2fxDJQpwJcVZ phRg== X-Gm-Message-State: AHYfb5hCIbdLD5OWAHMWXDbPZRwzgxFmXKqT8s2C3m9cXLPD3As38YR6 arrW51ZbzO/Z+7WIPNEfkpI1lXH55cbA X-Received: by 10.176.73.194 with SMTP id f2mr17537849uad.140.1502699644993; Mon, 14 Aug 2017 01:34:04 -0700 (PDT) MIME-Version: 1.0 Received: by 10.31.157.79 with HTTP; Mon, 14 Aug 2017 01:34:04 -0700 (PDT) From: tsuroerusu@gmail.com Date: Mon, 14 Aug 2017 10:34:04 +0200 Message-ID: Subject: nullfs making contents of ZFS datasets invisible even after unmounting To: freebsd-stable@freebsd.org Content-Type: text/plain; charset="UTF-8" X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Aug 2017 08:34:06 -0000 I am running a FreeBSD 11.1 system with ZFS and jails and I mount a file system on my storage pool (/storage/cloud) into the jail (/jails/cloud/storage) via nullfs, and that works fine for what the jail does. However I just noticed that outside the jail, I can only see the mount points of the file system children, but not the contents. For example if I do: ls -la /storage/cloud/* (As root) then nothing shows up, but they are present inside the jail. Even if I stop the jail, they still are not present outside the jail. I just tried disabling jails in /etc/rc.conf and rebooting the system and EVEN THEN the files do not reappear outside the jail in their original location, yet zfs list reports the space being used. But if I then (without rebooting) enable the jail, the files show up in the nullfs-mounted location inside the jail! As an experiment, I tried creating /mnt/test and /mnt/test2 and creates a folder and a few files in test, and then nullfs-mounted it onto test2, and I could then see the files in both locations. Does anybody know what might be causing this? The fact that my data stays hidden after a reboot is rather worrisome.