From owner-freebsd-bugs@FreeBSD.ORG Wed Feb 4 23:19:51 2015 Return-Path: Delivered-To: freebsd-bugs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 7CEB72C1 for ; Wed, 4 Feb 2015 23:19:51 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4BA2081F for ; Wed, 4 Feb 2015 23:19:51 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.9/8.14.9) with ESMTP id t14NJpFc037172 for ; Wed, 4 Feb 2015 23:19:51 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-bugs@FreeBSD.org Subject: [Bug 197336] find command cannot see more than 32765 subdirectories when using ZFS Date: Wed, 04 Feb 2015 23:19:51 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 10.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: wdormann@gmail.com X-Bugzilla-Status: New X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-bugs@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter attachments.created Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Feb 2015 23:19:51 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=197336 Bug ID: 197336 Summary: find command cannot see more than 32765 subdirectories when using ZFS Product: Base System Version: 10.1-RELEASE Hardware: amd64 OS: Any Status: New Severity: Affects Many People Priority: --- Component: bin Assignee: freebsd-bugs@FreeBSD.org Reporter: wdormann@gmail.com Created attachment 152566 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=152566&action=edit python script to generate a bunch of subdirectories with files in them When a directory has more than 32765 subdirectories in it, the find command fails to find all of the contents if the find command is executed in a ZFS filesystem. If the same command is executed in another filesystem that FreeBSD supports that also supports large counts of subdirectories, the find command sees everything. I've confirmed the correct behavior with both Reiserfs and unionfs. So it appears to be something about the interaction between find and ZFS that triggers the bug. Steps to reproduce: 1. Create a directory structure using the attached dirgen.py script 2. Verify the file count with the ls command. e.g.: ls -lR find_test_q65puW | egrep "txt$" | wc -l 3. Verify the file count with the find command. e.g.: find find_test_q65puW -name "*.txt" | wc -l Actual results: [~/test]$ python ./dirgen.py ndirs: 300000 nfiles: 300000 [~/test]$ ls -l total 219058 -rw-r--r-- 1 user user 861 Feb 4 15:30 dirgen.py drwx------ 32767 user user 300002 Feb 4 15:31 find_test_q65puW [~/test]$ ls -lR find_test_q65puW | egrep "txt$" | wc -l 300000 [~/test]$ find find_test_q65puW -name "*.txt" | wc -l 32765 The count is not complete. (32765 instead of 300000) Expected results: The find command should indicate that there are 300000 files. -- You are receiving this mail because: You are the assignee for the bug.