From owner-freebsd-stable@FreeBSD.ORG Tue Jul 7 08:17:12 2009 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1C69E106566C for ; Tue, 7 Jul 2009 08:17:12 +0000 (UTC) (envelope-from peterjeremy@optushome.com.au) Received: from mail12.syd.optusnet.com.au (mail12.syd.optusnet.com.au [211.29.132.193]) by mx1.freebsd.org (Postfix) with ESMTP id 9AF038FC1C for ; Tue, 7 Jul 2009 08:17:11 +0000 (UTC) (envelope-from peterjeremy@optushome.com.au) Received: from server.vk2pj.dyndns.org (c122-106-247-205.belrs3.nsw.optusnet.com.au [122.106.247.205]) by mail12.syd.optusnet.com.au (8.13.1/8.13.1) with ESMTP id n678Gw6X032587 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 7 Jul 2009 18:17:04 +1000 X-Bogosity: Ham, spamicity=0.000000 Received: from server.vk2pj.dyndns.org (localhost.vk2pj.dyndns.org [127.0.0.1]) by server.vk2pj.dyndns.org (8.14.3/8.14.3) with ESMTP id n678GwMx068701; Tue, 7 Jul 2009 18:16:58 +1000 (EST) (envelope-from peter@server.vk2pj.dyndns.org) Received: (from peter@localhost) by server.vk2pj.dyndns.org (8.14.3/8.14.3/Submit) id n678Gw82068700; Tue, 7 Jul 2009 18:16:58 +1000 (EST) (envelope-from peter) Date: Tue, 7 Jul 2009 18:16:58 +1000 From: Peter Jeremy To: "Marat N.Afanasyev" Message-ID: <20090707081658.GA68385@server.vk2pj.dyndns.org> References: <4A50E947.9020608@ksu.ru> MIME-Version: 1.0 Content-Type: multipart/signed; protocol="application/x-pkcs7-signature"; micalg=sha1; boundary="W/nzBZO5zC0uMSeA" Content-Disposition: inline In-Reply-To: <4A50E947.9020608@ksu.ru> X-PGP-Key: http://members.optusnet.com.au/peterjeremy/pubkey.asc User-Agent: Mutt/1.5.19 (2009-01-05) Cc: FreeBSD-STABLE Mailing List Subject: Re: bug in ufs? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Jul 2009 08:17:12 -0000 --W/nzBZO5zC0uMSeA Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 2009-Jul-05 21:56:23 +0400, "Marat N.Afanasyev" wrote: >i have a strange problem with writing data to my ufs2+su filesystem. Overall, I think you are pushing UFS and have hit one of its limits. >1. i made a 1T gpt partition on my storage server, and formatted it: >newfs -U -m 0 -o time -i 32768 /dev/da1p3a '-m 0' is undesirable. The default 8% free space is intended to hide the sort of effect you've run into. Unless you can find a slightly bigger disk, I suggest you try building an 8K/1K filesystem by adding '-b 8192 -f 1024' - this will be slightly slower than the default 16K/2K but will hopefully allow you to fit slightly more files in. >2. i tried to move data from other servers to this filesystem, total=20 >size of files is slightly less than 1T Can you be more accurate than "slightly less than 1T" (ie how many MiB) and what is the size distribution of the files? The average size is 48KiB but are they all roughly the same size or do they vary widely? Are there many files <16KiB? >3. i encountered a 'No space left on device' while i still have 11G of=20 >free space and about 13 million free inodes on the filesystem: > >#df -ih >Filesystem Size Used Avail Capacity iused ifree %iused=20 >Mounted on >/dev/da1p3a 1.0T 1.0T 11G 99% 20397465 13363173 60%=20 >/mnt/45_114 More significant figures are needed. How about 'df -im' or 'df -ik'. How close are you to fitting in all the files you want? >all i want to know is whether this is a bug or a feature? and if such a=20 >behavior is well-known, where can i read about it? Have a read of /usr/share/doc/smm/05.fastfs/paper.ascii.gz - especially the bits about "fragments". Whilst this paper talks about the original UFS and a 4K/1K configuration, the principles remain the same in UFS2. --=20 Peter Jeremy --W/nzBZO5zC0uMSeA Content-Type: application/x-pkcs7-signature Content-Disposition: attachment; filename="smime.p7s" Content-Transfer-Encoding: base64 MIIPuQYJKoZIhvcNAQcCoIIPqjCCD6YCAQExCzAJBgUrDgMCGgUAMAsGCSqGSIb3DQEHAaCC DSUwggXgMIIDyKADAgECAgMD984wDQYJKoZIhvcNAQEFBQAweTEQMA4GA1UEChMHUm9vdCBD QTEeMBwGA1UECxMVaHR0cDovL3d3dy5jYWNlcnQub3JnMSIwIAYDVQQDExlDQSBDZXJ0IFNp Z25pbmcgQXV0aG9yaXR5MSEwHwYJKoZIhvcNAQkBFhJzdXBwb3J0QGNhY2VydC5vcmcwHhcN MDcwODI4MDA1MjAzWhcNMDkwODI3MDA1MjAzWjCBoDEVMBMGA1UEAxMMUGV0ZXIgSmVyZW15 MSswKQYJKoZIhvcNAQkBFhxwZXRlcmplcmVteUBvcHR1c2hvbWUuY29tLmF1MScwJQYJKoZI hvcNAQkBFhhwZXRlci5qZXJlbXlAYXV1Zy5vcmcuYXUxMTAvBgkqhkiG9w0BCQEWInBldGVy LmplcmVteUBhbGNhdGVsLWx1Y2VudC5jb20uYXUwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAw ggEKAoIBAQC0saUsCMQRDIW7pALRwK5z9/gRCBYiYNnmx9fYEsDiIJ1zYJd33Z7hJ4exUXOG Zk3IZjtSyUh9Qnqvic9bvhKpsLKE/2xzmj5ddfN4WzNcaM0+S2J6DzU5kZprn9Ex7A6YJ8WH vEy8f1mXBnQ8SCwAsBJ41tIdW8cxkBRGCL9A+LFzEoHQ9x150eK2UjVHG7tjeFRMkiQC8BDo 7YY+dxH5apyru952xcu4HKEeOeb31WJhxa+HDiWhzbBR8vlUDocyy+41/LAbIET3VfPIuEwo mrDgt3xKw1INUzXVi+jENzIqy8yFX9FigKlo/QDAfg58qvCs//BgpBxu7PUKTPyDAgMBAAGj ggFHMIIBQzAMBgNVHRMBAf8EAjAAMFYGCWCGSAGG+EIBDQRJFkdUbyBnZXQgeW91ciBvd24g Y2VydGlmaWNhdGUgZm9yIEZSRUUgaGVhZCBvdmVyIHRvIGh0dHA6Ly93d3cuQ0FjZXJ0Lm9y ZzBABgNVHSUEOTA3BggrBgEFBQcDBAYIKwYBBQUHAwIGCisGAQQBgjcKAwQGCisGAQQBgjcK AwMGCWCGSAGG+EIEATAyBggrBgEFBQcBAQQmMCQwIgYIKwYBBQUHMAGGFmh0dHA6Ly9vY3Nw LmNhY2VydC5vcmcwZQYDVR0RBF4wXIEccGV0ZXJqZXJlbXlAb3B0dXNob21lLmNvbS5hdYEY cGV0ZXIuamVyZW15QGF1dWcub3JnLmF1gSJwZXRlci5qZXJlbXlAYWxjYXRlbC1sdWNlbnQu Y29tLmF1MA0GCSqGSIb3DQEBBQUAA4ICAQAXxWquW06hLqy4/mGkSaQCZpaeZ4ILLEA80TKi 7jSMVxnQzcjalox79LhWYBeIK7J+w5cfblD3o9lVvrwhSzDE3GmwKrz9aZIsNzD0LgTaQ6gv f7U1DWex02WwowMwG00AAcqXwC7ZbOyl1gaVgXQuaYjUyggCPq9n54IlYRAVAWE/JBFVwqNP JWdpDt7AMpa22UAJL+5rWaOde6SsUS55NTEQ7M32/xNCAFDwwO3rQ6ToEqpQUeoVyGnRdp+q oJFkKE/fnngWy8wP9RPV+yxfJ4OfsLcILnp66wROwSECySJGkppO4C4NApOyHa4sZx8Ui6XP A5EiICCCRIYJP3+sdlwgazfNu1lZ+/uHrajGgnpS7lGRZITa6hFcFJpoCHDjurPJWwPqdzpK 8wcSXeV05oEldK5FfOjzcaUd6mI/YLK3j4Ie7VQg1zB32shzM0Lk8iDLIAO+vKcBzi79dCjR Hr0lKLttEVfNUcqDhEHzDvQsc+IYc8C4KibGeS9kRcx136EYXYn4dNu8Rab6ELTyaORlEB2z jo9HcToNfO/jLwByiRAHefTyziljVqAv6PaaVFNcTtiCEzFwi/eJERNZ0A9RS0Q+yIrC+dC3 0Oz8TVUisJ4YOYJPVL1bVAzWVzf0IpIYPTixy9dpTItAY6BOTHzpcY/mCqiqoi36QXyCfDCC Bz0wggUloAMCAQICAQAwDQYJKoZIhvcNAQEEBQAweTEQMA4GA1UEChMHUm9vdCBDQTEeMBwG A1UECxMVaHR0cDovL3d3dy5jYWNlcnQub3JnMSIwIAYDVQQDExlDQSBDZXJ0IFNpZ25pbmcg QXV0aG9yaXR5MSEwHwYJKoZIhvcNAQkBFhJzdXBwb3J0QGNhY2VydC5vcmcwHhcNMDMwMzMw MTIyOTQ5WhcNMzMwMzI5MTIyOTQ5WjB5MRAwDgYDVQQKEwdSb290IENBMR4wHAYDVQQLExVo dHRwOi8vd3d3LmNhY2VydC5vcmcxIjAgBgNVBAMTGUNBIENlcnQgU2lnbmluZyBBdXRob3Jp dHkxITAfBgkqhkiG9w0BCQEWEnN1cHBvcnRAY2FjZXJ0Lm9yZzCCAiIwDQYJKoZIhvcNAQEB BQADggIPADCCAgoCggIBAM4iwOJGfew2KAdQlvKgM0CMS/E7Zj8x5WsCNtvWfPbxiI9OdzYF QZX5CfASz0aGc2C3bn7owFhkrs2wrUUXDGP6Zwro1tK/PueYxPBM+uADuzVdbCHeniDZus1m Mjdy+vcI9cfNWMmO5w5e6j7+HKEUChVshoRbZGYqeqlLU3n1iKJ77i8KYSuNsn5NVqUT7Ora kp6sREEeWGBlBWb4wES9y5T3Qn4L92VomFEF8PMFkQQdGxeC7MhXu8NreojxsHLMJVsgkewW AhKPMukXGEjQxwUuAjBCuCWcBWs/qjqn61NI9+jStgeY3BvGNH9/yRyCegVYKwhb8ziiqxdd ZsmY154Qi6LS3XSa93EMcmDfzW+YM52WNHY+JHqSsA6VHm/moEU4R6rXQe1KtxL21xuDig8u 2Am2WdeqBP/Sk31oLt2LS6tYui+N6pWnoMNUiaX724tRIp2yw74RviyRhouWeK0g04ovGj/G 0FFlhyGxGQFlf0Uch/V80EFMTymYIf0zH3UMBFH6GXfb1BQc7oHDHfWYt2kGkSLdAFDMgTGs Egd7ONpoW+Yr1H7JX63o63JM8wHlSyC/mqZXypEAAYuhdSE3tWMNZz5GT3AgZ87F1lnbAuDw 0svNumK3kEHo3SDkKbxkKULIItx4mv9D7JgbCVFLWlrCcfHEy3Op5aELAgMBAAGjggHOMIIB yjAdBgNVHQ4EFgQUFrUyG9TH8+DmjvO90rA67rI5GNEwgaMGA1UdIwSBmzCBmIAUFrUyG9TH 8+DmjvO90rA67rI5GNGhfaR7MHkxEDAOBgNVBAoTB1Jvb3QgQ0ExHjAcBgNVBAsTFWh0dHA6 Ly93d3cuY2FjZXJ0Lm9yZzEiMCAGA1UEAxMZQ0EgQ2VydCBTaWduaW5nIEF1dGhvcml0eTEh MB8GCSqGSIb3DQEJARYSc3VwcG9ydEBjYWNlcnQub3JnggEAMA8GA1UdEwEB/wQFMAMBAf8w MgYDVR0fBCswKTAnoCWgI4YhaHR0cHM6Ly93d3cuY2FjZXJ0Lm9yZy9yZXZva2UuY3JsMDAG CWCGSAGG+EIBBAQjFiFodHRwczovL3d3dy5jYWNlcnQub3JnL3Jldm9rZS5jcmwwNAYJYIZI AYb4QgEIBCcWJWh0dHA6Ly93d3cuY2FjZXJ0Lm9yZy9pbmRleC5waHA/aWQ9MTAwVgYJYIZI AYb4QgENBEkWR1RvIGdldCB5b3VyIG93biBjZXJ0aWZpY2F0ZSBmb3IgRlJFRSBoZWFkIG92 ZXIgdG8gaHR0cDovL3d3dy5jYWNlcnQub3JnMA0GCSqGSIb3DQEBBAUAA4ICAQAox+6cggK6 XIASyjUKHYFviWqZzPJoD3+n4Y1YlT698gbDkFqstWD2mUMBo4hwnJ1inaSHr2dYDTA2O+at SNPLdAKGcT7iKwNo8TRiQEY7U+oo9Kz7ZpVTik1d/TvZYNfKeWk7sWWSpsaBglyczetNAYql 3xFVqhXKHzfAgphwYdtqfJajji5UPk8hqZDv3IK/3OhFrU2Qcwg8lGWwBJl2f+K8wmoVqpcE NyTYHpRObQ5RvtbEj8qWbfdD3+gwZSc7e7tDQ2PEQ/ey7GjM4RmOIvuY4XtaPgE3O4sIsKLz lU4ay5vNmrHbsnDwLUrb2LDjb0VIMxL//jwyKlT3xPeK8Igjwkf+ZHpxwNEepmOwB36kL9MB j9yfK7bGCKkPk0gl/BL9n0Lc88Q+9lew191p0QZ3NApL0sqg/xzGjMkWvsTMMjdoc18I+1H3 SVM2BQqVAkzyeRoQ9tg6dZzzHfGiDXBnhhuzFvUv5aTreYb5PQvCcwulmaxv/Ge45S8Lphgk jXvRSDUpGECsk2DhloZQtHpZ2I8hC5/PgpHGO79r3AeRuZdWI6q2bJTGSAY85M5OquT2Lwnc U28u/HTrOmOZwqasibynskSgDYoQ42zyJMv6m59wRy7eFIvUsiAJlqJk8SQc3KE1nBWy1LxV Ln0G9ZwOVfRa1pPadq0lc0zFQzGCAlwwggJYAgEBMIGAMHkxEDAOBgNVBAoTB1Jvb3QgQ0Ex HjAcBgNVBAsTFWh0dHA6Ly93d3cuY2FjZXJ0Lm9yZzEiMCAGA1UEAxMZQ0EgQ2VydCBTaWdu aW5nIEF1dGhvcml0eTEhMB8GCSqGSIb3DQEJARYSc3VwcG9ydEBjYWNlcnQub3JnAgMD984w CQYFKw4DAhoFAKCBsTAYBgkqhkiG9w0BCQMxCwYJKoZIhvcNAQcBMBwGCSqGSIb3DQEJBTEP Fw0wOTA3MDcwODE2NThaMCMGCSqGSIb3DQEJBDEWBBQff/T5YdDI4PS/n1cNdo48Y52rsjBS BgkqhkiG9w0BCQ8xRTBDMAoGCCqGSIb3DQMHMA4GCCqGSIb3DQMCAgIAgDANBggqhkiG9w0D AgIBQDAHBgUrDgMCBzANBggqhkiG9w0DAgIBKDANBgkqhkiG9w0BAQEFAASCAQArfqM2Bb1Z SNeIrKUVWEGKlO24Ay6W6CWTzdyH9VsQ4zqYivSH4h1iWVUz065ywPI64T3gW01NBW6X2Wwb 1IBaYgn77NLLbjRsKcPscZPlGqbV+xfwH3IgXeG/HEgc4SBBFUoqyLIu97BgijzidSPvXfp3 xu5uO5JwYUtx4rwax3Dg8hdOYo9wii1jTi37pshGodbKRJqmPgf06GztDe1zIgMbc2gFqdID EhBmPlya66GtsMyYXeqyUy8sk3SV6becQQnCY17Dt1jay1+7ofxUWk6VNN6n3SEq+WFXXiHP JcEjUnmuTHGZV4WmphWOpSgAhopdH7Peqk5aA+jt2p51 --W/nzBZO5zC0uMSeA--