Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 7 Jul 2009 18:16:58 +1000
From:      Peter Jeremy <peterjeremy@optushome.com.au>
To:        "Marat N.Afanasyev" <amarat@ksu.ru>
Cc:        FreeBSD-STABLE Mailing List <freebsd-stable@freebsd.org>
Subject:   Re: bug in ufs?
Message-ID:  <20090707081658.GA68385@server.vk2pj.dyndns.org>
In-Reply-To: <4A50E947.9020608@ksu.ru>
References:  <4A50E947.9020608@ksu.ru>

next in thread | previous in thread | raw e-mail | index | archive | help

--W/nzBZO5zC0uMSeA
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

On 2009-Jul-05 21:56:23 +0400, "Marat N.Afanasyev" <amarat@ksu.ru> wrote:
>i have a strange problem with writing data to my ufs2+su filesystem.

Overall, I think you are pushing UFS and have hit one of its limits.

>1. i made a 1T gpt partition on my storage server, and formatted it:
>newfs -U -m 0 -o time -i 32768 /dev/da1p3a

'-m 0' is undesirable.  The default 8% free space is intended to hide
the sort of effect you've run into.  Unless you can find a slightly
bigger disk, I suggest you try building an 8K/1K filesystem by adding
'-b 8192 -f 1024' - this will be slightly slower than the default
16K/2K but will hopefully allow you to fit slightly more files in.

>2. i tried to move data from other servers to this filesystem, total=20
>size of files is slightly less than 1T

Can you be more accurate than "slightly less than 1T" (ie how many
MiB) and what is the size distribution of the files?  The average size
is 48KiB but are they all roughly the same size or do they vary widely?
Are there many files <16KiB?

>3. i encountered a 'No space left on device' while i still have 11G of=20
>free space and about 13 million free inodes on the filesystem:
>
>#df -ih
>Filesystem     Size    Used   Avail Capacity  iused    ifree %iused=20
>Mounted on
>/dev/da1p3a    1.0T    1.0T     11G    99% 20397465 13363173   60%=20
>/mnt/45_114

More significant figures are needed.  How about 'df -im' or 'df -ik'.
How close are you to fitting in all the files you want?

>all i want to know is whether this is a bug or a feature? and if such a=20
>behavior is well-known, where can i read about it?

Have a read of /usr/share/doc/smm/05.fastfs/paper.ascii.gz - especially
the bits about "fragments".  Whilst this paper talks about the original
UFS and a 4K/1K configuration, the principles remain the same in UFS2.

--=20
Peter Jeremy

--W/nzBZO5zC0uMSeA
Content-Type: application/x-pkcs7-signature
Content-Disposition: attachment; filename="smime.p7s"
Content-Transfer-Encoding: base64

MIIPuQYJKoZIhvcNAQcCoIIPqjCCD6YCAQExCzAJBgUrDgMCGgUAMAsGCSqGSIb3DQEHAaCC
DSUwggXgMIIDyKADAgECAgMD984wDQYJKoZIhvcNAQEFBQAweTEQMA4GA1UEChMHUm9vdCBD
QTEeMBwGA1UECxMVaHR0cDovL3d3dy5jYWNlcnQub3JnMSIwIAYDVQQDExlDQSBDZXJ0IFNp
Z25pbmcgQXV0aG9yaXR5MSEwHwYJKoZIhvcNAQkBFhJzdXBwb3J0QGNhY2VydC5vcmcwHhcN
MDcwODI4MDA1MjAzWhcNMDkwODI3MDA1MjAzWjCBoDEVMBMGA1UEAxMMUGV0ZXIgSmVyZW15
MSswKQYJKoZIhvcNAQkBFhxwZXRlcmplcmVteUBvcHR1c2hvbWUuY29tLmF1MScwJQYJKoZI
hvcNAQkBFhhwZXRlci5qZXJlbXlAYXV1Zy5vcmcuYXUxMTAvBgkqhkiG9w0BCQEWInBldGVy
LmplcmVteUBhbGNhdGVsLWx1Y2VudC5jb20uYXUwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAw
ggEKAoIBAQC0saUsCMQRDIW7pALRwK5z9/gRCBYiYNnmx9fYEsDiIJ1zYJd33Z7hJ4exUXOG
Zk3IZjtSyUh9Qnqvic9bvhKpsLKE/2xzmj5ddfN4WzNcaM0+S2J6DzU5kZprn9Ex7A6YJ8WH
vEy8f1mXBnQ8SCwAsBJ41tIdW8cxkBRGCL9A+LFzEoHQ9x150eK2UjVHG7tjeFRMkiQC8BDo
7YY+dxH5apyru952xcu4HKEeOeb31WJhxa+HDiWhzbBR8vlUDocyy+41/LAbIET3VfPIuEwo
mrDgt3xKw1INUzXVi+jENzIqy8yFX9FigKlo/QDAfg58qvCs//BgpBxu7PUKTPyDAgMBAAGj
ggFHMIIBQzAMBgNVHRMBAf8EAjAAMFYGCWCGSAGG+EIBDQRJFkdUbyBnZXQgeW91ciBvd24g
Y2VydGlmaWNhdGUgZm9yIEZSRUUgaGVhZCBvdmVyIHRvIGh0dHA6Ly93d3cuQ0FjZXJ0Lm9y
ZzBABgNVHSUEOTA3BggrBgEFBQcDBAYIKwYBBQUHAwIGCisGAQQBgjcKAwQGCisGAQQBgjcK
AwMGCWCGSAGG+EIEATAyBggrBgEFBQcBAQQmMCQwIgYIKwYBBQUHMAGGFmh0dHA6Ly9vY3Nw
LmNhY2VydC5vcmcwZQYDVR0RBF4wXIEccGV0ZXJqZXJlbXlAb3B0dXNob21lLmNvbS5hdYEY
cGV0ZXIuamVyZW15QGF1dWcub3JnLmF1gSJwZXRlci5qZXJlbXlAYWxjYXRlbC1sdWNlbnQu
Y29tLmF1MA0GCSqGSIb3DQEBBQUAA4ICAQAXxWquW06hLqy4/mGkSaQCZpaeZ4ILLEA80TKi
7jSMVxnQzcjalox79LhWYBeIK7J+w5cfblD3o9lVvrwhSzDE3GmwKrz9aZIsNzD0LgTaQ6gv
f7U1DWex02WwowMwG00AAcqXwC7ZbOyl1gaVgXQuaYjUyggCPq9n54IlYRAVAWE/JBFVwqNP
JWdpDt7AMpa22UAJL+5rWaOde6SsUS55NTEQ7M32/xNCAFDwwO3rQ6ToEqpQUeoVyGnRdp+q
oJFkKE/fnngWy8wP9RPV+yxfJ4OfsLcILnp66wROwSECySJGkppO4C4NApOyHa4sZx8Ui6XP
A5EiICCCRIYJP3+sdlwgazfNu1lZ+/uHrajGgnpS7lGRZITa6hFcFJpoCHDjurPJWwPqdzpK
8wcSXeV05oEldK5FfOjzcaUd6mI/YLK3j4Ie7VQg1zB32shzM0Lk8iDLIAO+vKcBzi79dCjR
Hr0lKLttEVfNUcqDhEHzDvQsc+IYc8C4KibGeS9kRcx136EYXYn4dNu8Rab6ELTyaORlEB2z
jo9HcToNfO/jLwByiRAHefTyziljVqAv6PaaVFNcTtiCEzFwi/eJERNZ0A9RS0Q+yIrC+dC3
0Oz8TVUisJ4YOYJPVL1bVAzWVzf0IpIYPTixy9dpTItAY6BOTHzpcY/mCqiqoi36QXyCfDCC
Bz0wggUloAMCAQICAQAwDQYJKoZIhvcNAQEEBQAweTEQMA4GA1UEChMHUm9vdCBDQTEeMBwG
A1UECxMVaHR0cDovL3d3dy5jYWNlcnQub3JnMSIwIAYDVQQDExlDQSBDZXJ0IFNpZ25pbmcg
QXV0aG9yaXR5MSEwHwYJKoZIhvcNAQkBFhJzdXBwb3J0QGNhY2VydC5vcmcwHhcNMDMwMzMw
MTIyOTQ5WhcNMzMwMzI5MTIyOTQ5WjB5MRAwDgYDVQQKEwdSb290IENBMR4wHAYDVQQLExVo
dHRwOi8vd3d3LmNhY2VydC5vcmcxIjAgBgNVBAMTGUNBIENlcnQgU2lnbmluZyBBdXRob3Jp
dHkxITAfBgkqhkiG9w0BCQEWEnN1cHBvcnRAY2FjZXJ0Lm9yZzCCAiIwDQYJKoZIhvcNAQEB
BQADggIPADCCAgoCggIBAM4iwOJGfew2KAdQlvKgM0CMS/E7Zj8x5WsCNtvWfPbxiI9OdzYF
QZX5CfASz0aGc2C3bn7owFhkrs2wrUUXDGP6Zwro1tK/PueYxPBM+uADuzVdbCHeniDZus1m
Mjdy+vcI9cfNWMmO5w5e6j7+HKEUChVshoRbZGYqeqlLU3n1iKJ77i8KYSuNsn5NVqUT7Ora
kp6sREEeWGBlBWb4wES9y5T3Qn4L92VomFEF8PMFkQQdGxeC7MhXu8NreojxsHLMJVsgkewW
AhKPMukXGEjQxwUuAjBCuCWcBWs/qjqn61NI9+jStgeY3BvGNH9/yRyCegVYKwhb8ziiqxdd
ZsmY154Qi6LS3XSa93EMcmDfzW+YM52WNHY+JHqSsA6VHm/moEU4R6rXQe1KtxL21xuDig8u
2Am2WdeqBP/Sk31oLt2LS6tYui+N6pWnoMNUiaX724tRIp2yw74RviyRhouWeK0g04ovGj/G
0FFlhyGxGQFlf0Uch/V80EFMTymYIf0zH3UMBFH6GXfb1BQc7oHDHfWYt2kGkSLdAFDMgTGs
Egd7ONpoW+Yr1H7JX63o63JM8wHlSyC/mqZXypEAAYuhdSE3tWMNZz5GT3AgZ87F1lnbAuDw
0svNumK3kEHo3SDkKbxkKULIItx4mv9D7JgbCVFLWlrCcfHEy3Op5aELAgMBAAGjggHOMIIB
yjAdBgNVHQ4EFgQUFrUyG9TH8+DmjvO90rA67rI5GNEwgaMGA1UdIwSBmzCBmIAUFrUyG9TH
8+DmjvO90rA67rI5GNGhfaR7MHkxEDAOBgNVBAoTB1Jvb3QgQ0ExHjAcBgNVBAsTFWh0dHA6
Ly93d3cuY2FjZXJ0Lm9yZzEiMCAGA1UEAxMZQ0EgQ2VydCBTaWduaW5nIEF1dGhvcml0eTEh
MB8GCSqGSIb3DQEJARYSc3VwcG9ydEBjYWNlcnQub3JnggEAMA8GA1UdEwEB/wQFMAMBAf8w
MgYDVR0fBCswKTAnoCWgI4YhaHR0cHM6Ly93d3cuY2FjZXJ0Lm9yZy9yZXZva2UuY3JsMDAG
CWCGSAGG+EIBBAQjFiFodHRwczovL3d3dy5jYWNlcnQub3JnL3Jldm9rZS5jcmwwNAYJYIZI
AYb4QgEIBCcWJWh0dHA6Ly93d3cuY2FjZXJ0Lm9yZy9pbmRleC5waHA/aWQ9MTAwVgYJYIZI
AYb4QgENBEkWR1RvIGdldCB5b3VyIG93biBjZXJ0aWZpY2F0ZSBmb3IgRlJFRSBoZWFkIG92
ZXIgdG8gaHR0cDovL3d3dy5jYWNlcnQub3JnMA0GCSqGSIb3DQEBBAUAA4ICAQAox+6cggK6
XIASyjUKHYFviWqZzPJoD3+n4Y1YlT698gbDkFqstWD2mUMBo4hwnJ1inaSHr2dYDTA2O+at
SNPLdAKGcT7iKwNo8TRiQEY7U+oo9Kz7ZpVTik1d/TvZYNfKeWk7sWWSpsaBglyczetNAYql
3xFVqhXKHzfAgphwYdtqfJajji5UPk8hqZDv3IK/3OhFrU2Qcwg8lGWwBJl2f+K8wmoVqpcE
NyTYHpRObQ5RvtbEj8qWbfdD3+gwZSc7e7tDQ2PEQ/ey7GjM4RmOIvuY4XtaPgE3O4sIsKLz
lU4ay5vNmrHbsnDwLUrb2LDjb0VIMxL//jwyKlT3xPeK8Igjwkf+ZHpxwNEepmOwB36kL9MB
j9yfK7bGCKkPk0gl/BL9n0Lc88Q+9lew191p0QZ3NApL0sqg/xzGjMkWvsTMMjdoc18I+1H3
SVM2BQqVAkzyeRoQ9tg6dZzzHfGiDXBnhhuzFvUv5aTreYb5PQvCcwulmaxv/Ge45S8Lphgk
jXvRSDUpGECsk2DhloZQtHpZ2I8hC5/PgpHGO79r3AeRuZdWI6q2bJTGSAY85M5OquT2Lwnc
U28u/HTrOmOZwqasibynskSgDYoQ42zyJMv6m59wRy7eFIvUsiAJlqJk8SQc3KE1nBWy1LxV
Ln0G9ZwOVfRa1pPadq0lc0zFQzGCAlwwggJYAgEBMIGAMHkxEDAOBgNVBAoTB1Jvb3QgQ0Ex
HjAcBgNVBAsTFWh0dHA6Ly93d3cuY2FjZXJ0Lm9yZzEiMCAGA1UEAxMZQ0EgQ2VydCBTaWdu
aW5nIEF1dGhvcml0eTEhMB8GCSqGSIb3DQEJARYSc3VwcG9ydEBjYWNlcnQub3JnAgMD984w
CQYFKw4DAhoFAKCBsTAYBgkqhkiG9w0BCQMxCwYJKoZIhvcNAQcBMBwGCSqGSIb3DQEJBTEP
Fw0wOTA3MDcwODE2NThaMCMGCSqGSIb3DQEJBDEWBBQff/T5YdDI4PS/n1cNdo48Y52rsjBS
BgkqhkiG9w0BCQ8xRTBDMAoGCCqGSIb3DQMHMA4GCCqGSIb3DQMCAgIAgDANBggqhkiG9w0D
AgIBQDAHBgUrDgMCBzANBggqhkiG9w0DAgIBKDANBgkqhkiG9w0BAQEFAASCAQArfqM2Bb1Z
SNeIrKUVWEGKlO24Ay6W6CWTzdyH9VsQ4zqYivSH4h1iWVUz065ywPI64T3gW01NBW6X2Wwb
1IBaYgn77NLLbjRsKcPscZPlGqbV+xfwH3IgXeG/HEgc4SBBFUoqyLIu97BgijzidSPvXfp3
xu5uO5JwYUtx4rwax3Dg8hdOYo9wii1jTi37pshGodbKRJqmPgf06GztDe1zIgMbc2gFqdID
EhBmPlya66GtsMyYXeqyUy8sk3SV6becQQnCY17Dt1jay1+7ofxUWk6VNN6n3SEq+WFXXiHP
JcEjUnmuTHGZV4WmphWOpSgAhopdH7Peqk5aA+jt2p51

--W/nzBZO5zC0uMSeA--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20090707081658.GA68385>