Date: Mon, 7 Apr 2008 18:00:58 -0700 From: Chuck Swiger <cswiger@mac.com> To: Chris Maness <chris@chrismaness.com> Cc: FreeBSD List <freebsd-questions@freebsd.org> Subject: Re: Mail Spool Problems / IMAP Message-ID: <5CD93A19-BF52-42E2-A6B4-CC55179E0FCA@mac.com> In-Reply-To: <20080407174833.O72600@ns1.kq6up.org> References: <20080407084644.T69126@ns1.kq6up.org> <3B719C19-1051-491D-936F-158C4A58D49E@mac.com> <20080407174833.O72600@ns1.kq6up.org>
next in thread | previous in thread | raw e-mail | index | archive | help
On Apr 7, 2008, at 5:49 PM, Chris Maness wrote:
> How do I check it? Should I use another IMAP server?
Look at the first few lines; you should see either a placeholder =20
message like:
> =46rom MAILER-DAEMON Mon Apr 7 13:08:13 2008
> Date: 07 Apr 2008 13:08:13 -0400
> From: Mail System Internal Data <MAILER-DAEMON@pong.codefab.com>
> Subject: DON'T DELETE THIS MESSAGE -- FOLDER INTERNAL DATA
> Message-ID: <1207588093@pong.codefab.com>
> X-IMAP: 1143826475 0000000664 NonJunk $NotJunk JunkRecorded $Junk Junk
> Status: RO
>
> This text is part of the internal format of your mail folder, and is =20=
> not
> a real message. It is created automatically by the mail system =20
> software.
> If deleted, important folder data will be lost, and it will be re-=20
> created
> with the data reset to initial values.
>
...or a normal message with an X-IMAPbase: header, depending on which =20=
version of UW IMAP you created the mailbox under. If you see binary =20
gunk (see forwarded message below), you're running into the same issue =20=
I've seen.
Regards,
--=20
-Chuck
PS: Since the mail below was written, I have seen this corruption =20
happen with Outlook and Mozilla Tbird, not just with Apple Mail.
Begin forwarded message:
> From: Chuck Swiger <cswiger@mac.com>
> Date: January 24, 2008 11:05:50 AM PST
> To: imap-uw@u.washington.edu
> Subject: [Imap-uw] imap-2007 on Solaris 8, possible mbox data =20
> corruption?
>
> Hi, all--
>
> I've been a happy user of UW imapd for many years, but recently a =20
> number of my users have started really doing a lot of mail access in =20=
> parallel from a workstation and something like an iPhone. I'd been =20=
> receiving more frequent reports of imapd locking problems with =20
> imapd-2006h (ie, which would be resolved by them quitting and =20
> restarting their MUA or smart phone), and have updated the imapd to =20=
> imap-2007 based on the comments in the release notes about the =20
> locking issues which hopefully were resolved with 2006k.
>
> The users have initially reported that their locking problems were =20
> much improved after the update, however, the build of imap-2007 is =20
> now showing signs of a mbox corruption issue which has affected =20
> several users. Specifically, the first line or perhaps first few =20
> lines of their mbox (either /var/mail/$USER, or ~$USER/mail/mbox) =20
> which is normally the SMTP envelope =46rom header, is being corrupted.
>
> Two examples (with apologies for the length):
>
> # head -2 mbox_200801114
> @???h?f??x?#~??$??
> I??U?#LiLQ?
> ?{?v?????=DB=9Fc??"nF????m??mendez@gmail.com=
>
> Received: from pi.codefab.com (pi.codefab.com [199.103.21.227])
> # head -2 mbox_200801114 | od -h
> 0000000 1703 0100 4092 9291 0668 9f66 fae3 78df
> 0000020 237e c0d2 2415 e4f7 0b1e 499d da55 e223
> 0000040 1f8e 084c 694c 1c51 e00b 9f7b a076 0fbc
> 0000060 b1be a4e2 93db 9f63 b9b1 226e 46a3 1cc1
> 0000100 c9c9 6d8e 8f6d 656e 6465 7a40 676d 6169
> 0000120 6c2e 636f 6d3e 0a52 6563 6569 7665 643a
> 0000140 2066 726f 6d20 7069 2e63 6f64 6566 6162
> 0000160 2e63 6f6d 2028 7069 2e63 6f64 6566 6162
> 0000200 2e63 6f6d 205b 3139 392e 3130 332e 3231
> 0000220 2e32 3237 5d29 0a00
>
> # head -8 mbox_20080121
> ?*?D?jZ??????{?=DA=9F V??=C3=B9Ey ?u?uG?M?Nl?R???:?hx
> Q?R?5???? ?r???U?N?E??=CE=B4K??=D1=BC?-K?=CD=91@?!????$?c,?
> ??-?0?Z????4??9?@?=20
> C??a6?v?
> =
fJh=20
> ?k?Kp?g??
>
> =
b=20
> ??
> ?FR_????b?k?=E5=95=BE)???t_?=DB=86tF2?X??&??>h?z?3??ZNr?Yz=3D=CB=AC??9=DF=
=AC??6??4?{?mWCX?=20
> Z2?K??=CA=A9)?vG??a??}Mi5?=D0=AF?9?)?=3DnUc?,<,?~
> =
:?V=20
> ?w<?n????????B?w?????<???>8AB h7???=ED=91=A6X?
> ??d?d?tQ?bh?\6~rj???~=D6=81a #?y?F??j????o??DA=DE=BA?e4d?z'???
> ]6 2??=3D???=20
> %?"??????8???v|??=E1=84=A1S?B?( =
lJp?)^7'???g8?#??F0????=C9=9E??CP??=D6=A3???=20
> R=DA=973?8(?_??X"???=C5=A6=D6=80?E?[?F?K?f=EB=9C=83?Qq?_=C7=96 ??=E5=92=AD=
o?
> vBdh????L?1??w???G??
> ???ZLP???D?E6:?h?=DC=91N=CF=87?M =
???ax?n?x?\?O/ZF3??=3D??0?[??1cfX??;???`???-?=20
> z_>?E??\?C}??=D7=82P?\=E3=8B=83J?~L^??=3D?=C9=B6???Y?4rF?\3<?I+DDUP??p??=
=3D?=C4=B5D ?K??=20
> FP??dm?|yH??D?E?K
> $YS???;F/4x?(e?~$3=CA=BB=E4=9A=B3=3D=DB=B7nR?.?6
> ?%??@????f??=DD=BE??r??7T??7??O??}?[3p?)7,??X?o=DE=9E?T??;?*?6F??)q`????=
\?=C2=B4?=20
> &0??'&?zn??H??????9,o?!??EC6??U?( s\H$?h?B?P-7uO7?-Q?/?0?1%1j?=20
> a???????!??!#$?????:??b???????6??B????LS>b?|4:11 -0400 (EDT)
> Received: from list.precipice.net ([199.103.21.231])
> # head -8 mbox_20080121 | od -h
> 0000000 1703 0103 e042 3493 4acb baae 3b03 ebab
> 0000020 9316 0deb 2ac0 4489 6a5a 8a81 e8a7 12af
> 0000040 0504 8e1b 23a2 8b7b d5da 9f20 56dc d5c3
> 0000060 b945 1279 1e20 d81f 758a 7547 1a93 1e4d
> 0000100 bb4e 6ce3 8606 521e d002 86aa 3ad7 6811
> 0000120 780a 51ab 52e9 358a d5ff f296 09c8 72fc
> 0000140 cad4 55c7 4e9b 45b4 b9ce b44b b990 d1bc
> 0000160 d62d 4bc4 cd91 100e 40ab 21ba a2cd f124
> 0000200 a863 2cf0 0c04 8615 a32d f913 30c1 5a97
> 0000220 f912 e804 02de 34d6 ef39 c140 b143 dfe6
> 0000240 610f 3605 db76 d80b 664a 68ca 036b 9c4b
> 0000260 1970 c667 c73f 0b06 0b09 62af c80a a846
> 0000300 190e 525f 95a6 9590 62d9 6b3f e595 be29
> 0000320 b98d e883 745f addb 8674 4632 ef58 86a9
> 0000340 2680 b33e 68cb 7aaa 3393 eb5a 4e72 138e
> 0000360 597a 3dcb acac 9d39 02df acba e636 9386
> 0000400 3499 7bfe 6d57 1143 58ff 5a32 9b4b b39a
> 0000420 caa9 2987 7647 f3ca 61ff c603 7d4d 6935
> 0000440 f2d0 afe1 1d39 dd29 d63d 6e55 631b 66eb
> 0000460 2c01 133c 2cc9 7e0b 3ac8 56a0 773c 966e
> 0000500 fcfa e280 f0f6 85ab dc42 cc77 edae a0de
> 0000520 dd3c 8c90 e33e 3841 4209 6837 8ee2 e3ed
> 0000540 91a6 5885 0acd db0e 64f2 7f64 d11c 7451
> 0000560 af62 68ce 5c36 7e72 6aae 119b 827e d681
> 0000600 0161 2023 1dd6 79ed 46bf b76a acf2 d6ea
> 0000620 9302 6fe9 d944 4117 deba b365 3464 af7a
> 0000640 1e27 8fa0 ba0b 5d36 0932 fffa 3dc5 dcfb
> 0000660 25f8 22ed 111a b799 9fca fc38 8d18 8acb
> 0000700 767c b019 bee1 84a1 53c1 42ba 2809 6c4a
> 0000720 1070 ad29 5e37 2712 92f9 9b67 38ae 23b8
> 0000740 fc46 30a2 12cb 00ff 87c9 9ee7 ed43 50a4
> 0000760 89d6 a3bb 1094 e5bd 52da 9733 8e38 28d3
> 0001000 5fb8 c906 5822 811e 89d7 c5a6 d680 e345
> 0001020 8006 5bd3 46c8 044b 01e6 66eb 9c83 f751
> 0001040 718f 5fc7 9620 87cf e592 ad6f e80b 2076
> 0001060 4264 68d5 c21c fbda 054c c731 f9ba 7710
> 0001100 b690 aa47 3fcd 0af0 9705 8edc 5a4c 50ca
> 0001120 daf3 2208 44e9 4536 3aad 6882 dc91 074e
> 0001140 cf87 f54d 0992 cfd0 6117 78b4 6e05 c978
> 0001160 995c 914f 2f5a 4633 acf0 3daf d030 04a1
> 0001200 1c5b a6bf 3163 6612 5814 9a07 1d9d 3b94
> 0001220 3f87 609a e9c8 2d8b 7a5f 3ec9 45c5 e75c
> 0001240 e643 7da6 0306 aed7 8250 b85c e38b 834a
> 0001260 de7e 104c 5ead 02aa 3ddd c9b6 c7dc de16
> 0001300 59ca 3472 46c2 5c33 3cfc 492b 0744 1244
> 0001320 5550 1501 d8dc 70a9 c63d c7c4 b544 0983
> 0001340 4bf6 ae46 50ad d846 4cbd 7c79 48bb 3f44
> 0001360 8145 864b 0d64 6d0a 2459 0153 fbab 803b
> 0001400 462f 3478 c328 65b0 7e24 33ca bbe4 9ab3
> 0001420 3ddb b712 6e52 1a19 932e d736 0a8f 25b1
> 0001440 8440 e3b3 f69c 9966 90c2 ddbe f7f1 80bc
> 0001460 72a7 f1a5 3754 a0ca 37b5 a54f b4e0 7d13
> 0001500 e788 5b33 1e70 c629 372c 0080 a758 a26f
> 0001520 de9e dd54 e8ea 1c3b eb2a a436 46aa d429
> 0001540 7160 bbfa fee7 5c10 dec2 b4aa 2630 85d2
> 0001560 2726 8d19 127a 6efc ea48 a088 8310 eaf0
> 0001600 a912 9239 0e2c 056f ba21 baac 4543 36c9
> 0001620 eea8 55c7 2820 735c 4824 de68 b942 a350
> 0001640 2d37 754f 37ee 952d 5103 cc2f ed30 8c31
> 0001660 2531 6af4 1461 fd1d afb4 a2d8 1fc5 c506
> 0001700 21cb e221 231e 24e0 e6ce eaef 3ade f162
> 0001720 f5be 8bf5 b09b ea36 eae4 42ba 8a93 f64c
> 0001740 533e 62b4 7c34 3a31 3120 2d30 3430 3020
> 0001760 2845 4454 290a 5265 6365 6976 6564 3a20
> 0002000 6672 6f6d 206c 6973 742e 7072 6563 6970
> 0002020 6963 652e 6e65 7420 285b 3139 392e 3130
> 0002040 332e 3231 2e32 3331 5d29 0a00
>
> The mailserver in question is a Sun E450 running Solaris 8 (kernel =20
> rev=3DGeneric_117350-46); imap-2007 was built with "make gso" using =20=
> gcc-3.4.6 from the sunfreeware.com SMCgcc package and against =20
> OpenSSL 0.9.8f also from SMCossl; the only change was to set =20
> mailsubdir =3D "mail". All of the files are on local disks which are =20=
> in either a RAID-1 (/var) or RAID-10 (/home) configuration using =20
> DiskSuite; metastat and systems logs are not reporting any disk =20
> issues.
>
> This problem seems to only happen in conjunction with simultaneous =20
> access and has been reported only with Mail.app from MacOS X =20
> 10.4/10.5 & either a iPhone/Treo/Blackberry; I have yet to hear of =20
> problems with users running Mozilla Thunderbird or Outlook Express. =20=
> Since all access is via 993/imaps, I can't readily tcpdump the =20
> traffic, but I do have some syslogs which correspond to the issue:
>
> Jan 24 13:01:14 pong imapd[24697]: [ID 234311 mail.info] Login =20
> user=3Dxxxxx host=3Dnfw1.codefab.com [199.103.21.225]
> Jan 24 13:01:14 pong imapd[24697]: [ID 960700 mail.info] Logout =20
> user=3Dxxxxx host=3Dnfw1.codefab.com [199.103.21.225]
> Jan 24 13:03:32 pong imapd[24722]: [ID 234311 mail.info] Login =20
> user=3Dxxxxx host=3Dmobile-032-137-230-023.mycingular.net =
[32.137.230.23]
> Jan 24 13:04:06 pong imapd[24722]: [ID 960700 mail.info] Hangup =20
> user=3Dxxxxx host=3Dmobile-032-137-230-023.mycingular.net =
[32.137.230.23]
> Jan 24 13:06:15 pong imapd[25051]: [ID 234311 mail.info] Login =20
> user=3Dxxxxx host=3Dnfw1.codefab.com [199.103.21.225]
> Jan 24 13:06:15 pong imapd[25051]: [ID 960700 mail.info] Logout =20
> user=3Dxxxxx host=3Dnfw1.codefab.com [199.103.21.225]
> Jan 24 13:09:28 pong imapd[24023]: [ID 960700 mail.info] Killed =20
> (terminated) user=3Dxxxxx host=3Dnfw1.codefab.com [199.103.21.225]
> Jan 24 13:17:24 pong imapd[25829]: [ID 234311 mail.info] Login =20
> user=3Dxxxxx host=3Dnfw1.codefab.com [199.103.21.225]
> Jan 24 13:17:30 pong imapd[25834]: [ID 234311 mail.info] Login =20
> user=3Dxxxxx host=3Dnfw1.codefab.com [199.103.21.225]
> Jan 24 13:17:31 pong imapd[25835]: [ID 234311 mail.info] Login =20
> user=3Dxxxxx host=3Dnfw1.codefab.com [199.103.21.225]
> Jan 24 13:17:36 pong imapd[25834]: [ID 960700 mail.info] Logout =20
> user=3Dxxxxx host=3Dnfw1.codefab.com [199.103.21.225]
> Jan 24 13:18:50 pong imapd[25857]: [ID 234311 mail.info] Login =20
> user=3Dxxxxx host=3Dmobile-032-136-111-035.mycingular.net =
[32.136.111.35]
> Jan 24 13:18:51 pong imapd[25829]: [ID 960700 mail.info] Killed =20
> (lost mailbox lock) user=3Dxxxxx host=3Dnfw1.codefab.com =
[199.103.21.225]
> Jan 24 13:18:51 pong imapd[25835]: [ID 960700 mail.info] Unexpected =20=
> client disconnect, while reading line user=3Dxxxxx =20
> host=3Dnfw1.codefab.com [199.103.21.225]
> Jan 24 13:19:32 pong imapd[25857]: [ID 960700 mail.info] Hangup =20
> user=3Dxxxxx host=3Dmobile-032-136-111-035.mycingular.net =
[32.136.111.35]
> Jan 24 13:22:30 pong imapd[26199]: [ID 234311 mail.info] Login =20
> user=3Dxxxxx host=3Dnfw1.codefab.com [199.103.21.225]
>
> Regards,
> --=20
> -Chuck
>
> _______________________________________________
> Imap-uw mailing list
> Imap-uw@u.washington.edu
> https://mailman1.u.washington.edu/mailman/listinfo/imap-uw
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?5CD93A19-BF52-42E2-A6B4-CC55179E0FCA>