Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 7 Mar 2018 17:32:29 +0000
From:      NAGY Andreas <Andreas.Nagy@frequentis.com>
To:        Rick Macklem <rmacklem@uoguelph.ca>, "'freebsd-stable@freebsd.org'" <freebsd-stable@freebsd.org>
Subject:   =?iso-8859-1?Q?RE:_NFS_4.1_RECLAIM=5FCOMPLETE_FS=A0failed_error_in_combin?= =?iso-8859-1?Q?ation_with_ESXi_client?=
Message-ID:  <D890568E1D8DD044AA846C56245166780124AFCABC@vie196nt>
In-Reply-To: <YQBPR0101MB10427C97161C74A5C441D1DCDDD80@YQBPR0101MB1042.CANPRD01.PROD.OUTLOOK.COM>
References:  <c5c624de-42bb-45cf-8cf0-b25be56e5f58@frequentis.com> <YQBPR0101MB1042DEF0825996764CBCA829DDC40@YQBPR0101MB1042.CANPRD01.PROD.OUTLOOK.COM>, <D890568E1D8DD044AA846C56245166780124AFB90E@vie196nt> <YQBPR0101MB1042479407CAA253674BBAEBDDDB0@YQBPR0101MB1042.CANPRD01.PROD.OUTLOOK.COM> <D890568E1D8DD044AA846C56245166780124AFBD21@vie196nt>, <D890568E1D8DD044AA846C56245166780124AFBD91@vie196nt> <YQBPR0101MB104225B6884FEC70A03C61CCDDDA0@YQBPR0101MB1042.CANPRD01.PROD.OUTLOOK.COM>, <D890568E1D8DD044AA846C56245166780124AFC0E2@vie196nt>, <YQBPR0101MB1042040D2BFB3681E940D271DDDA0@YQBPR0101MB1042.CANPRD01.PROD.OUTLOOK.COM>, <2feda1e2-16d5-43b5-98eb-dcc71cc67c6f@frequentis.com> <YQBPR0101MB10427C97161C74A5C441D1DCDDD80@YQBPR0101MB1042.CANPRD01.PROD.OUTLOOK.COM>

next in thread | previous in thread | raw e-mail | index | archive | help
--_002_D890568E1D8DD044AA846C56245166780124AFCABCvie196nt_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

Hi,

attached the trace. If I see it correct it uses FORE_OR_BOTH. (bctsa_dir: C=
DFC4_FORE_OR_BOTH (0x00000003))

The trace is only with the first patch, have not compiled the wantdeleg pat=
ches so far.

I think this is related to the BIND_CONN_TO_SESSION; after a disconnect the=
 ESXi cannot connect to the NFS also with this warning:
2018-03-07T16:55:11.227Z cpu21:66484)WARNING: NFS41: NFS41_Bug:2361: BUG - =
Invalid BIND_CONN_TO_SESSION error: NFS4ERR_NOTSUPP

Another thing I noticed today is that it is not possible to delete a folder=
 with the ESXi datastorebrowser on the NFS mount. Maybe it is a VMWare bug,=
 but with NFS3 it works.

Here the vmkernel.log with only one connection contains mounting, trying to=
 delete a folder and disconnect:

2018-03-07T16:46:04.543Z cpu12:68008 opID=3D55bea165)World: 12235: VC opID =
c55dbe59 maps to vmkernel opID 55bea165
2018-03-07T16:46:04.543Z cpu12:68008 opID=3D55bea165)NFS41: NFS41_VSIMountS=
et:423: Mount server: 10.0.0.225, port: 2049, path: /, label: nfsds1, secur=
ity: 1 user: , options: <none>
2018-03-07T16:46:04.543Z cpu12:68008 opID=3D55bea165)StorageApdHandler: 977=
: APD Handle  Created with lock[StorageApd-0x43046e4c6d70]
2018-03-07T16:46:04.544Z cpu11:66486)NFS41: NFS41ProcessClusterProbeResult:=
3873: Reclaiming state, cluster 0x43046e4c7ee0 [7]
2018-03-07T16:46:04.545Z cpu12:68008 opID=3D55bea165)NFS41: NFS41FSComplete=
Mount:3791: Lease time: 120
2018-03-07T16:46:04.545Z cpu12:68008 opID=3D55bea165)NFS41: NFS41FSComplete=
Mount:3792: Max read xfer size: 0x20000
2018-03-07T16:46:04.545Z cpu12:68008 opID=3D55bea165)NFS41: NFS41FSComplete=
Mount:3793: Max write xfer size: 0x20000
2018-03-07T16:46:04.545Z cpu12:68008 opID=3D55bea165)NFS41: NFS41FSComplete=
Mount:3794: Max file size: 0x800000000000
2018-03-07T16:46:04.545Z cpu12:68008 opID=3D55bea165)NFS41: NFS41FSComplete=
Mount:3795: Max file name: 255
2018-03-07T16:46:04.545Z cpu12:68008 opID=3D55bea165)WARNING: NFS41: NFS41F=
SCompleteMount:3800: The max file name size (255) of file system is larger =
than that of FSS (128)
2018-03-07T16:46:04.546Z cpu12:68008 opID=3D55bea165)NFS41: NFS41FSAPDNotif=
y:5960: Restored connection to the server 10.0.0.225 mount point nfsds1, mo=
unted as 1a7893c8-eec764a7-0000-000000000000 ("/")
2018-03-07T16:46:04.546Z cpu12:68008 opID=3D55bea165)NFS41: NFS41_VSIMountS=
et:435: nfsds1 mounted successfully
2018-03-07T16:47:19.869Z cpu21:67981 opID=3De47706ec)World: 12235: VC opID =
c55dbe91 maps to vmkernel opID e47706ec
2018-03-07T16:47:19.869Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.870Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.870Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.870Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.870Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.871Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.871Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.871Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.871Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.872Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.872Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.872Z cpu21:67981 opID=3De47706ec)WARNING: UserFile: 215=
5: hostd-worker: Directory changing too often to perform readdir operation =
(11 retries), returning busy
2018-03-07T16:47:19.874Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.875Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.875Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.875Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.875Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.876Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.876Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.876Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.876Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.877Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.877Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.877Z cpu21:67981 opID=3De47706ec)WARNING: UserFile: 215=
5: hostd-worker: Directory changing too often to perform readdir operation =
(11 retries), returning busy
2018-03-07T16:47:19.879Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.879Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.879Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.880Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.880Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.880Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.880Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.881Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.881Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.881Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.881Z cpu21:67981 opID=3De47706ec)WARNING: NFS41: NFS41F=
ileOpReaddir:4728: Failed to process READDIR result for fh 0x43046e4c6398: =
Transient file system condition, suggest retry
2018-03-07T16:47:19.881Z cpu21:67981 opID=3De47706ec)WARNING: UserFile: 215=
5: hostd-worker: Directory changing too often to perform readdir operation =
(11 retries), returning busy
2018-03-07T16:49:41.154Z cpu23:85446)WARNING: SunRPC: 3987: fail all pendin=
g calls for client 0x4303cbe221f0 IP 10.0.0.225.8.1 (socket half closed)
2018-03-07T16:49:41.155Z cpu11:66486)WARNING: NFS41: NFS41FSAPDNotify:5908:=
 Lost connection to the server 10.0.0.225 mount point nfsds1, mounted as 1a=
7893c8-eec764a7-0000-000000000000 ("/")

-----Original Message-----
From: Rick Macklem [mailto:rmacklem@uoguelph.ca]=20
Sent: Mittwoch, 7. M=E4rz 2018 16:07
To: NAGY Andreas <Andreas.Nagy@frequentis.com>; 'freebsd-stable@freebsd.org=
' <freebsd-stable@freebsd.org>
Subject: Re: NFS 4.1 RECLAIM_COMPLETE FS=A0failed error in combination with=
 ESXi client

NAGY Andreas wrote:
>Okay, that was the main reason for using NFS 4.1.
>Is it planned to implement it, or is the focus on pNFS?
I took a quick look and implementing this for some cases will be pretty eas=
y. Binding a FORE channel is implied, so for that case all the server does =
is reply OK to the BIND_CONN_TO_SESSION.

To know if the ESXi client case is a simple one, I need to see what the BIN=
D_CONN_TO_SESSION arguments look like.
If you can capture packets for when this second connection is done and emai=
l it to me as an attachment, I can look at what the BIND_CONN_TO_SESSION ar=
gs are.
# tcpdump -s 0 -w <file.pcap> host <client-host-for-this-connection> run on=
 the FreeBSD server should get the <file.pcap> I need.

Alternately, if you have wireshark handy, you can just use it to look for t=
he BIND_CONN_TO_SESSION request and see if it specifies (FORE, BACK, FORE_O=
R_BOTH or BACK_OR_BOTH) in it.
FORE or FORE_OR_BOTH means it is easy to do and I can probably have a patch=
 for testing in a day or two.

rick

--_002_D890568E1D8DD044AA846C56245166780124AFCABCvie196nt_
Content-Type: application/octet-stream; name="nfs41_trace.pcap"
Content-Description: nfs41_trace.pcap
Content-Disposition: attachment; filename="nfs41_trace.pcap"; size=4930;
	creation-date="Wed, 07 Mar 2018 16:45:03 GMT";
	modification-date="Wed, 07 Mar 2018 16:45:03 GMT"
Content-Transfer-Encoding: base64

1MOyoQIABAAAAAAAAAAAAAAABAABAAAAWhugWkBTAABKAAAASgAAAAAmVdY3uABQVmtb7AgARQAA
POvDQABABjVFCgAC0woAAuECtggBdTR+pQAAAACgAv//0TwAAAIEIwABAwMJBAIICgCMQKUAAAAA
WhugWk5TAABKAAAASgAAAABQVmtb7AAmVdY3uAgARQAAPHfvAABABukZCgAC4QoAAtMIAQK2oNgD
X3U0fqagEv//GeIAAAIEIwABAwMJBAIICrgDIm8AjEClWhugWjdUAABCAAAAQgAAAAAmVdY3uABQ
Vmtb7AgARQAANOvFQABABjVLCgAC0woAAuECtggBdTR+pqDYA2CAEACLnhAAAAEBCAoAjECluAMi
b1oboFpPVAAAQgAAAEIAAAAAUFZrW+wAJlXWN7gIAEUAADR38AAAQAbpIAoAAuEKAALTCAECtqDY
A2B1NH6mgBABBhnaAAABAQgKuAMicACMQKVaG6BaL1UAAEoBAABKAQAAACZV1je4AFBWa1vsCABF
AAE868ZAAEAGNEIKAALTCgAC4QK2CAF1NH6moNgDYIAYCAAxZQAAAQEICgCMQKW4AyJvgAABBGie
nrQAAAAAAAAAAgABhqMAAAAEAAAAAQAAAAEAAAAgAAAAAAAAAApBVFMtRVNYLTAxAAAAAAAAAAAA
AAAAAAAAAAAAAAAAAAAAAA5ORlM0MUN0bEV4Y2hJRAAAAAAAAQAAAAEAAAAq4K2eWgAAAAAAAAAk
NWE3ODNkNTAtNmRlNS01ZDRhLTJkMWQtMDAxOTk5YmEzM2Q3AAMAAAAAAAAAAAABAAAACnZtd2Fy
ZS5jb20AAAAAAD9WTXdhcmUgTkZTdjQuMSBDbGllbnQ6IFZNd2FyZSBFU1hpLCA2LjUuMCwgUmVs
ZWFzZWJ1aWxkLTczODg2MDcAAAAAAFo3m2MAAAAAWhugWmxVAABCAAAAQgAAAABQVmtb7AAmVdY3
uAgARQAANAQAAABABl0RCgAC4QoAAtMIAQK2oNgDYHU0f66AEHHHGdoAAAEBCAq4AyJwAIxApVob
oFqJVQAAdgEAAHYBAAAAUFZrW+wAJlXWN7gIAEUAAWgEAQAAQAZb3AoAAuEKAALTCAECtqDYA2B1
NH+ugBhxxxsOAAABAQgKuAMicACMQKWAAAEwaJ6etAAAAAEAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
AA5ORlM0MUN0bEV4Y2hJRAAAAAAAAQAAACoAAAAAgxagWgIAAAAAAAAAgAEAAAAAAAAAAAAAAAAA
AAAAACRkODUzNzM0OS1hYmMzLTExZGYtYTg0Ny0wMDE5OTk4M2UwNjgAAAAEIAUAAAAAAAEAAAAL
ZnJlZWJzZC5vcmcAAAAAgUZyZWVCU0QgMTEuMS1SRUxFQVNFICMwIHIzMzAzNzNNOiBTdW4gTWFy
ICA0IDEwOjIwOjQyIFVUQyAyMDE4CiAgICBmcnFAbmFzNGZyZWUtZGV2Oi91c3Ivb2JqL25hczRm
cmVlL3Vzci9zcmMvc3lzL05BUzRGUkVFLWFtZDY0CgAAAAAAAABNHm6AAAAAAFoboFqjVgAA0gAA
ANIAAAAAJlXWN7gAUFZrW+wIAEUAAMTryUAAQAY0twoAAtMKAALhArYIAXU0f66g2ASUgBgIAF6T
AAABAQgKAIxApbgDInCAAACMaJ6euAAAAAAAAAACAAGGowAAAAQAAAABAAAAAQAAACAAAAAAAAAA
CkFUUy1FU1gtMDEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAGU5GUzQxQ3RsQmluZENvbm5Ub1Nl
c3Npb24AAAAAAAABAAAAAQAAACkCAAAAAAAAAIMWoFoCAAAAAAAAAwAAAABaG6Ba6VYAAI4AAACO
AAAAAFBWa1vsACZV1je4CABFAACAj+QAAEAG0OAKAALhCgAC0wgBArag2ASUdTSAPoAYcccaJgAA
AQEICrgDInAAjEClgAAASGienrgAAAABAAAAAAAAAAAAAAAAAAAAAAAAJxQAAAAZTkZTNDFDdGxC
aW5kQ29ublRvU2Vzc2lvbgAAAAAAAAEAAAApAAAnFFoboFq89wEAQgAAAEIAAAAAJlXWN7gAUFZr
W+wIAEUAADTr+kAAQAY1FgoAAtMKAALhArYIAXU0gD6g2ATggBAIAJN3AAABAQgKAIxAsLgDInBf
G6BaEnEAADwAAAA8AAAAACZV1je4AFBWa1vsCABFAAAo7GJAAEAGNLoKAALTCgAC4QK2CAF1NIA9
oNgE4FAQCADoPwAAAAAAAAAAXxugWh5xAABCAAAAQgAAAABQVmtb7AAmVdY3uAgARQAANHfyAABA
BukeCgAC4QoAAtMIAQK2oNgE4HU0gD6AEHHHGdoAAAEBCAq4AzX/AIxAsGQboFoKYAAA0gAAANIA
AAAAJlXWN7gAUFZrW+wIAEUAAMTssEAAQAYz0AoAAtMKAALhArYIAXU0gD6g2ATggBgIAEY+AAAB
AQgKAIxEjbgDNf+AAACMaJ6eugAAAAAAAAACAAGGowAAAAQAAAABAAAAAQAAACAAAAAAAAAACkFU
Uy1FU1gtMDEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAGU5GUzQxQ3RsQmluZENvbm5Ub1Nlc3Np
b24AAAAAAAABAAAAAQAAACkCAAAAAAAAAIMWoFoCAAAAAAAAAwAAAABkG6BaT2AAAI4AAACOAAAA
AFBWa1vsACZV1je4CABFAACAkFUAAEAG0G8KAALhCgAC0wgBArag2ATgdTSAzoAYcccaJgAAAQEI
CrgDSYMAjESNgAAASGienroAAAABAAAAAAAAAAAAAAAAAAAAAAAAJxQAAAAZTkZTNDFDdGxCaW5k
Q29ublRvU2Vzc2lvbgAAAAAAAAEAAAApAAAnFGQboFqe9wEAQgAAAEIAAAAAJlXWN7gAUFZrW+wI
AEUAADTssUAAQAY0XwoAAtMKAALhArYIAXU0gM6g2AUsgBAIAGegAAABAQgKAIxEmLgDSYNpG6Ba
znAAADwAAAA8AAAAACZV1je4AFBWa1vsCABFAAAo7QBAAEAGNBwKAALTCgAC4QK2CAF1NIDNoNgF
LFAQCADnYwAAAAAAAAAAaRugWtpwAABCAAAAQgAAAABQVmtb7AAmVdY3uAgARQAANHf1AABABukb
CgAC4QoAAtMIAQK2oNgFLHU0gM6AEHHHGdoAAAEBCAq4A10PAIxEmG4boFp3agAA0gAAANIAAAAA
JlXWN7gAUFZrW+wIAEUAAMTtoEAAQAYy4AoAAtMKAALhArYIAXU0gM6g2AUsgBgIABn7AAABAQgK
AIxIdbgDXQ+AAACMaJ6fKQAAAAAAAAACAAGGowAAAAQAAAABAAAAAQAAACAAAAAAAAAACkFUUy1F
U1gtMDEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAGU5GUzQxQ3RsQmluZENvbm5Ub1Nlc3Npb24A
AAAAAAABAAAAAQAAACkCAAAAAAAAAIMWoFoCAAAAAAAAAwAAAABuG6BavmoAAI4AAACOAAAAAFBW
a1vsACZV1je4CABFAACAkIwAAEAG0DgKAALhCgAC0wgBArag2AUsdTSBXoAYcccaJgAAAQEICrgD
cJUAjEh1gAAASGienykAAAABAAAAAAAAAAAAAAAAAAAAAAAAJxQAAAAZTkZTNDFDdGxCaW5kQ29u
blRvU2Vzc2lvbgAAAAAAAAEAAAApAAAnFG4boFrI9gEAQgAAAEIAAAAAJlXWN7gAUFZrW+wIAEUA
ADTtoUAAQAYzbwoAAtMKAALhArYIAXU0gV6g2AV4gBAIADvKAAABAQgKAIxIgLgDcJVzG6Ba0m8A
ADwAAAA8AAAAACZV1je4AFBWa1vsCABFAAAo7rFAAEAGMmsKAALTCgAC4QK2CAF1NIFdoNgFeFAQ
CADmhwAAAAAAAAAAcxugWt1vAABCAAAAQgAAAABQVmtb7AAmVdY3uAgARQAANHf2AABABukaCgAC
4QoAAtMIAQK2oNgFeHU0gV6AEHHHGdoAAAEBCAq4A4QfAIxIgHgboFpccAAA0gAAANIAAAAAJlXW
N7gAUFZrW+wIAEUAAMTuykAAQAYxtgoAAtMKAALhArYIAXU0gV6g2AV4gBgIAO3uAAABAQgKAIxM
XrgDhB+AAACMaJ6fYAAAAAAAAAACAAGGowAAAAQAAAABAAAAAQAAACAAAAAAAAAACkFUUy1FU1gt
MDEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAGU5GUzQxQ3RsQmluZENvbm5Ub1Nlc3Npb24AAAAA
AAABAAAAAQAAACkCAAAAAAAAAIMWoFoCAAAAAAAAAwAAAAB4G6BapXAAAI4AAACOAAAAAFBWa1vs
ACZV1je4CABFAACAkSUAAEAGz58KAALhCgAC0wgBArag2AV4dTSB7oAYcccaJgAAAQEICrgDl6cA
jExegAAASGien2AAAAABAAAAAAAAAAAAAAAAAAAAAAAAJxQAAAAZTkZTNDFDdGxCaW5kQ29ublRv
U2Vzc2lvbgAAAAAAAAEAAAApAAAnFHgboFpiJQIAQgAAAEIAAAAAJlXWN7gAUFZrW+wIAEUAADTu
y0AAQAYyRQoAAtMKAALhArYIAXU0ge6g2AXEgBAIAA/zAAABAQgKAIxMabgDl6d9G6Ba1cQAADwA
AAA8AAAAACZV1je4AFBWa1vsCABFAAAo7u1AAEAGMi8KAALTCgAC4QK2CAF1NIHtoNgFxFAQCADl
qwAAAAAAAAAAfRugWuDEAABCAAAAQgAAAABQVmtb7AAmVdY3uAgARQAANHf5AABABukXCgAC4QoA
AtMIAQK2oNgFxHU0ge6AEHHHGdoAAAEBCAq4A6tEAIxMaYIboFq5egAA0gAAANIAAAAAJlXWN7gA
UFZrW+wIAEUAAMTvB0AAQAYxeQoAAtMKAALhArYIAXU0ge6g2AXEgBgIAMFsAAABAQgKAIxQRrgD
q0SAAACMaJ6f+QAAAAAAAAACAAGGowAAAAQAAAABAAAAAQAAACAAAAAAAAAACkFUUy1FU1gtMDEA
AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAGU5GUzQxQ3RsQmluZENvbm5Ub1Nlc3Npb24AAAAAAAAB
AAAAAQAAACkCAAAAAAAAAIMWoFoCAAAAAAAAAwAAAACCG6BaJHsAAI4AAACOAAAAAFBWa1vsACZV
1je4CABFAACAkSYAAEAGz54KAALhCgAC0wgBArag2AXEdTSCfoAYcccaJgAAAQEICrgDvroAjFBG
gAAASGien/kAAAABAAAAAAAAAAAAAAAAAAAAAAAAJxQAAAAZTkZTNDFDdGxCaW5kQ29ublRvU2Vz
c2lvbgAAAAAAAAEAAAApAAAnFIIboFq9IwIAQgAAAEIAAAAAJlXWN7gAUFZrW+wIAEUAADTvCEAA
QAYyCAoAAtMKAALhArYIAXU0gn6g2AYQgBAIAOQbAAABAQgKAIxQUbgDvrqHG6Baa50AADwAAAA8
AAAAACZV1je4AFBWa1vsCABFAAAo8BlAAEAGMQMKAALTCgAC4QK2CAF1NIJ9oNgGEFAQCADkzwAA
AAAAAAAAhxugWnedAABCAAAAQgAAAABQVmtb7AAmVdY3uAgARQAANHjJAABABuhHCgAC4QoAAtMI
AQK2oNgGEHU0gn6AEHHHGdoAAAEBCAq4A9JKAIxQUYwboFoThQAA0gAAANIAAAAAJlXWN7gAUFZr
W+wIAEUAAMTwMUAAQAYwTwoAAtMKAALhArYIAXU0gn6g2AYQgBgIAJWhAAABAQgKAIxULrgD0kqA
AACMaJ6f+gAAAAAAAAACAAGGowAAAAQAAAABAAAAAQAAACAAAAAAAAAACkFUUy1FU1gtMDEAAAAA
AAAAAAAAAAAAAAAAAAAAAAAAAAAAGU5GUzQxQ3RsQmluZENvbm5Ub1Nlc3Npb24AAAAAAAABAAAA
AQAAACkCAAAAAAAAAIMWoFoCAAAAAAAAAwAAAACMG6BafoUAAI4AAACOAAAAAFBWa1vsACZV1je4
CABFAACABAkAAEAGXLwKAALhCgAC0wgBArag2AYQdTSDDoAYcccaJgAAAQEICrgD5cwAjFQugAAA
SGien/oAAAABAAAAAAAAAAAAAAAAAAAAAAAAJxQAAAAZTkZTNDFDdGxCaW5kQ29ublRvU2Vzc2lv
bgAAAAAAAAEAAAApAAAnFIwboFpcIwIAQgAAAEIAAAAAJlXWN7gAUFZrW+wIAEUAADTwMkAAQAYw
3goAAtMKAALhArYIAXU0gw6g2AZcgBAIALhFAAABAQgKAIxUObgD5cyRG6BarpwAADwAAAA8AAAA
ACZV1je4AFBWa1vsCABFAAAo8D9AAEAGMN0KAALTCgAC4QK2CAF1NIMNoNgGXFAQCADj8wAAAAAA
AAAAkRugWrmcAABCAAAAQgAAAABQVmtb7AAmVdY3uAgARQAANHjMAABABuhECgAC4QoAAtMIAQK2
oNgGXHU0gw6AEHHHGdoAAAEBCAq4A/laAIxUOQ==

--_002_D890568E1D8DD044AA846C56245166780124AFCABCvie196nt_--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?D890568E1D8DD044AA846C56245166780124AFCABC>