Date: Tue, 05 Jan 1999 16:43:09 -0500 From: Robert Withrow <bwithrow@BayNetworks.COM> To: hackers@FreeBSD.ORG Cc: witr@rwwa.com, bwithrow@BayNetworks.COM Subject: 3.0-REL NFS interop problems redux Message-ID: <199901052143.VAA15097@tuva.engeast.baynetworks.com>
next in thread | raw e-mail | index | archive | help
I whined before about my problem where a specific NFS mount goes
deaf on me for a period of time and then wakes up later. I said
that I would sniff out the problem... Well I finally got my office
set up so that I could get a sniffer to capture the session and I have
that capture (about 600 packets). I've looked at it and I can see
where it goes wrong, but I can't see *why* it is wrong. I'm wondering
if there is an NFS hacker who can work with me on this.
To recap, I'm using 3.0_REL but I have replaced the amutils with the
latest beta of amutils (which fixes a number of amd-related problems
in 3.0-REL). I log into a virtual console and I can access my
(nfs-mounted, automounted) home directory. I then log into an
XDM session and the login hangs accessing my home directory. If
I switch back to the VT session I *also* hang accessing my home
directory. The mount will "wake up" on the order of 10 minutes later.
This problems is completely repeatable, with the caveat that it only
happens *once* for every time I boot my machine. Even if I allow the
mount of my home directory to time out the problem will *not* occur
unless the system is re-booted.
My home directory is served by a NAC box version 4.2a.
I sniffed the wire as I logged into the XDM session and I see:
Frame Delta T Length Dir Dest Address Source Address
[lots deleted]
553 0.001 90 NA 192.32.68.39 192.32.61.8
554 0.000 182 NA 192.32.61.8 192.32.68.39
555 0.001 170 NA 192.32.68.39 192.32.61.8
556 0.000 166 NA 192.32.61.8 192.32.68.39
557 0.001 90 NA 192.32.68.39 192.32.61.8
558 0.655 849 NA 192.32.61.8 192.32.68.39
559 2.030 849 NA 192.32.61.8 192.32.68.39
560 4.050 885 NA 192.32.61.8 192.32.68.39
561 5.919 90 NA 192.32.72.6 192.32.68.39
562 0.004 90 NA 192.32.68.39 192.32.72.6
563 0.975 82 NA 192.32.61.8 192.32.68.39
And nothing much more happens until the mount wakes up. My workstation
is 192.32.68.39 and the server is 192.32.61.8. The problem
seems to begin with packets 558, 559, and 560. Full trace
available upon request. Details of these packets follow:
Frame 558 Date and Time: 04-Jan-99 00:05:43.606
Ethernet Header byte 0
Destination 00:00:a2:c3:39:74 48 bits
Bay Networks
Source 00:a0:24:97:82:2e 48 bits
Ethertype 0x800 16 bits
IP Header (Internet Protocol) byte 14
Version IP 4 bits
Header Length 5 32-bit words 4 bits
Precedence ROUTINE 3 bits
Type of Service NORMAL_SERVICE 4 bits
Unused 0 1 bits
Total Length 1120 bytes 16 bits
Identification 3589 16 bits
Flags, Unused 0 1 bits
Flags, DF bit MAY_FRAGMENT 1 bits
Flags, MF bit LAST_FRAGMENT 1 bits
Fragment Offset 0 * 8 octets 13 bits
Time To Live 64 seconds/hops 8 bits
Protocol UDP 8 bits
Checksum 0x6718 16 bits
Source Address 192.32.68.39 32 bits
Destination Address 192.32.61.8 32 bits
UDP Header byte 34
Source Port 0x34d 16 bits
Destination Port 0x801 16 bits
Length 1100 bytes 16 bits
Checksum 0xda23 16 bits
DATA byte 42
0: 176bdcd6 00000000 00000002 000186a3 .k..............
10: 00000002 00000008 00000001 00000034 ...............4
20: 00000000 00000000 00000b0c 00000014 ................
30: 00000008 00000014 00000000 00000038 ...............8
40: 0000008c 00000037 00000025 000000aa .......7...%....
50: 000000cc 00000000 00000000 4b1f1a00 ............K...
60: af2ed92b 00000000 5fdc0d00 cc058023 ...+...._......#
70: 00000000 01ae0500 9c280800 00000000 .........(......
80: 00000000 000003b8 000003b8 00000004 ................
90: c0204427 00013000 124d4954 2d4d4147 . D'..0..MIT-MAG
a0: 49432d43 4f4f4b49 452d3100 102c493e IC-COOKIE-1..,I>
b0: 582b6a2f 21280d77 191b183c 18010000 X+j/!(.w...<....
c0: 1d6b797a 796c2e65 6e676561 73742e62 .kyzyl.engeast.b
d0: 61796e65 74776f72 6b732e63 6f6d0001 aynetworks.com..
e0: 3000124d 49542d4d 41474943 2d434f4f 0..MIT-MAGIC-COO
f0: 4b49452d 3100102c 493e582b 6a2f2128 KIE-1..,I>X+j/!(
100: 0d77191b 183c1800 000004c0 20442600 .w...<...... D&.
110: 01300012 4d49542d 4d414749 432d434f .0..MIT-MAGIC-CO
120: 4f4b4945 2d310010 07397b42 622b2626 OKIE-1...9{Bb+&&
130: 5a03084c 31176e1a 0100001c 74757661 Z..L1.n.....tuva
140: 2e656e67 65617374 2e626179 6e657477 .engeast.baynetw
150: 6f726b73 2e636f6d 00013000 124d4954 orks.com..0..MIT
160: 2d4d4147 49432d43 4f4f4b49 452d3100 -MAGIC-COOKIE-1.
170: 1007397b 42622b26 265a0308 4c31176e ..9{Bb+&&Z..L1.n
180: 1a000000 04c0208a 7f000131 00124d49 ...... ....1..MI
190: 542d4d41 4749432d 434f4f4b 49452d31 T-MAGIC-COOKIE-1
1a0: 0010b6be 63a75d1a 03b0dbef b9d7c6ed ....c.].........
1b0: 5b5f0100 000a7373 682d7365 72766572 [_....ssh-server
1c0: 00013100 124d4954 2d4d4147 49432d43 ..1..MIT-MAGIC-C
1d0: 4f4f4b49 452d3100 10b6be63 a75d1a03 OOKIE-1....c.]..
1e0: b0dbefb9 d7c6ed5b 5f000000 04c0208a .......[_..... .
1f0: 7f000132 00124d49 542d4d41 4749432d ...2..MIT-MAGIC-
200: 434f4f4b 49452d31 00103574 88e4473e COOKIE-1..5t..G>
210: a48fcaad 49db7962 be870100 000a7373 ....I.yb......ss
220: 682d7365 72766572 00013200 124d4954 h-server..2..MIT
230: 2d4d4147 49432d43 4f4f4b49 452d3100 -MAGIC-COOKIE-1.
240: 10357488 e4473ea4 8fcaad49 db7962be .5t..G>....I.yb.
250: 87000000 04c02006 fb000130 00124d49 ...... ....0..MI
260: 542d4d41 4749432d 434f4f4b 49452d31 T-MAGIC-COOKIE-1
270: 00101e41 8142d1fb 8c099bc6 8edf3d35 ...A.B........=5
280: c4570100 00086465 6c6f7265 616e0001 .W....delorean..
290: 3000124d 49542d4d 41474943 2d434f4f 0..MIT-MAGIC-COO
2a0: 4b49452d 310010c7 61e4ada4 c7d59f4d KIE-1...a......M
2b0: 7fbee210 020ded00 000004c0 20066900 ............ .i.
2c0: 01300012 4d49542d 4d414749 432d434f .0..MIT-MAGIC-CO
2d0: 4f4b4945 2d310010 ca22b5ea 9a06aa85 OKIE-1..."......
2e0: 6f0aab8d 6dba92c0 01000005 726f6269 o...m.......robi
2f0: 6e000130 00124d49 542d4d41 4749432d n..0..MIT-MAGIC-
300: 434f4f4b 49452d31 00103458 53d66775 COOKIE-1..4XS.gu
310: 952a1b66 7c9f1a16 63d20000 0004c020 .*.f|...c......
320: 06910001 3000c0 ....0..
Frame 559 Date and Time: 04-Jan-99 00:05:45.636
Ethernet Header byte 0
Destination 00:00:a2:c3:39:74 48 bits
Bay Networks
Source 00:a0:24:97:82:2e 48 bits
Ethertype 0x800 16 bits
IP Header (Internet Protocol) byte 14
Version IP 4 bits
Header Length 5 32-bit words 4 bits
Precedence ROUTINE 3 bits
Type of Service NORMAL_SERVICE 4 bits
Unused 0 1 bits
Total Length 1120 bytes 16 bits
Identification 3590 16 bits
Flags, Unused 0 1 bits
Flags, DF bit MAY_FRAGMENT 1 bits
Flags, MF bit LAST_FRAGMENT 1 bits
Fragment Offset 0 * 8 octets 13 bits
Time To Live 64 seconds/hops 8 bits
Protocol UDP 8 bits
Checksum 0x6717 16 bits
Source Address 192.32.68.39 32 bits
Destination Address 192.32.61.8 32 bits
UDP Header byte 34
Source Port 0x34d 16 bits
Destination Port 0x801 16 bits
Length 1100 bytes 16 bits
Checksum 0xda23 16 bits
DATA byte 42
0: 176bdcd6 00000000 00000002 000186a3 .k..............
10: 00000002 00000008 00000001 00000034 ...............4
20: 00000000 00000000 00000b0c 00000014 ................
30: 00000008 00000014 00000000 00000038 ...............8
40: 0000008c 00000037 00000025 000000aa .......7...%....
50: 000000cc 00000000 00000000 4b1f1a00 ............K...
60: af2ed92b 00000000 5fdc0d00 cc058023 ...+...._......#
70: 00000000 01ae0500 9c280800 00000000 .........(......
80: 00000000 000003b8 000003b8 00000004 ................
90: c0204427 00013000 124d4954 2d4d4147 . D'..0..MIT-MAG
a0: 49432d43 4f4f4b49 452d3100 102c493e IC-COOKIE-1..,I>
b0: 582b6a2f 21280d77 191b183c 18010000 X+j/!(.w...<....
c0: 1d6b797a 796c2e65 6e676561 73742e62 .kyzyl.engeast.b
d0: 61796e65 74776f72 6b732e63 6f6d0001 aynetworks.com..
e0: 3000124d 49542d4d 41474943 2d434f4f 0..MIT-MAGIC-COO
f0: 4b49452d 3100102c 493e582b 6a2f2128 KIE-1..,I>X+j/!(
100: 0d77191b 183c1800 000004c0 20442600 .w...<...... D&.
110: 01300012 4d49542d 4d414749 432d434f .0..MIT-MAGIC-CO
120: 4f4b4945 2d310010 07397b42 622b2626 OKIE-1...9{Bb+&&
130: 5a03084c 31176e1a 0100001c 74757661 Z..L1.n.....tuva
140: 2e656e67 65617374 2e626179 6e657477 .engeast.baynetw
150: 6f726b73 2e636f6d 00013000 124d4954 orks.com..0..MIT
160: 2d4d4147 49432d43 4f4f4b49 452d3100 -MAGIC-COOKIE-1.
170: 1007397b 42622b26 265a0308 4c31176e ..9{Bb+&&Z..L1.n
180: 1a000000 04c0208a 7f000131 00124d49 ...... ....1..MI
190: 542d4d41 4749432d 434f4f4b 49452d31 T-MAGIC-COOKIE-1
1a0: 0010b6be 63a75d1a 03b0dbef b9d7c6ed ....c.].........
1b0: 5b5f0100 000a7373 682d7365 72766572 [_....ssh-server
1c0: 00013100 124d4954 2d4d4147 49432d43 ..1..MIT-MAGIC-C
1d0: 4f4f4b49 452d3100 10b6be63 a75d1a03 OOKIE-1....c.]..
1e0: b0dbefb9 d7c6ed5b 5f000000 04c0208a .......[_..... .
1f0: 7f000132 00124d49 542d4d41 4749432d ...2..MIT-MAGIC-
200: 434f4f4b 49452d31 00103574 88e4473e COOKIE-1..5t..G>
210: a48fcaad 49db7962 be870100 000a7373 ....I.yb......ss
220: 682d7365 72766572 00013200 124d4954 h-server..2..MIT
230: 2d4d4147 49432d43 4f4f4b49 452d3100 -MAGIC-COOKIE-1.
240: 10357488 e4473ea4 8fcaad49 db7962be .5t..G>....I.yb.
250: 87000000 04c02006 fb000130 00124d49 ...... ....0..MI
260: 542d4d41 4749432d 434f4f4b 49452d31 T-MAGIC-COOKIE-1
270: 00101e41 8142d1fb 8c099bc6 8edf3d35 ...A.B........=5
280: c4570100 00086465 6c6f7265 616e0001 .W....delorean..
290: 3000124d 49542d4d 41474943 2d434f4f 0..MIT-MAGIC-COO
2a0: 4b49452d 310010c7 61e4ada4 c7d59f4d KIE-1...a......M
2b0: 7fbee210 020ded00 000004c0 20066900 ............ .i.
2c0: 01300012 4d49542d 4d414749 432d434f .0..MIT-MAGIC-CO
2d0: 4f4b4945 2d310010 ca22b5ea 9a06aa85 OKIE-1..."......
2e0: 6f0aab8d 6dba92c0 01000005 726f6269 o...m.......robi
2f0: 6e000130 00124d49 542d4d41 4749432d n..0..MIT-MAGIC-
300: 434f4f4b 49452d31 00103458 53d66775 COOKIE-1..4XS.gu
310: 952a1b66 7c9f1a16 63d20000 0004c020 .*.f|...c......
320: 06910001 3000c0 ....0..
Frame 560 Date and Time: 04-Jan-99 00:05:49.686
Ethernet Header byte 0
Destination 00:00:a2:c3:39:74 48 bits
Bay Networks
Source 00:a0:24:97:82:2e 48 bits
Ethertype 0x800 16 bits
IP Header (Internet Protocol) byte 14
Version IP 4 bits
Header Length 5 32-bit words 4 bits
Precedence ROUTINE 3 bits
Type of Service NORMAL_SERVICE 4 bits
Unused 0 1 bits
Total Length 1120 bytes 16 bits
Identification 3591 16 bits
Flags, Unused 0 1 bits
Flags, DF bit MAY_FRAGMENT 1 bits
Flags, MF bit LAST_FRAGMENT 1 bits
Fragment Offset 0 * 8 octets 13 bits
Time To Live 64 seconds/hops 8 bits
Protocol UDP 8 bits
Checksum 0x6716 16 bits
Source Address 192.32.68.39 32 bits
Destination Address 192.32.61.8 32 bits
UDP Header byte 34
Source Port 0x34d 16 bits
Destination Port 0x801 16 bits
Length 1100 bytes 16 bits
Checksum 0xda23 16 bits
DATA byte 42
0: 176bdcd6 00000000 00000002 000186a3 .k..............
10: 00000002 00000008 00000001 00000034 ...............4
20: 00000000 00000000 00000b0c 00000014 ................
30: 00000008 00000014 00000000 00000038 ...............8
40: 0000008c 00000037 00000025 000000aa .......7...%....
50: 000000cc 00000000 00000000 4b1f1a00 ............K...
60: af2ed92b 00000000 5fdc0d00 cc058023 ...+...._......#
70: 00000000 01ae0500 9c280800 00000000 .........(......
80: 00000000 000003b8 000003b8 00000004 ................
90: c0204427 00013000 124d4954 2d4d4147 . D'..0..MIT-MAG
a0: 49432d43 4f4f4b49 452d3100 102c493e IC-COOKIE-1..,I>
b0: 582b6a2f 21280d77 191b183c 18010000 X+j/!(.w...<....
c0: 1d6b797a 796c2e65 6e676561 73742e62 .kyzyl.engeast.b
d0: 61796e65 74776f72 6b732e63 6f6d0001 aynetworks.com..
e0: 3000124d 49542d4d 41474943 2d434f4f 0..MIT-MAGIC-COO
f0: 4b49452d 3100102c 493e582b 6a2f2128 KIE-1..,I>X+j/!(
100: 0d77191b 183c1800 000004c0 20442600 .w...<...... D&.
110: 01300012 4d49542d 4d414749 432d434f .0..MIT-MAGIC-CO
120: 4f4b4945 2d310010 07397b42 622b2626 OKIE-1...9{Bb+&&
130: 5a03084c 31176e1a 0100001c 74757661 Z..L1.n.....tuva
140: 2e656e67 65617374 2e626179 6e657477 .engeast.baynetw
150: 6f726b73 2e636f6d 00013000 124d4954 orks.com..0..MIT
160: 2d4d4147 49432d43 4f4f4b49 452d3100 -MAGIC-COOKIE-1.
170: 1007397b 42622b26 265a0308 4c31176e ..9{Bb+&&Z..L1.n
180: 1a000000 04c0208a 7f000131 00124d49 ...... ....1..MI
190: 542d4d41 4749432d 434f4f4b 49452d31 T-MAGIC-COOKIE-1
1a0: 0010b6be 63a75d1a 03b0dbef b9d7c6ed ....c.].........
1b0: 5b5f0100 000a7373 682d7365 72766572 [_....ssh-server
1c0: 00013100 124d4954 2d4d4147 49432d43 ..1..MIT-MAGIC-C
1d0: 4f4f4b49 452d3100 10b6be63 a75d1a03 OOKIE-1....c.]..
1e0: b0dbefb9 d7c6ed5b 5f000000 04c0208a .......[_..... .
1f0: 7f000132 00124d49 542d4d41 4749432d ...2..MIT-MAGIC-
200: 434f4f4b 49452d31 00103574 88e4473e COOKIE-1..5t..G>
210: a48fcaad 49db7962 be870100 000a7373 ....I.yb......ss
220: 682d7365 72766572 00013200 124d4954 h-server..2..MIT
230: 2d4d4147 49432d43 4f4f4b49 452d3100 -MAGIC-COOKIE-1.
240: 10357488 e4473ea4 8fcaad49 db7962be .5t..G>....I.yb.
250: 87000000 04c02006 fb000130 00124d49 ...... ....0..MI
260: 542d4d41 4749432d 434f4f4b 49452d31 T-MAGIC-COOKIE-1
270: 00101e41 8142d1fb 8c099bc6 8edf3d35 ...A.B........=5
280: c4570100 00086465 6c6f7265 616e0001 .W....delorean..
290: 3000124d 49542d4d 41474943 2d434f4f 0..MIT-MAGIC-COO
2a0: 4b49452d 310010c7 61e4ada4 c7d59f4d KIE-1...a......M
2b0: 7fbee210 020ded00 000004c0 20066900 ............ .i.
2c0: 01300012 4d49542d 4d414749 432d434f .0..MIT-MAGIC-CO
2d0: 4f4b4945 2d310010 ca22b5ea 9a06aa85 OKIE-1..."......
2e0: 6f0aab8d 6dba92c0 01000005 726f6269 o...m.......robi
2f0: 6e000130 00124d49 542d4d41 4749432d n..0..MIT-MAGIC-
300: 434f4f4b 49452d31 00103458 53d66775 COOKIE-1..4XS.gu
310: 952a1b66 7c9f1a16 63d20000 0004c020 .*.f|...c......
320: 06910001 3000124d 49542d4d 41474943 ....0..MIT-MAGIC
330: 2d434f4f 4b49452d 3100109f 8c5f2a51 -COOKIE-1...._*Q
340: 1dc293c8 e111e018 4893cf ........H..
Frame 563 Date and Time: 04-Jan-99 00:05:56.586
Ethernet Header byte 0
Destination 00:00:a2:c3:39:74 48 bits
Bay Networks
Source 00:a0:24:97:82:2e 48 bits
Ethertype 0x800 16 bits
IP Header (Internet Protocol) byte 14
Version IP 4 bits
Header Length 5 32-bit words 4 bits
Precedence ROUTINE 3 bits
Type of Service NORMAL_SERVICE 4 bits
Unused 0 1 bits
Total Length 68 bytes 16 bits
Identification 3593 16 bits
Flags, Unused 0 1 bits
Flags, DF bit MAY_FRAGMENT 1 bits
Flags, MF bit LAST_FRAGMENT 1 bits
Fragment Offset 0 * 8 octets 13 bits
Time To Live 64 seconds/hops 8 bits
Protocol UDP 8 bits
Checksum 0x6b30 16 bits
Source Address 192.32.68.39 32 bits
Destination Address 192.32.61.8 32 bits
UDP Header byte 34
Source Port SUNRPC 16 bits
Destination Port 0x801 16 bits
Length 48 bytes 16 bits
Checksum 0xe972 16 bits
SUNRPC_HDR byte 42
Transfer Id 0x82040000 32 bits
Type CALL 32 bits
SUNRPC_CALL byte 50
RPC Version VERS_2 32 bits
Program NFS 32 bits
Version 2 32 bits
Procedure 0 32 bits
Flavor NONE 32 bits
Length 0 bytes 32 bits
Flavor NONE 32 bits
Length 0 bytes 32 bits
--
Robert Withrow -- (+1 978 916 8256)
BWithrow@BayNetworks.com
To Unsubscribe: send mail to majordomo@FreeBSD.org
with "unsubscribe freebsd-hackers" in the body of the message
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?199901052143.VAA15097>