From owner-freebsd-current Thu Nov 7 22:36:08 1996 Return-Path: owner-current Received: (from root@localhost) by freefall.freebsd.org (8.7.5/8.7.3) id WAA11363 for current-outgoing; Thu, 7 Nov 1996 22:36:08 -0800 (PST) Received: from who.cdrom.com (who.cdrom.com [204.216.27.3]) by freefall.freebsd.org (8.7.5/8.7.3) with ESMTP id WAA11346 for ; Thu, 7 Nov 1996 22:36:04 -0800 (PST) Received: from rover.village.org (rover.village.org [204.144.255.49]) by who.cdrom.com (8.7.5/8.6.11) with SMTP id VAA20351 for ; Thu, 7 Nov 1996 21:38:49 -0800 (PST) Received: from rover.village.org [127.0.0.1] by rover.village.org with esmtp (Exim 0.56 #1) id E0vLjeQ-0006es-00; Thu, 7 Nov 1996 22:38:46 -0700 To: current@freebsd.org Subject: Strange hang in Nov 3 kernel Date: Thu, 07 Nov 1996 22:38:46 -0700 From: Warner Losh Message-Id: Sender: owner-current@freebsd.org X-Loop: FreeBSD.org Precedence: bulk I had a strange hang with a Nov 3 -current kernel: FreeBSD rover.village.org 3.0-CURRENT FreeBSD 3.0-CURRENT #0: Sun Nov 3 17:02:05 MST 1996 imp@rover.village.org:/jaz/FreeBSD/current/src/sys/compile/ROVER i386 Unfortunately, this happened while I was at work, and my wife needed the machine rebooted to do some work for the SCA, so I couldn't look into it. This machine is basically a two user machine. I use the color console head in X running X Inside's server for my #9GXE. My wife uses an X terminal for email. We get about 300-500 email messages a day between the two of us. At the time, about four copies of emacs were running (two for my wife, one for me at work (via ssh) and one for the console. There were about 5 xterms on the various displays, an xclock and maybe two or three sshds running. I have a vmstat -s ; vmstat -m record from every 10 minutes leading up to the crash, if that would help. I didn't see anything odd, but I thought I'd offer the data. This hang happened on Nov 5, so the machine had been up at most two days. The strange thing was that the hang happened at 10:22 (the last time my emacs window updated), but the stats are there right up until I had her reboot at 10:45ish (the 10:20, 10:30 and 10:40 stats are all there). There were no network interruptions that were detectible during this time, and traffic to other machines on the net in my basement from my office was still happening. No hardware changes recently on this machine. Warner P.S. Here's the diff between 10:20 and 10:30 for date ; vmstat -s ; vmstat -m run at those times. --- - Thu Nov 7 22:35:49 1996 +++ /tmp/stats9611051030.25579 Thu Nov 7 22:35:49 1996 @@ -1,11 +1,11 @@ -Tue Nov 5 10:20:00 MST 1996 - 623386 cpu context switches - 19753275 device interrupts - 452741 software interrupts - 557798 traps - 5825304 system calls - 299 swap pager pageins - 770 swap pager pages paged in +Tue Nov 5 10:30:00 MST 1996 + 624833 cpu context switches + 19890950 device interrupts + 453813 software interrupts + 560336 traps + 5833800 system calls + 300 swap pager pageins + 771 swap pager pages paged in 1078 swap pager pageouts 3111 swap pager pages paged out 2708 vnode pager pageins @@ -15,31 +15,31 @@ 148 page daemon wakeups 391891 pages examined by the page daemon 7010 pages reactivated - 201744 copy-on-write faults - 177052 zero fill pages zeroed + 202985 copy-on-write faults + 177918 zero fill pages zeroed 7 intransit blocking page faults - 514954 total VM faults taken - 465804 pages freed + 517489 total VM faults taken + 468371 pages freed 94 pages freed by daemon - 315721 pages freed by exiting processes - 3637 pages active - 808 pages inactive + 317524 pages freed by exiting processes + 3640 pages active + 804 pages inactive 907 pages in VM cache - 2167 pages wired down - 245 pages free + 2166 pages wired down + 247 pages free 4096 bytes per page - 899278 total name lookups + 901901 total name lookups cache hits (62% pos + 1% neg) system 7% per-directory deletions 1%, falsehits 5%, toolong 0% Memory statistics by bucket size Size In Use Free Requests HighWater Couldfree 16 46 466 1298 1280 0 - 32 141 115 12075 640 0 - 64 2945 63 101124 320 0 - 128 5615 81 202559 160 249 - 256 2706 46 222976 80 0 - 512 80 48 9185 40 308 - 1K 65 191 442693 20 51038 + 32 142 114 12146 640 0 + 64 2946 62 101543 320 0 + 128 5622 74 203806 160 249 + 256 2709 43 223174 80 0 + 512 81 47 9244 40 308 + 1K 64 192 443526 20 51862 2K 43 95 1478 10 690 4K 10 1 83 5 0 8K 4 1 227 5 0 @@ -68,40 +68,40 @@ Type InUse MemUse HighUse Limit Requests Limit Limit Size(s) mbuf 1 1K 1K 18636K 1 0 0 1K devbuf 45 110K 110K 18636K 114 0 0 16,32,256,512,1K,2K,4K,16K - socket 48 12K 14K 18636K 2412 0 0 256 - pcb 47 9K 11K 18636K 3929 0 0 16,32,128,256,512 + socket 48 12K 14K 18636K 2424 0 0 256 + pcb 47 9K 11K 18636K 3953 0 0 16,32,128,256,512 routetbl 41 5K 6K 18636K 145 0 0 16,32,64,128,256 - zombie 0 0K 1K 18636K 8965 0 0 128 + zombie 0 0K 1K 18636K 9023 0 0 128 ifaddr 8 1K 1K 18636K 8 0 0 64,128 - namei 1 1K 5K 18636K 426238 0 0 1K + namei 0 0K 5K 18636K 427071 0 0 1K ioctlops 0 0K 1K 18636K 6 0 0 512 - cred 26 4K 4K 18636K 1962 0 0 128 - pgrp 28 1K 1K 18636K 2233 0 0 32 - session 19 1K 1K 18636K 521 0 0 32 + cred 26 4K 4K 18636K 1975 0 0 128 + pgrp 28 1K 1K 18636K 2242 0 0 32 + session 19 1K 1K 18636K 524 0 0 32 mount 7 4K 4K 18636K 7 0 0 512 vnodes 2555 318K 318K 18636K 3568 0 0 16,128,256 namecache 2511 165K 165K 18636K 2511 0 0 64,8K UFS quota 1 8K 8K 18636K 1 0 0 8K UFS mount 19 33K 33K 18636K 19 0 0 512,1K,2K,8K - VM map 54 13K 19K 18636K 9019 0 0 128,256 + VM map 55 13K 19K 18636K 9078 0 0 128,256 VM mapent 75 5K 5K 18636K 75 0 0 64 - VM object 2419 303K 312K 18636K 176624 0 0 128 + VM object 2425 304K 312K 18636K 177729 0 0 128 VM pgdata 371 58K 58K 18636K 462 0 0 64,128,256,512,1K,2K,4K,8K - file 107 7K 10K 18636K 91468 0 0 64 - file desc 45 6K 9K 18636K 9014 0 0 128,256 - lockf 3 1K 1K 18636K 6752 0 0 64 - proc 52 24K 36K 18636K 9256 0 0 16,64,256,512 - subproc 49 3K 4K 18636K 9633 0 0 32,256 - FFS node 2479 620K 628K 18636K 199901 0 0 256 + file 108 7K 10K 18636K 91827 0 0 64 + file desc 46 6K 9K 18636K 9073 0 0 128,256 + lockf 3 1K 1K 18636K 6812 0 0 64 + proc 53 24K 36K 18636K 9315 0 0 16,64,256,512 + subproc 50 3K 4K 18636K 9698 0 0 32,256 + FFS node 2479 620K 628K 18636K 199952 0 0 256 ip_moptions 0 0K 1K 18636K 2 0 0 128 in_multi 2 1K 1K 18636K 2 0 0 64 ether_multi 1 1K 1K 18636K 1 0 0 32 MSDOSFS mount 1 4K 4K 18636K 1 0 0 4K - temp 61 9K 22K 18636K 8958 0 0 16,32,64,128,256,512,1K,4K,8K + temp 63 10K 22K 18636K 9010 0 0 16,32,64,128,256,512,1K,4K,8K ttys 482 66K 66K 18636K 1028 0 0 128,2K sysctl 0 0K 1K 18636K 2 0 0 32 BIO buffer 79 106K 245K 18636K 17771 0 0 512,1K,2K - select 22 6K 6K 18636K 1093 0 0 256 + select 22 6K 6K 18636K 1099 0 0 256 Memory Totals: In Use Free Requests - 1895K 454K 993702 + 1896K 453K 996529