From owner-freebsd-stable@FreeBSD.ORG Tue Mar 20 13:41:01 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id ECBE71065670; Tue, 20 Mar 2012 13:41:01 +0000 (UTC) (envelope-from matt.thyer@gmail.com) Received: from mail-we0-f182.google.com (mail-we0-f182.google.com [74.125.82.182]) by mx1.freebsd.org (Postfix) with ESMTP id 262CA8FC12; Tue, 20 Mar 2012 13:41:00 +0000 (UTC) Received: by wern13 with SMTP id n13so49585wer.13 for ; Tue, 20 Mar 2012 06:41:00 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=qVj2otUfIv30ezJAg4kqne3mBr+8w8sVdupLomiAXg0=; b=nIGbEyft5fPFPVX+mXLNX2S32hs+5amIPS/azhy7d80rLpFxLwJu13VzCoQ5pkRUGa HAJHhX9STyNP5yRCc8N1/088SZ8/efYnM8hsvXjiIvFmP2ZgTF7Mw3QptNoJvhJ+Doo7 IgV+YhQaOPwLwHL/O5gaLqj0EWx6mb4VnDVmW4NTlUBjG+mzCH0752zSWXqyTn8wFEm5 ZIo4mCds6tBrKpGn2XLrpJFNjFTJ+0+idcDYTBCTIw9f6mO9zYnTvTEFvfpuojqwAX1A DT46jIH2sxetv2vkric4PHAtqB3cgbMKkonCEujs1nMy5CHTCcW1JJsgMemEjeo1Id9w i6fg== MIME-Version: 1.0 Received: by 10.180.107.162 with SMTP id hd2mr28916823wib.8.1332250860133; Tue, 20 Mar 2012 06:41:00 -0700 (PDT) Received: by 10.216.229.10 with HTTP; Tue, 20 Mar 2012 06:41:00 -0700 (PDT) In-Reply-To: <20120320133306.GA5044@in-addr.com> References: <20120320133306.GA5044@in-addr.com> Date: Wed, 21 Mar 2012 00:11:00 +1030 Message-ID: From: Matt Thyer To: Gary Palmer Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-stable@freebsd.org, Ivan Voras Subject: Re: 157k interrupts per second causing 60% CPU load on idle system X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Mar 2012 13:41:02 -0000 On 21 March 2012 00:03, Gary Palmer wrote: > On Tue, Mar 20, 2012 at 11:10:10PM +1030, Matt Thyer wrote: > > On 20 March 2012 22:24, Ivan Voras wrote: > > > > > On 20 March 2012 12:52, Matt Thyer wrote: > > > > On 20 March 2012 21:12, Ivan Voras wrote: > > > >> > > > >> On 20/03/2012 06:26, Matt Thyer wrote: > > > >> > I've upgraded my FreeBSD-STABLE NAS from r225723 (22nd Sept 2011) > to > > > >> > r232477 (4th Mar 2012) and am finding that a system process called > > > >> > "intr" > > > >> > is now constantly using about 60% of 1 CPU starting a short time > after > > > >> > reboot (possibly triggered by use of the samba server). > > > >> > > > > >> > When this starts, systat -vm 1 says that the system is 85% idle > and > > > 14% > > > >> > interrupt handling. > > > >> > It says that there's around 157k interrupts per second. > > > >> > > > > >> > > > >> Ok, but *which* interrupt is getting triggered? Please send the > output > > > >> of "vmstat -i". > > > >> > > > >> > > > > interrupt total rate > > > > irq16: uhci0+ 3392184862 126692 > > > > > > Ok, something's probably wrong with USB. Can you disable it in BIOS? > > > > > > > > > > cpu0: timer 53549677 1999 > > > > irq256: mps0 2643187 98 > > > > irq257: re0 5508108 205 > > > > irq258: ahci0 160717 6 > > > > cpu1: timer 53525300 1999 > > > > cpu2: timer 53525300 1999 > > > > cpu3: timer 53525296 1999 > > > > Total 3614622447 134999 > > > > > > > > > > > I did just update the BIOS at about the same time so the difference may > be > > due to that change. > > > > I'll try a few things such as: > > > > - Unplugging any USB things (I've only got a keyboard plugged in). > > - Downgrade BIOS. > > > > I'll get back to you all soon. > > It would be interesting to know if there are other devices on irq16 also. > > grep 'irq 16' /var/run/dmesg.boot > > I think the '+' on the irq16 line from vmstat means the interrupt is > shared, but the man page doesn't mention it so I'm not 100% sure > > Thanks, > > Gary > Good point... pcib1: irq 16 at device 1.0 on pci0 mps0: port 0xee00-0xeeff mem 0xfbdfc000-0xfbdfffff,0xfbd80000-0xfbdbffff irq 16 at device 0.0 on pci1 vgapci0: port 0xff00-0xff07 mem 0xfb400000-0xfb7fffff,0xe0000000-0xefffffff irq 16 at device 2.0 on pci0 uhci0: port 0xfe00-0xfe1f irq 16 at device 26.0 on pci0 pcib2: irq 16 at device 28.0 on pci0 pcib3: irq 16 at device 28.4 on pci0 atapci0: port 0xdf00-0xdf07,0xde00-0xde03,0xdd00-0xdd07,0xdc00-0xdc03,0xdb00-0xdb0f irq 16 at device 0.0 on pci3 I'd suspect the SAS/SATA HBA using the mps0 driver as that's where I have the raidz2 on 8 drives. Is this still the old driver or has the new LSI authored driver been added to -STABLE yet ?