From owner-freebsd-hackers@FreeBSD.ORG Sat Feb 28 18:21:51 2004 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D482D16A4CE for ; Sat, 28 Feb 2004 18:21:51 -0800 (PST) Received: from aries.ai.net (aries.ai.net [205.134.163.4]) by mx1.FreeBSD.org (Postfix) with ESMTP id 69E9343D31 for ; Sat, 28 Feb 2004 18:21:51 -0800 (PST) (envelope-from deepak@ai.net) Received: from ai.net (mikej@pool-151-200-114-38.res.east.verizon.net [151.200.114.38]) by aries.ai.net (8.9.3/8.9.3) with ESMTP id VAA11847; Sat, 28 Feb 2004 21:21:50 -0500 (EST) (envelope-from deepak@ai.net) Message-ID: <40414CBC.20001@ai.net> Date: Sat, 28 Feb 2004 21:21:48 -0500 From: Deepak Jain User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.6) Gecko/20040113 X-Accept-Language: en-us, en MIME-Version: 1.0 To: Deepak Jain References: <40414823.9040507@ai.net> In-Reply-To: <40414823.9040507@ai.net> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit cc: freebsd-hackers@freebsd.org Subject: Re: em0, polling performance, P4 2.8ghz FSB 800mhz X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 Feb 2004 02:21:52 -0000 It was kindly pointed out that I didn't including the symptoms of the problem: Without polling on, I get 70+% interrupt load, and I get live lock. With polling on, I start getting huge amounts of input errors, packet loss, and general unresponsiveness to the network. The web server on it doesn't respond though it occassionally will open the connection, just not respond. accept_filter on/off makes no difference. I have read other posts that say em systems can more >200kpps without serious incident. Thanks in advance, DJ Deepak Jain wrote: > > I have a machine running 4.9. P4 2.8Ghz, 800mhz bus, Intel PRO/1000 > ethernet connected to a Cisco, both sides are locked to 1000/FD. > > The kernel has HZ=1000, and DEVICE_POLLING, IPFW, DUMMYNET, etc. After > only a few minutes of run time under an attack ~90,000 pps. The attack > has been limited at the router to JUST incoming TCP port 80 inbound > traffic. I don't know why the machine is having such a hard time under > the load. The cpu shows it is >90% idle even under the worst of the > attack. What am I doing wrong? > > Thanks, > > DJ > > #sysctl -a |grep hz > kern.clockrate: { hz = 1000, tick = 1000, tickadj = 1, profhz = 1024, > stathz = 1 > 28 } > #sysctl -a |grep polling > kern.polling.burst: 544 > kern.polling.each_burst: 30 > kern.polling.burst_max: 550 > kern.polling.idle_poll: 1 > kern.polling.poll_in_trap: 0 > kern.polling.user_frac: 50 > kern.polling.reg_frac: 30 > kern.polling.short_ticks: 44151 > kern.polling.lost_polls: 84925 > kern.polling.pending_polls: 0 > kern.polling.residual_burst: 0 > kern.polling.handlers: 1 > kern.polling.enable: 1 > kern.polling.phase: 0 > kern.polling.suspect: 39272 > kern.polling.stalled: 5 > > > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 > The Regents of the University of California. All rights reserved. > FreeBSD 4.9-RELEASE #8: Sat Feb 28 23:42:41 GMT 2004 > > Timecounter "i8254" frequency 1193182 Hz > CPU: Intel(R) Pentium(R) 4 CPU 2.80GHz (2806.38-MHz 686-class CPU) > Origin = "GenuineIntel" Id = 0xf29 Stepping = 9 > > Features=0xbfebfbff > MOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> > Hyperthreading: 2 logical CPUs > real memory = 2147418112 (2097088K bytes) > avail memory = 2085978112 (2037088K bytes) > Preloaded elf kernel "kernel" at 0xc04fa000. > Warning: Pentium 4 CPU: PSE disabled > Pentium Pro MTRR support enabled > md0: Malloc disk > Using $PIR table, 12 entries at 0xc00fdea0 > npx0: on motherboard > npx0: INT 16 interface > pcib0: on motherboard > pci0: on pcib0 > pcib1: at device 1.0 on pci0 > pci1: on pcib1 > pcib2: at device 3.0 on pci0 > pci2: on pcib2 > em0: port > 0xb000-0xb01f > mem 0xf3000000-0xf301ffff irq 12 at device 1.0 on pci2 > em0: Speed:N/A Duplex:N/A > uhci0: port 0xcc00-0xcc1f > irq 11 at > device 29.0 on pci0 > usb0: on uhci0 > usb0: USB revision 1.0 > uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 > uhub0: 2 ports with 2 removable, self powered > uhci1: port 0xc000-0xc01f > irq 3 at d > evice 29.1 on pci0 > usb1: on uhci1 > usb1: USB revision 1.0 > uhub1: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 > uhub1: 2 ports with 2 removable, self powered > uhci2: port 0xc400-0xc41f > irq 12 at > device 29.2 on pci0 > usb2: on uhci2 > usb2: USB revision 1.0 > uhub2: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 > uhub2: 2 ports with 2 removable, self powered > uhci3: port 0xc800-0xc81f > irq 11 at > device 29.3 on pci0 > usb3: on uhci3 > usb3: USB revision 1.0 > uhub3: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 > uhub3: 2 ports with 2 removable, self powered > pci0: at 29.7 irq 7 > pcib3: at device 30.0 on pci0 > pci3: on pcib3 > ahd0: port > 0x9400-0x94ff,0x9000-0x90ff m > em 0xf2020000-0xf2021fff irq 11 at device 0.0 on pci3 > aic7901A: Ultra320 Wide Channel A, SCSI Id=7, PCI 33 or 66Mhz, 512 SCBs > pci3: (vendor=0x105a, dev=0x3373) at 3.0 irq 10 > pci3: at 7.0 irq 11 > pci3: (vendor=0x8086, dev=0x1051) at 8.0 irq 5 > isab0: at device 31.0 on pci0 > isa0: on isab0 > atapci0: port > 0xf000-0xf00f,0-0x3,0-0x7,0-0x3,0-0 > x7 irq 0 at device 31.1 on pci0 > ata0: at 0x1f0 irq 14 on atapci0 > ata1: at 0x170 irq 15 on atapci0 > pci0: (vendor=0x8086, dev=0x24d3) at 31.3 irq 9 > orm0: