From owner-freebsd-stable@FreeBSD.ORG Fri Oct 13 01:35:31 2006 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A389816A403 for ; Fri, 13 Oct 2006 01:35:31 +0000 (UTC) (envelope-from sullrich@gmail.com) Received: from ug-out-1314.google.com (ug-out-1314.google.com [66.249.92.170]) by mx1.FreeBSD.org (Postfix) with ESMTP id A839943D67 for ; Fri, 13 Oct 2006 01:35:25 +0000 (GMT) (envelope-from sullrich@gmail.com) Received: by ug-out-1314.google.com with SMTP id m2so357581uge for ; Thu, 12 Oct 2006 18:35:24 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=RuLY83ytK5ZvCY6thVjCmEO5vQ5SeFiJTsdzrrGYxxsQyjRi5oLX9oAfkGgzCoTQZ9CPdlUkSa9zPTLOoVb0tU0BKJJYMb9bgpQ6p8f0nxe6BUGxv+EwF0wcuMo3QfhPmS3fBfkV3+rhFwNGUrod8jVX2SXgELzdS3v1DCDJzE0= Received: by 10.66.220.17 with SMTP id s17mr3606099ugg; Thu, 12 Oct 2006 18:35:24 -0700 (PDT) Received: by 10.67.28.14 with HTTP; Thu, 12 Oct 2006 18:35:23 -0700 (PDT) Message-ID: Date: Thu, 12 Oct 2006 21:35:23 -0400 From: "Scott Ullrich" To: "Chuck Swiger" In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline References: Cc: freebsd-stable Subject: Re: Userland freezes during heavy packet forwarding workloads X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Oct 2006 01:35:31 -0000 On 10/12/06, Chuck Swiger wrote: > On Oct 12, 2006, at 2:11 PM, Scott Ullrich wrote: > > We (pfSense developers) have noticed an interesting problem where > > userland stops functioning under high packet forwarding workloads. > > Userland applications such as sshd and lighttpd freeze but userland > > resumes after the network load eases. > > [ ...note that the links you posted included the trailing square > bracket, > and thus were broken, although easily fixable by hand... ] Yes, this is to prevent breakage of the URLs in many common mailers. > > Is there anything we can do to prevent userland from stopping > > completely when under heavy load? Is this a bug? > > You're probably experiencing some form of "livelock"; your hardware > isn't horribly fast, and if the NICs are generating interrupts > rapidly enough due to the high rate of packet forwarding, you're not > going to have a lot of spare CPU available to run userland tasks. > > I notice you're compiling in support for DEVICE_POLLING; does > enabling it do anything to help the responsiveness of the userland > tasks under high network load? You might try adjusting HZ from 100 > to 250 or so...I found that made a decent tradeoff between packet > delay and scheduler overhead on similar Soerkis 4801 or VIA C3/EPIA-M > hardware to yours. We are not interested in polling, it is not the answer to the problem at hand. 4.X does not require polling to keep userland available during these workloads. Why should 6.X require this? I understand where you are going with this but we are somewhat interested in helping get FreeBSD back on track, not to introduce workarounds. Thanks for your response. Scott