From owner-freebsd-stable@FreeBSD.ORG Fri Aug 13 20:36:14 2010 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 96FD8106566B for ; Fri, 13 Aug 2010 20:36:14 +0000 (UTC) (envelope-from healer@rpi.edu) Received: from smtp6.server.rpi.edu (smtp6.server.rpi.edu [128.113.2.226]) by mx1.freebsd.org (Postfix) with ESMTP id 5E8938FC0C for ; Fri, 13 Aug 2010 20:36:13 +0000 (UTC) Received: from [128.113.12.172] (cimr-15.dynamic2.rpi.edu [128.113.12.172]) (authenticated bits=0) by smtp6.server.rpi.edu (8.13.1/8.13.1) with ESMTP id o7DJLr7f031033 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Fri, 13 Aug 2010 15:21:53 -0400 Message-ID: <4C659B4C.50207@rpi.edu> Date: Fri, 13 Aug 2010 15:21:48 -0400 From: Robert Healey User-Agent: Thunderbird 2.0.0.24 (Windows/20100228) MIME-Version: 1.0 To: freebsd-stable@freebsd.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Bayes-Prob: 0.0001 (Score 0) X-RPI-SA-Score: 0.00 () [Hold at 15.00] 22490(-25) X-CanItPRO-Stream: outgoing X-Canit-Stats-ID: Bayes signature not available X-Scanned-By: CanIt (www . roaringpenguin . com) on 128.113.2.226 Subject: Problem with mxge on RELENG_8_1 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Aug 2010 20:36:14 -0000 Hello. I recently updated the central file server/router systems for a pair of research clusters from RELENG_8_0 to RELENG_8_1. After following the proper procedures, the network throughput when pulling files from both machines via mxge0 is 200KB/s or less. Before the update, 50MB/s was the normal rate. Doing some testing, with the 8.1 kernel booted, I can upload files to the server over the 10G link with scp or NFS at the expected rates. I can fetch files from the Internet using this server as the NAT gateway also at the expected rates. Retrieving files from the server over mxge, the throughput falls to 200KB/s. Retrieving files from the server from the onboard Broadcom NIC, rates are as to be expected from gigabit. With 8.0, everything works as expected. Hardware Config 1: Dell Poweredge R610 with 2 Xeon E5530 @ 2.4 GHz, hyperthreading disabled and 24GB RAM. Onboard interface is bce. Disk is attached via a PERC 6/E. Internal cluster switch is Dell Powerconnect 6248P. This switch sees excessive large packets on the 10G connection on 8.1, but not 8.0. Hardware Config 2: HP Proliant DL 320G6 with 1 Xeon E5540 @ 2.53GHz, hyperthreading enabled and 8GB RAM. Onboard interface is bge. Disk is attached via a HP Smart Array P212. Internal cluster switch is an HP Procurve 2910al. It does not see any packet errors from the 10G link. If anyone could point me in the general direction of a solution, I would be very appreciative. Thank you. -- Bob Healey Systems Administrator Biocomputation and Bioinformatics Constellation and Molecularium healer@rpi.edu (518) 276-4407