From owner-freebsd-net@FreeBSD.ORG Tue May 21 14:54:11 2013 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id B1AD7A97 for ; Tue, 21 May 2013 14:54:11 +0000 (UTC) (envelope-from barney_cordoba@yahoo.com) Received: from nm30-vm4.bullet.mail.ne1.yahoo.com (nm30-vm4.bullet.mail.ne1.yahoo.com [98.138.91.190]) by mx1.freebsd.org (Postfix) with ESMTP id 7189B829 for ; Tue, 21 May 2013 14:54:11 +0000 (UTC) Received: from [98.138.90.55] by nm30.bullet.mail.ne1.yahoo.com with NNFMP; 21 May 2013 14:52:24 -0000 Received: from [98.138.89.175] by tm8.bullet.mail.ne1.yahoo.com with NNFMP; 21 May 2013 14:52:24 -0000 Received: from [127.0.0.1] by omp1031.mail.ne1.yahoo.com with NNFMP; 21 May 2013 14:52:24 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 441181.86690.bm@omp1031.mail.ne1.yahoo.com Received: (qmail 31454 invoked by uid 60001); 21 May 2013 14:52:24 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1369147944; bh=ggNK0FpIVCfgkC0LtOhOv9a454KxDS9hq2lj9ZB17Fc=; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:Message-ID:Date:From:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=oFGJ5KzqBUgKCMlWoaM3zMNbvVi0cnBmHrq3hDENxSIoR9FGkWbcN3D/+ZUi1pjnScKsnoCwWhu1hVi1Dt2b9+BdDRLg+ytR7zXMhOVFkyq8Of8vqn/GhVdCrkaGvk2xQ05iKNPRrME+S448sbL6A9urJrL3EAUjQbe/oTxPn1g= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:Message-ID:Date:From:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=wvIqEyNNQS0r7iwJDUtypO4tSP7zCCIpd++rdWpAY6ljXs1dLvRhHCXHbH3uyY5hfckgnfeyZ5jHxgeWKEPLJ7qGHh+TN6PMT/OCM16I8/swemagOcJc74Rajw8NhumdrG9PdsufUDBX9MF5i2WoS9uSX17/vX4ZQc8nNYOXp84=; X-YMail-OSG: NdwprkEVM1mzG9UFn57t2MztH09r8niG8oCtpkQ80JM9IXz Flx5j1e81Ha2qNZ2daALOkp1ww_Mbpvu4z0RIGwP_eTbqWzKLuHzK.dF4QFX vK1m7Js_Njyx27rBRJqeWWAk_u9lthhYGXhcyiE34rcSD6__4rkWJ47DiXvi SaujORE_LSP9KV.U4R8Hv19bHTVETeqNO4OqqE7bA7v0Bi8x5DL3A6UBUe55 3wVdj1hO81gG9Sef7RXEP6jpcOYgCV4LU9qCBgYLPDpDFtAWH_JraiOuoT63 GvV.W5WOtb4OTTFmSxHxzzBKmbe36ytRmP6S7Ua1zjFbABct6vL1lPJL9t4M F1TCgqrF3oWZvlZC0XHbQ549zhlrG3gVSfi5XPEh3RLv7MsMV.plu1tNiUjD cXJjRFQvLZA4E_YGcrc9RaM9Aa_WVT3zcSvdiVTKRTZmUx33otZeaciXL2hp vP6Vy_v6ZuH71IO.3a2UX9Fw6ubQNUtGdO7be3ZygLczxepgiVRJFDbsMM3k GmGq1oC2.sYRDLFDweqrK0MId9dfrfd9lb1IrJpo2FzSYlQi_EOeglLYOwVi ECdwLdKbcFhug.zIkIthzgutRWQXJBOI- Received: from [98.203.118.124] by web121606.mail.ne1.yahoo.com via HTTP; Tue, 21 May 2013 07:52:24 PDT X-Rocket-MIMEInfo: 002.001, CgotLS0gT24gVHVlLCA1LzIxLzEzLCBMdWlnaSBSaXp6byA8cml6em9AaWV0LnVuaXBpLml0PiB3cm90ZToKCj4gRnJvbTogTHVpZ2kgUml6em8gPHJpenpvQGlldC51bmlwaS5pdD4KPiBTdWJqZWN0OiBSZTogbmV0bWFwIGJyaWRnZSBjYW4gdHJhbm1pdCBiaWcgcGFja2V0IGluIGxpbmUgcmF0ZSA_Cj4gVG86ICJIb29tYW4gRmF6YWVsaSIgPGhvb21hbmZhemFlbGlAZ21haWwuY29tPgo.IENjOiBmcmVlYnNkLW5ldEBmcmVlYnNkLm9yZwo.IERhdGU6IFR1ZXNkYXksIE1heSAyMSwgMjAxMywgMTA6MzkgQU0BMAEBAQE- X-Mailer: YahooMailClassic/15.1.8 YahooMailWebService/0.8.142.542 Message-ID: <1369147944.27968.YahooMailClassic@web121606.mail.ne1.yahoo.com> Date: Tue, 21 May 2013 07:52:24 -0700 (PDT) From: Barney Cordoba Subject: Re: netmap bridge can tranmit big packet in line rate ? To: Hooman Fazaeli , Luigi Rizzo In-Reply-To: <20130521143906.GA80993@onelab2.iet.unipi.it> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable Cc: freebsd-net@freebsd.org X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 May 2013 14:54:11 -0000 =0A=0A--- On Tue, 5/21/13, Luigi Rizzo wrote:=0A=0A> F= rom: Luigi Rizzo =0A> Subject: Re: netmap bridge can tr= anmit big packet in line rate ?=0A> To: "Hooman Fazaeli" =0A> Cc: freebsd-net@freebsd.org=0A> Date: Tuesday, May 21, 2013, 10= :39 AM=0A> On Tue, May 21, 2013 at 06:51:12PM=0A> +0430, Hooman Fazaeli wro= te:=0A> > On 5/21/2013 5:10 PM, Barney Cordoba wrote:=0A> > >=0A> > > --- O= n Tue, 5/21/13, liujie =0A> wrote:=0A> > >=0A> > >> From: l= iujie =0A> > >> Subject: Re: netmap bridge can tranmit big= =0A> packet in line rate ?=0A> > >> To: freebsd-net@freebsd.org=0A> > >> Da= te: Tuesday, May 21, 2013, 5:25 AM=0A> > >> Hi, Prof.Luigi RIZZO=0A> > >>= =A0 =A0 =0A> > >>=A0 Firstly i should thank you for netmap. I=0A> tried to = send a=0A> > >> e-mail to you=0A> > >> yestoday, but it was rejected.=0A> >= >>=0A> > >>=A0 I used two machines to test netmap=0A> bridge. all with i7-= 2600=0A> > >> cpu and intel=0A> > >> 82599 dual-interfaces card.=0A> > >>= =0A> > >>=A0 One worked as sender and receiver with=0A> pkt-gen, the other= =0A> > >> worked as bridge=0A> > >> with bridge.c.=0A> > >>=0A> > >>=A0 as = you said,I feeled comfous too when i=0A> saw the big packet=0A> > >> perfor= mance=0A> > >> dropped, i tried to change the memory=0A> parameters of=0A> = > >> netmap(netmap_mem1.c=0A> > >> netmap_mem2.c),but it seemed that=A0 can= =0A> not resove the=0A> > >> problem.=0A> > >>=A0=A0=A060-byte packet send = 14882289=0A> pps=A0 recv =0A> > >> 13994753 pps=0A> > >>=A0=A0=A0124-byte= =A0=0A> =A0=A0=A0=0A> > >>=A0 =A0 send=A0=A0=A08445770 pps=0A> =0A> > >> re= cv=A0 =A0 7628942 pps=0A> > >>=A0=A0=A0252-byte=A0=0A> =A0=A0=A0=0A> > >>= =A0 =A0 send=A0=A0=A04529819 pps=0A> =0A> > >> recv=A0 =A0=A0=A03757843 pps= =0A> > >>=A0=A0=A0508-byte=A0=0A> =A0=A0=A0=0A> > >>=A0 =A0 send=A0 =A0 235= 0815 pps =0A> > >> recv=A0 =A0 1645647 pps=0A> > >>=A0=A0=A01514-byte=A0 = =A0=0A> =A0=A0=A0send =0A> > >>=A0=A0=A0814288 pps=A0=0A> =A0=A0=A0recv=A0 = 489133=0A> > >> pps=0A> > > These numbers indicate you're tx'ing 7.2Gb/s wi= th=0A> 60 byte packets and=0A> > > 9.8Gb/s with 1514, so maybe you just nee= d a new=0A> calculator?=0A> > >=0A> > > BC=0A> > > ________________________= _______________________=0A> > >=0A> > AsBarney pointed outalready, your num= bers are=0A> reasonable. You have almost saturated=0A> > the link with 1514= byte packets.In the case of 64 byte=0A> packets, you do not achieve line= =0A> > rate probably because of the congestion on the bus.Can=0A> you show = us "top -SI" output on the=0A> > sender machine?=0A> =0A> the OP is comment= ing that on the receive side he is seeing a=0A> much=0A> lower number than = on the tx side (A:ix1 489Kpps vs A:ix0=0A> 814Kpps).=0A> =0A> =A0 =A0 [pkt-= gen -f tx ix0]-->--[ix0 bridge ]=0A> =A0 =A0 [=A0=A0=A0HOST A=A0 =A0 =A0=0A= > =A0 ]=A0 =A0=A0=A0[=A0 =A0 HOST B ]=0A> =A0 =A0 [pkt-gen -f rx ix1]--<--[= ix1=A0 =A0=0A> =A0 =A0 ]=0A> =0A> What is unclear is where the loss occurs.= =0A> =0A> =A0=A0=A0 cheers=0A> =A0=A0=A0 luigi=0A=0AThe ixgbe driver has ma= c stats that will answer that. Just look at the=0Asysctl output.=0A=0ABC