Date: Fri, 25 Apr 2014 14:27:56 +0100 From: "Steven Hartland" <killing@multiplay.co.uk> To: "Marek Salwerowicz" <marek_sal@wp.pl>, =?iso-8859-1?Q?Gerrit_K=FChn?= <gerrit.kuehn@aei.mpg.de> Cc: freebsd-net@freebsd.org Subject: Re: NFS over LAGG / lacp poor performance Message-ID: <AC1233D368D94519BB59B484D6F385C0@multiplay.co.uk> References: <535A1354.2040309@wp.pl> <20140425113711.e7c7d1c2.gerrit.kuehn@aei.mpg.de> <535A482E.1030106@wp.pl> <20140425140123.a76c18f9.gerrit.kuehn@aei.mpg.de> <535A5268.100@wp.pl> <8247FE6336414E1F97ADA561D0680097@multiplay.co.uk> <535A5DD9.9060206@wp.pl>
next in thread | previous in thread | raw e-mail | index | archive | help
----- Original Message ----- From: "Marek Salwerowicz" <marek_sal@wp.pl> To: "Steven Hartland" <killing@multiplay.co.uk>; "Gerrit Kühn" <gerrit.kuehn@aei.mpg.de> Cc: <freebsd-net@freebsd.org> Sent: Friday, April 25, 2014 2:06 PM Subject: Re: NFS over LAGG / lacp poor performance >W dniu 2014-04-25 14:55, Steven Hartland pisze: >> ----- Original Message ----- From: "Marek Salwerowicz" <marek_sal@wp.pl> >> >> >>> W dniu 2014-04-25 14:01, Gerrit Kühn pisze: >>>> Thanks for your input. As far as I understood so far, there should >>>> be one >>>> igb queue created per cpu core in the system by default (and this is >>>> what >>>> I see on my system). But my irq rate looks quite high to me (and it is >>>> only on one of these queues). >>> >>> >>> My CPU has 8 cores: >>> >>> http://ark.intel.com/products/75267/Intel-Xeon-Processor-E5-2640-v2-20M-Cache-2_00-GHz >>> >>> >>> So why do I have only 1 queue ? >> >> What does "sysctl hw.igb.num_queues" report? > > storage1% sysctl hw.igb.num_queues > hw.igb.num_queues: 1 >> >> num_queues does default to 1 for Legacy or MSI so you might be hitting >> that. >> >> Do you see "Using MSIX interrupts with" in your dmesg? > storage% dmesg | grep MSIX > igb0: Using MSIX interrupts with 2 vectors > igb1: Using MSIX interrupts with 2 vectors > igb2: Using MSIX interrupts with 2 vectors > igb3: Using MSIX interrupts with 2 vectors > igb0: Using MSIX interrupts with 2 vectors > igb1: Using MSIX interrupts with 2 vectors > igb2: Using MSIX interrupts with 2 vectors > igb3: Using MSIX interrupts with 2 vectors In that case I believe you've hard coded the number of queues, check /boot/loader.conf for references to this. Regards Steve
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?AC1233D368D94519BB59B484D6F385C0>