Skip site navigation (1)Skip section navigation (2)
Date:      Sun, 12 Nov 2006 20:58:49 -0500
From:      Mike Tancsa <mike@sentex.net>
To:        Scott Long <scottl@samsco.org>
Cc:        freebsd-net <freebsd-net@freebsd.org>, freebsd-stable@freebsd.org, Jack Vogel <jfvogel@gmail.com>
Subject:   Re: Proposed 6.2 em RELEASE patch
Message-ID:  <200611130158.kAD1wdKE040908@lava.sentex.ca>
In-Reply-To: <4557CECD.2000609@samsco.org>
References:  <2a41acea0611081719h31be096eu614d2f2325aff511@mail.gmail.com> <200611091536.kA9FaltD018819@lava.sentex.ca> <45534E76.6020906@samsco.org> <200611092200.kA9M0q1E020473@lava.sentex.ca> <200611102004.kAAK4iO9027778@lava.sentex.ca> <2a41acea0611101400w5b8cef40ob84ed6de181f3e2c@mail.gmail.com> <200611102221.kAAML6ol028630@lava.sentex.ca> <455570D8.6070000@samsco.org> <200611120412.kAC4CuIB035746@lava.sentex.ca> <45574ECA.4080207@samsco.org> <200611130040.kAD0etbp040637@lava.sentex.ca> <4557CECD.2000609@samsco.org>

next in thread | previous in thread | raw e-mail | index | archive | help
At 08:47 PM 11/12/2006, Scott Long wrote:
>>>2. Try compiling in WITNESS and running the test as before, then break
>>>into the debugger as before.  Run 'show locks'.  I'm not sure how
>>>fruitful this will be, WITNESS might make it unbearably slow.
>>It was in that kernel already
>
>So you're seeing the livelock under load while also having WITNESS 
>enabled?  Have you tried your test without WITNESS?  What about INVARIANTS?

Sorry, by it was in the kernel already, it was from last nights tests 
where you asked me to break into the debugger to see what was going 
on. I figured you would want it in there.  My original tests were all 
without WITNESS and INVARIANTS and they were showing the same 
behaviour (locking up on the management interface) with and without 
WITNESS and INVARIANTS


Removing ADAPTIVE_GIANT seems to be very key in this!  If I remove 
it, the box no longer locks up under a high packet rate! Its still a 
little sluggish on the bge OOB interface, but its not totally locking 
up like before

Running ifstat -b from the management interface, here is the traffic 
pattern first with one blast running and then the second kicks 
in.  The Kbps/s out on em1 drops in half, but the box is still 
responsive and bge1... Certainly responsive enough to see the output of ifstat.



218028.4      0.00      0.00  216389.9      0.47      1.17
218971.2      0.00      0.00  217123.1      0.94      2.34
217754.7      0.00      0.00  215677.2      0.94      1.17
215763.1      0.00      0.00  214578.5      0.47      1.17
217850.3      0.00      0.00  216138.7      1.40      2.34
217668.0      0.00      0.00  215888.3      0.47      1.17
        em0                 em1                 bge1
  Kbps in  Kbps out   Kbps in  Kbps out   Kbps in  Kbps out
217382.3      0.00      0.00  216293.8      1.26      1.59
218247.9  118916.5  234167.3  124972.1      0.47      2.17
215973.4  220459.9  393350.0  54875.64      1.40      2.34
217697.7  210984.5  398543.3  58165.20      0.94      3.09
217183.6  200424.9  399096.5  61845.74      0.94      1.17
217788.7  221212.9  400129.8  53716.38      0.47      1.17
217040.0  204934.2  396628.7  61247.34      1.40      2.34
217105.9  201295.5  399274.1  61710.76      0.94      3.09
215605.6  225012.4  397533.5  53237.31      0.94      1.17
217933.3  200346.4  395949.3  62734.52      0.47      1.17
216783.7  205114.1  395923.0  61042.17      0.94      1.17
217885.7  88513.41  159056.4  151418.9      0.47      1.17
216927.2      0.00      0.00  215450.4      0.94      1.17
217454.1      0.00      0.00  215466.6      0.47      1.17
216810.6      0.00      0.00  215564.2      1.40      1.17
217608.3      0.00      0.00  216061.8      0.47      1.17
217452.8      0.00      0.00  215627.1      0.94      1.17
217185.0      0.00      0.00  216079.7      0.47      1.17


However, if I turn on fastforwarding, its back to the old behavior 
with it locking up.  This was with the stock driver. I will try the 
same test with

#define EM_FAST_INTR 1

as well as taking out the nfs option from the kernel 
driver.  Anything else to tune with ?

         ---Mike





>Scott




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?200611130158.kAD1wdKE040908>