From owner-freebsd-arch@freebsd.org Wed May 31 17:30:45 2017 Return-Path: Delivered-To: freebsd-arch@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 47E0AB7F0BE for ; Wed, 31 May 2017 17:30:45 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-wm0-x231.google.com (mail-wm0-x231.google.com [IPv6:2a00:1450:400c:c09::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D91CB84723 for ; Wed, 31 May 2017 17:30:44 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by mail-wm0-x231.google.com with SMTP id d127so28713754wmf.0 for ; Wed, 31 May 2017 10:30:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc; bh=ZDaJROj7Q6vCxStdTYfntp++ScQAaRv4YO9N0zU/6Lc=; b=jJ2TabaR419/4gvk1ijSb2iDVmQrXhYMBHjCv666z+bJ2P9FoHxNu7Ugyy24IRMmAV QpiH0z1zmEmE1ZgpCRCsQzEseJxudaODkGj+EC8FeLms5VTBcXwiyJXVb0SBfT324qD3 yNOvvpQoiUM1xUmZjhiPFeISxBb/3KahFxIieyHqoCxnSZMnL+yiF5cETXMnMnxsQxFD fV+fPgGin3n9oDaGsMSCBS0PLIzLd61on3nm8aezIV0aInPK3YQ6fd05Zv7ywp5q90KV Cy2uDKyocCdB1kEk3YUI56LsFQtjBlrt9cHltWFxjRUh5b4crobSZF34cpRxo/rAA2QF k9fw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc; bh=ZDaJROj7Q6vCxStdTYfntp++ScQAaRv4YO9N0zU/6Lc=; b=mosEFttkKHMV5awU6BWLipZiTzvInCJfn0sAc0b0EliFUMUN5XXdtuQVdyM0Ek7kca LsRx6MSB+lJluGmM/Xpfwt4PUi7zJ7NdQRd2do6Dz7hyAlhB39nnuS/MvLqU8LpDWmdJ q6qVwnLVvJYz1Knr6yIkEronDgq8yMYZ/RfJUGwoSVHqDyWBeEBWjkUovSva+Krl0obl 1qUCEboubzTv5Q+BxHhB2O2PnwA3StR43HuqxZh+gP7bxQa8+5oXjT+yMHNpqiKDEQUs pq9ZVyrLoFuh1oowRtppjaGPJOsvkkdGe8twui6NpcUUrXNQ0ILmqpWs2CsAUiC9rQdw 47dA== X-Gm-Message-State: AODbwcCIIQ2kL88j1jdNaJLV4eU3oHyqvMNrdX8sUj50Dw995p2EMqzm XFEV+2hBltUw4GgKfBu8q/3DyjqjUqFD X-Received: by 10.28.31.135 with SMTP id f129mr6689500wmf.78.1496251842634; Wed, 31 May 2017 10:30:42 -0700 (PDT) MIME-Version: 1.0 Sender: adrian.chadd@gmail.com Received: by 10.28.193.134 with HTTP; Wed, 31 May 2017 10:30:41 -0700 (PDT) In-Reply-To: <1349284176.55940289.1496238801718.JavaMail.zimbra@stormshield.eu> References: <1914359731.54283525.1495178031163.JavaMail.zimbra@stormshield.eu> <816581118.55670987.1496141816904.JavaMail.zimbra@stormshield.eu> <608664209.55736023.1496155561181.JavaMail.zimbra@stormshield.eu> <1349284176.55940289.1496238801718.JavaMail.zimbra@stormshield.eu> From: Adrian Chadd Date: Wed, 31 May 2017 10:30:41 -0700 X-Google-Sender-Auth: AHapgUrBolrcdiTiUEzkjvVkC_g Message-ID: Subject: Re: numa and taskqueues To: Emeric POUPON Cc: freebsd-arch Content-Type: text/plain; charset="UTF-8" X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 31 May 2017 17:30:45 -0000 On 31 May 2017 at 06:53, Emeric POUPON wrote: > >>> >>> Actually, there is a performance boost only when few flows are involved. >>> That's why this is not activated by default and a sysctl is here to enable the >>> feature. >>> >>> To sum up, the more different flows you process (both ciphered and unciphered), >>> the more network queues are hit and the more CPU units are triggered from >>> ipsec. >>> In this case, we indeed notice a loss, certainly due to the extra >>> queing/reordering performed. >> >> Can you dig into that a bit more? Do you know exactly what's going on? >> eg, is it a "lock contention" problem? Is it a "stuff is context >> switching, thus latency" problem? etc, etc. >> > > Unfortunately I cannot tell you the exact reason right now. > I am sure there is no lock contention involved though (except of course when several domains are involved). > Did you expect such a dev to be enabled by default? Well, I'd really like to get to the bottom of these. :-P -adrian