Date: Tue, 28 Aug 2007 16:53:39 -0500 From: "Bill Marquette" <bill.marquette@gmail.com> To: "Max Laier" <max@love2party.net> Cc: freebsd-pf@freebsd.org Subject: Re: pfsync errors Message-ID: <55e8a96c0708281453y2a4a7ffdw1c5959a3c6fef7b9@mail.gmail.com> In-Reply-To: <200708282253.46740.max@love2party.net> References: <55e8a96c0708221242h2d5e7d15q847e6fac7cf60554@mail.gmail.com> <55e8a96c0708272114n42c0d9e7h675d1a9043bf3d80@mail.gmail.com> <55e8a96c0708281344y62bbb152k3f2a7e9d375a2acd@mail.gmail.com> <200708282253.46740.max@love2party.net>
next in thread | previous in thread | raw e-mail | index | archive | help
On 8/28/07, Max Laier <max@love2party.net> wrote: > > I'm going to toy with some settings for the em(4) driver in > > loader.conf and see if I can raise the txd and rxd descriptors since > > we're not running on 82542 or 82543 chipped hardware we can go above > > 256 descriptors. Raised it to 4096 for both txd and rxd with no impact (may help something else, who knows). > No that's the internal work deferral queue. Try something like the > following in contrib/pf/net/if_pfsync.c: > > @@ -229,7 +229,7 @@ > callout_init(&sc->sc_bulk_tmo, NET_CALLOUT_MPSAFE); > callout_init(&sc->sc_bulkfail_tmo, NET_CALLOUT_MPSAFE); > callout_init(&sc->sc_send_tmo, NET_CALLOUT_MPSAFE); > - sc->sc_ifq.ifq_maxlen = ifqmaxlen; > + sc->sc_ifq.ifq_maxlen = 2 * ifqmaxlen; > mtx_init(&sc->sc_ifq.ifq_mtx, ifp->if_xname, "pfsync send queue", > MTX_DEF); > if_attach(ifp); > > But there might be other reasons like timing wrt the locks. I'll have to > check for details. It might also be a good idea to MFC the taskqueue > approach from CURRENT, rather than using the callout ... that's a bit of > work however. That seems to have halved the error rate, not sure if it's not just the time of day though (we're now past our peak traffic load by a few hours). $ netstat -s -ppfsync && sleep 1 && netstat -s -ppfsync pfsync: 383169 packets received (IPv4) 0 packets received (IPv6) 0 packets discarded for bad interface 0 packets discarded for bad ttl 0 packets shorter than header 0 packets discarded for bad version 0 packets discarded for bad HMAC 0 packets discarded for bad action 0 packets discarded for short packet 0 states discarded for bad values 0 stale states 35622 failed state lookup/inserts 23635 packets sent (IPv4) 0 packets sent (IPv6) 0 send failed due to mbuf memory error 5580 send error pfsync: 387782 packets received (IPv4) 0 packets received (IPv6) 0 packets discarded for bad interface 0 packets discarded for bad ttl 0 packets shorter than header 0 packets discarded for bad version 0 packets discarded for bad HMAC 0 packets discarded for bad action 0 packets discarded for short packet 0 states discarded for bad values 0 stale states 35711 failed state lookup/inserts 23876 packets sent (IPv4) 0 packets sent (IPv6) 0 send failed due to mbuf memory error 5676 send error --Bill
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?55e8a96c0708281453y2a4a7ffdw1c5959a3c6fef7b9>