From owner-freebsd-arch@FreeBSD.ORG Thu Apr 4 16:04:10 2013 Return-Path: Delivered-To: arch@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 523B316C; Thu, 4 Apr 2013 16:04:10 +0000 (UTC) (envelope-from alfred@ixsystems.com) Received: from mail.iXsystems.com (newknight.ixsystems.com [206.40.55.70]) by mx1.freebsd.org (Postfix) with ESMTP id 2D848D5D; Thu, 4 Apr 2013 16:04:09 +0000 (UTC) Received: from localhost (mail.ixsystems.com [10.2.55.1]) by mail.iXsystems.com (Postfix) with ESMTP id 63DC6614A6; Thu, 4 Apr 2013 09:04:09 -0700 (PDT) Received: from mail.iXsystems.com ([10.2.55.1]) by localhost (mail.ixsystems.com [10.2.55.1]) (maiad, port 10024) with ESMTP id 64364-02; Thu, 4 Apr 2013 09:04:09 -0700 (PDT) Received: from Alfreds-MacBook-Pro-9.local (unknown [10.8.0.14]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mail.iXsystems.com (Postfix) with ESMTPSA id 9392E614A0; Thu, 4 Apr 2013 09:04:08 -0700 (PDT) Message-ID: <515DA46D.2060808@ixsystems.com> Date: Thu, 04 Apr 2013 09:03:57 -0700 From: Alfred Perlstein User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:17.0) Gecko/20130328 Thunderbird/17.0.5 MIME-Version: 1.0 To: =?UTF-8?B?RGFnLUVybGluZyBTbcO4cmdyYXY=?= Subject: Re: [CFR][CFT] counter(9): new API for faster and raceless counters References: <20130401115128.GZ76816@FreeBSD.org> <20130402232606.GC1810@garage.freebsd.pl> <20130403002846.GB15334@onelab2.iet.unipi.it> <20130403100401.GA1349@garage.freebsd.pl> <515C68B5.2010006@ixsystems.com> <86r4iqoen7.fsf@ds4.des.no> In-Reply-To: <86r4iqoen7.fsf@ds4.des.no> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Cc: arch@FreeBSD.org, Gleb Smirnoff X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 04 Apr 2013 16:04:10 -0000 Since we're taking the "blunt route" I'll be blunt as well: You have completely missed the point of the project I am working on. Here is the point which you have missed: I was attempting to graph as many stats as possible, in addition I was looking at some heuristics to find out when machines go bad. In doing so I found that the user land utilities are require quite a bit of parsing to figure this stuff out due to varied output formats. Both Munin and Graphite suffer from this as well. Go read through the plugins (which lack many of the metrics I've pulled in a generic fashion) and you'll see what I'm talking about. What we are inventing and proposing is adding output options for various tools in the base system to better plug into these monitoring tools. This means a CSV/XML-like output for tools like sysctl/netstat/etc/etc and I was probing the community for feedback on this matter. What I was not looking for was a pat on the back for the graphing system we worked on for a total of 5 days. I hope this helps. -Alfred On 4/4/13 1:59 AM, Dag-Erling Smørgrav wrote: > Alfred Perlstein writes: >> Here at iXsystems we've just developed a set of scripts to scrape the >> various FreeBSD user land utilities (sysctl, netstat, nfsstat, vmstat, >> etc, etc) and put them into graphs based on time. > in other words, you've reinvented Munin and Graphite? > >> The only problem we have is that every user land tool has its own >> format, so along with my team we have written some shell to coerce the >> output from the various programs into pseudo-CSV (key/value pair) >> which can then be post processed by tools to convert to CSV which can >> then be put into something like open office, or put through an R >> program to graph it. > in other words, you've reinvented rrdtool? > > DES