From owner-freebsd-embedded@FreeBSD.ORG Sun Feb 28 02:07:54 2010 Return-Path: Delivered-To: embedded@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 181AA106564A; Sun, 28 Feb 2010 02:07:54 +0000 (UTC) (envelope-from rpaulo@gmail.com) Received: from mail-vw0-f54.google.com (mail-vw0-f54.google.com [209.85.212.54]) by mx1.freebsd.org (Postfix) with ESMTP id 909598FC12; Sun, 28 Feb 2010 02:07:53 +0000 (UTC) Received: by vws14 with SMTP id 14so615349vws.13 for ; Sat, 27 Feb 2010 18:07:39 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:sender:subject:mime-version :content-type:from:in-reply-to:date:cc:content-transfer-encoding :message-id:references:to:x-mailer; bh=c8Qx0sTAFVgqY2lExV7gU9QZgCcCG8jBFWJ7JjTGG8U=; b=ktPYSlLm+rZzDTs13Y7UpWOVdxJGA2a90HA11e51EasJnih2zg/xxf4MEZi1J9Wp0j q21n+qpL4pv+6F9m2X/J6bzxaCFtGZWwSGjcAwj8bMmYmG2lwldG/Oe2GOLCXYpxEixo TwJAgrdueQjC0LIajSpjNzsIhiBQPelvJXhLM= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=sender:subject:mime-version:content-type:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to:x-mailer; b=R3/1Z/hoMAqoaFOmerjjKlz1sGEO4RqjULYE46XPG7Q+4ojunFmYny3R17S2NgNBA3 57IHsdJmHIqre8pfECew3xfxL50XbTdCLrADSMJq2WYfsyAbIo+0A5WldobRvt2kqre3 FRzKaVgPr65x7qkx6AMTiiTE0SMvohW5YEfeE= Received: by 10.220.89.205 with SMTP id f13mr1860032vcm.17.1267322859621; Sat, 27 Feb 2010 18:07:39 -0800 (PST) Received: from ?10.0.10.4? (54.81.54.77.rev.vodafone.pt [77.54.81.54]) by mx.google.com with ESMTPS id 42sm15916756vws.8.2010.02.27.18.07.36 (version=TLSv1/SSLv3 cipher=RC4-MD5); Sat, 27 Feb 2010 18:07:38 -0800 (PST) Sender: Rui Paulo Mime-Version: 1.0 (Apple Message framework v1077) Content-Type: text/plain; charset=us-ascii From: Rui Paulo In-Reply-To: <9D9E6892-ABE5-44B3-965B-383D80366D1B@neville-neil.com> Date: Sun, 28 Feb 2010 02:07:34 +0000 Content-Transfer-Encoding: quoted-printable Message-Id: References: <9D9E6892-ABE5-44B3-965B-383D80366D1B@neville-neil.com> To: George Neville-Neil X-Mailer: Apple Mail (2.1077) Cc: Joseph Koshy , embedded@freebsd.org, fabient@freebsd.org Subject: Re: 3rd, and hopefully final, MIPS 24K hwpmc patch... X-BeenThere: freebsd-embedded@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Dedicated and Embedded Systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 28 Feb 2010 02:07:54 -0000 Hi, On 27 Feb 2010, at 18:29, George Neville-Neil wrote: > Howdy, >=20 > I'd like to commit this patch sometime in the next week: >=20 > http://people.freebsd.org/~gnn/mipshwpmc_3.diff >=20 > The biggest change was breaking out MIPS24K from generic MIPS, which = will allow for the easy addition > of other types of MIPS chips in the near future. Looks good to me. Regards, -- Rui Paulo From owner-freebsd-embedded@FreeBSD.ORG Sun Feb 28 08:39:10 2010 Return-Path: Delivered-To: embedded@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E8511106564A; Sun, 28 Feb 2010 08:39:10 +0000 (UTC) (envelope-from imp@bsdimp.com) Received: from harmony.bsdimp.com (bsdimp.com [199.45.160.85]) by mx1.freebsd.org (Postfix) with ESMTP id A73488FC0C; Sun, 28 Feb 2010 08:39:10 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by harmony.bsdimp.com (8.14.3/8.14.1) with ESMTP id o1S8aInd028907; Sun, 28 Feb 2010 01:36:18 -0700 (MST) (envelope-from imp@bsdimp.com) Date: Sun, 28 Feb 2010 01:36:31 -0700 (MST) Message-Id: <20100228.013631.850602504923951271.imp@bsdimp.com> To: rpaulo@FreeBSD.org From: "M. Warner Losh" In-Reply-To: References: <9D9E6892-ABE5-44B3-965B-383D80366D1B@neville-neil.com> X-Mailer: Mew version 6.3 on Emacs 22.3 / Mule 5.0 (SAKAKI) Mime-Version: 1.0 Content-Type: Text/Plain; charset=us-ascii Content-Transfer-Encoding: 7bit Cc: jkoshy@FreeBSD.org, embedded@FreeBSD.org, fabient@FreeBSD.org Subject: Re: 3rd, and hopefully final, MIPS 24K hwpmc patch... X-BeenThere: freebsd-embedded@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Dedicated and Embedded Systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 28 Feb 2010 08:39:11 -0000 In message: Rui Paulo writes: : > http://people.freebsd.org/~gnn/mipshwpmc_3.diff : > : > The biggest change was breaking out MIPS24K from generic MIPS, which will allow for the easy addition : > of other types of MIPS chips in the near future. @@ -2681,6 +2724,10 @@ } else if (pe >= PMC_EV_XSCALE_FIRST && pe <= PMC_EV_XSCALE_LAST) { ev = xscale_event_table; evfence = xscale_event_table + PMC_EVENT_TABLE_SIZE(xscale); + } else if (pe >= PMC_EV_MIPS24K_FIRST && pe <= PMC_EV_MIPS24K_LAST) { + ev = mips24k_event_table; + evfence = mips24k_event_table + PMC_EVENT_TABLE_SIZE(mips24k +); Looks like a stray new line. There does seem to be a number of places where we mix mips, arm, and x86 CPUs in case statements and the like. Yet there are other places we carefully ifdef them. What's the determining factors here? Also, the mips24k counters are specific to the mips24k, but the harvesting of the counters is fairly generic to the mips architecture (when counters are present). Why encode all the counter knowledge in the kernel when it might make better sense to have the userland routines do that decoding based on the core that's used? Maybe I'm misunderstanding something here, but I do know that linux asks the CPU how many performance counters there are and harvests them generically across a wide range of MIPS cores. Warner From owner-freebsd-embedded@FreeBSD.ORG Sun Feb 28 11:42:21 2010 Return-Path: Delivered-To: embedded@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2892B1065672; Sun, 28 Feb 2010 11:42:21 +0000 (UTC) (envelope-from jkoshy.freebsd@gmail.com) Received: from mail-pw0-f54.google.com (mail-pw0-f54.google.com [209.85.160.54]) by mx1.freebsd.org (Postfix) with ESMTP id D52C98FC08; Sun, 28 Feb 2010 11:42:20 +0000 (UTC) Received: by pwj7 with SMTP id 7so1219594pwj.13 for ; Sun, 28 Feb 2010 03:42:15 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:sender:message-id:to:cc :subject:in-reply-to:references:user-agent:mime-version:content-type :from:date; bh=T7dKUhd4Km5CFqvvf4o7sOeZg5nYGNYOLkXvNtzeCoE=; b=i/OeLrNYikCBYh6i5wGOLl0ORhi7GI9rMaggWEmMkLyZ91z1Rk0ep0PtHqoJmUeKVU My/jrliaMTxR28llUIdugXqa27JJNKBTvkv19wFYWmH3qTWBwjvMF8kHh3MZgzkMIGF6 mTAl5Pb1Zvm4A4ttkXpvaxSLllyG1avKm6q28= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=sender:message-id:to:cc:subject:in-reply-to:references:user-agent :mime-version:content-type:from:date; b=O8Ii/Dc/X6YG0Iyz32GGntYhHbTqckndYjf5Y8t1cvNj50pk0xLffEYvfK/K48ujo7 Vs7O5XrcqVDadJ7qHQqBd7HHSODzfJsxK1lErbray9G+efCPpGyt3E19BFg1gNpBvb3g exvNj52r7cj5U3Y+g0BH4WC8ULe0Eu/OUydoc= Received: by 10.143.129.2 with SMTP id g2mr1388971wfn.273.1267357335402; Sun, 28 Feb 2010 03:42:15 -0800 (PST) Received: from moria.unixconsulting.co.in ([117.204.49.159]) by mx.google.com with ESMTPS id 23sm2427212pzk.2.2010.02.28.03.42.10 (version=TLSv1/SSLv3 cipher=RC4-MD5); Sun, 28 Feb 2010 03:42:13 -0800 (PST) Sender: Joseph Koshy Message-ID: <861vg54mr7.wl%koshy@unixconsulting.co.in> To: George Neville-Neil In-Reply-To: <3BF42672-9790-4D7F-9723-3D80601930B7@neville-neil.com> References: <42B59FCC-7A59-4383-BE4E-366B80B504BF@neville-neil.com> <867hqa9d0h.wl%koshy@unixconsulting.co.in> <3BF42672-9790-4D7F-9723-3D80601930B7@neville-neil.com> User-Agent: Wanderlust/2.14.0 (Africa) SEMI/1.14.6 (Maruoka) FLIM/1.14.8 (=?ISO-8859-4?Q?Shij=F2?=) APEL/10.7 Emacs/22.3 (amd64-portbld-freebsd6.3) MULE/5.0 (SAKAKI) MIME-Version: 1.0 (generated by SEMI 1.14.6 - "Maruoka") Content-Type: text/plain; charset=US-ASCII From: Joseph Koshy Date: Sun, 28 Feb 2010 11:36:23 -0000 Cc: Joseph Koshy , embedded@freebsd.org, fabient@freebsd.org Subject: Re: First cut at hwpmc support on MIPS X-BeenThere: freebsd-embedded@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Dedicated and Embedded Systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 28 Feb 2010 11:42:21 -0000 > > 7) From the definitions in the header file, these PMCs appear to > > support the concept of sampling based on processor mode: > > > > +#define MIPS_PMC_USER_ENABLE 0x08 /* Count in USER mode */ > > +#define MIPS_PMC_SUPER_ENABLE 0x04 /* Count in SUPERVISOR mode */ > > +#define MIPS_PMC_KERNEL_ENABLE 0x02 /* Count in KERNEL mode */ > > > > If that is the case, then you should support those modifiers in > > libpmc's event parsing. The libpmc code in the patch appears to be > > a stub: > > > > +static int > > +mips_allocate_pmc(enum pmc_event pe, char *ctrspec __unused, > > + struct pmc_op_pmcallocate *pmc_config __unused) > > +{ > > + switch (pe) { > > + default: > > + break; > > + } > > + > > + return (0); > > +} > > > > > Is there any other processor that does this? Right now I make the chip > sample in all modes by fiat. All the Intel and AMD PMCs: see the handling of the "usr" and "os" qualifiers. > > 8) You can reduce the size of the following table in "hwpmc_mips.c", > > by treating the pe_counter field as a set of flags. > > > > +struct mips_event_code_map { > > + enum pmc_event pe_ev; /* enum value */ > > + uint8_t pe_counter; /* Which counter this can be counted in. */ > > + uint8_t pe_code; /* numeric code */ > > +}; > > > > +const struct mips_event_code_map mips_event_codes[] = { > > + { PMC_EV_MIPS_CYCLE, 0, 0}, > > + { PMC_EV_MIPS_CYCLE, 1, 0}, <<<--- repeated information Most Intel CPUs have restrictions on the events that PMCs support. You may want to look at the P6, or Intel Core support code for examples. > > 9) You'd want to support flags that control counting based on > > processor modes. For this, you would want to pass down flags > > from userland and change the `pm_mips_evsel' field to suit: > > > > +static int > > +mips_allocate_pmc(int cpu, int ri, struct pmc *pm, > > + const struct pmc_op_pmcallocate *a) > > +{ > > ... > > + pm->pm_md.pm_mips.pm_mips_evsel = config; > > > Again, for both of these, is there an example I should work from? See P6, Pentium IV, AMD, Intel Core for examples. Additional comments on patch #3: * The manual page still has UTF 8. E.g.,- +Count all pipeline bubbles that are a result of multicycle ISPRAM +access. Pipeline bubbles are defined as all cycles that IFU doesn<80><99>t +present an instruction to ALU. The four cycles after a redirect are * The convention is that sentences always start on a new line in -mdoc input. Regards, Koshy From owner-freebsd-embedded@FreeBSD.ORG Sun Feb 28 18:48:33 2010 Return-Path: Delivered-To: embedded@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5A951106566B; Sun, 28 Feb 2010 18:48:33 +0000 (UTC) (envelope-from gnn@neville-neil.com) Received: from mail.meer.net (mail.meer.net [64.13.141.3]) by mx1.freebsd.org (Postfix) with ESMTP id 220F78FC14; Sun, 28 Feb 2010 18:48:32 +0000 (UTC) Received: from mail2.meer.net (mail2.meer.net [64.13.141.16]) by mail.meer.net (8.13.3/8.13.3/meer) with ESMTP id o1SIjVrX014441; Sun, 28 Feb 2010 10:45:31 -0800 (PST) (envelope-from gnn@neville-neil.com) Received: from [192.168.99.148] (host-216-220-114-135.dsl.bway.net [216.220.114.135]) (authenticated bits=0) by mail2.meer.net (8.14.1/8.14.3) with ESMTP id o1SIjJqJ073275 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NO); Sun, 28 Feb 2010 10:45:29 -0800 (PST) (envelope-from gnn@neville-neil.com) Mime-Version: 1.0 (Apple Message framework v1077) Content-Type: text/plain; charset=us-ascii From: George Neville-Neil In-Reply-To: <20100228.013631.850602504923951271.imp@bsdimp.com> Date: Sun, 28 Feb 2010 13:45:17 -0500 Content-Transfer-Encoding: quoted-printable Message-Id: <4169243C-D569-40E7-9115-09DB72F691FE@neville-neil.com> References: <9D9E6892-ABE5-44B3-965B-383D80366D1B@neville-neil.com> <20100228.013631.850602504923951271.imp@bsdimp.com> To: "M. Warner Losh" X-Mailer: Apple Mail (2.1077) Cc: jkoshy@FreeBSD.org, embedded@FreeBSD.org, rpaulo@FreeBSD.org, fabient@FreeBSD.org Subject: Re: 3rd, and hopefully final, MIPS 24K hwpmc patch... X-BeenThere: freebsd-embedded@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Dedicated and Embedded Systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 28 Feb 2010 18:48:33 -0000 On Feb 28, 2010, at 03:36 , M. Warner Losh wrote: > In message: > Rui Paulo writes: > : > http://people.freebsd.org/~gnn/mipshwpmc_3.diff > : >=20 > : > The biggest change was breaking out MIPS24K from generic MIPS, = which will allow for the easy addition > : > of other types of MIPS chips in the near future. >=20 > @@ -2681,6 +2724,10 @@ > } else if (pe >=3D PMC_EV_XSCALE_FIRST && pe <=3D = PMC_EV_XSCALE_LAST) { > ev =3D xscale_event_table; > evfence =3D xscale_event_table + = PMC_EVENT_TABLE_SIZE(xscale); > + } else if (pe >=3D PMC_EV_MIPS24K_FIRST && pe <=3D = PMC_EV_MIPS24K_LAST) { > + ev =3D mips24k_event_table; > + evfence =3D mips24k_event_table + = PMC_EVENT_TABLE_SIZE(mips24k > +); >=20 > Looks like a stray new line. >=20 I can fix that. > There does seem to be a number of places where we mix mips, arm, and > x86 CPUs in case statements and the like. Yet there are other places > we carefully ifdef them. What's the determining factors here? >=20 Well I followed the current standard so perhaps Joseph can comment more clearly on this. > Also, the mips24k counters are specific to the mips24k, but the > harvesting of the counters is fairly generic to the mips architecture > (when counters are present). Why encode all the counter knowledge in > the kernel when it might make better sense to have the userland > routines do that decoding based on the core that's used? Maybe I'm > misunderstanding something here, but I do know that linux asks the CPU > how many performance counters there are and harvests them generically > across a wide range of MIPS cores. The decoding is done in libpmc but grabbing the counters out of the = hardware is done in the kernel. Unless I don't quite get what you're asking. BTW Realize that the patch is both library (user space) and kernel = (dev/hwpmc) so it can be a bit confusing, perhaps to look at. Best, George From owner-freebsd-embedded@FreeBSD.ORG Sun Feb 28 23:07:33 2010 Return-Path: Delivered-To: embedded@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8EA42106566B; Sun, 28 Feb 2010 23:07:33 +0000 (UTC) (envelope-from gnn@neville-neil.com) Received: from mail.meer.net (mail.meer.net [64.13.141.3]) by mx1.freebsd.org (Postfix) with ESMTP id 6F0968FC14; Sun, 28 Feb 2010 23:07:33 +0000 (UTC) Received: from mail2.meer.net (mail2.meer.net [64.13.141.16]) by mail.meer.net (8.13.3/8.13.3/meer) with ESMTP id o1SN4KDU047923; Sun, 28 Feb 2010 15:04:20 -0800 (PST) (envelope-from gnn@neville-neil.com) Received: from [192.168.0.12] (cpe-68-175-72-246.nyc.res.rr.com [68.175.72.246]) (authenticated bits=0) by mail2.meer.net (8.14.1/8.14.3) with ESMTP id o1SN4IFk085382 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NO); Sun, 28 Feb 2010 15:04:20 -0800 (PST) (envelope-from gnn@neville-neil.com) Mime-Version: 1.0 (Apple Message framework v1077) Content-Type: text/plain; charset=us-ascii From: George Neville-Neil In-Reply-To: <861vg54mr7.wl%koshy@unixconsulting.co.in> Date: Sun, 28 Feb 2010 18:04:18 -0500 Content-Transfer-Encoding: quoted-printable Message-Id: <4FDD422C-DF35-4FFC-9D3F-77801574DCB9@neville-neil.com> References: <42B59FCC-7A59-4383-BE4E-366B80B504BF@neville-neil.com> <867hqa9d0h.wl%koshy@unixconsulting.co.in> <3BF42672-9790-4D7F-9723-3D80601930B7@neville-neil.com> <861vg54mr7.wl%koshy@unixconsulting.co.in> To: Joseph Koshy X-Mailer: Apple Mail (2.1077) Cc: embedded@freebsd.org, fabient@freebsd.org Subject: Re: First cut at hwpmc support on MIPS X-BeenThere: freebsd-embedded@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Dedicated and Embedded Systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 28 Feb 2010 23:07:33 -0000 On Feb 28, 2010, at 06:36 , Joseph Koshy wrote: >=20 >>> 7) =46rom the definitions in the header file, these PMCs appear to >>> support the concept of sampling based on processor mode: >>>=20 >>> +#define MIPS_PMC_USER_ENABLE 0x08 /* Count in USER = mode */ >>> +#define MIPS_PMC_SUPER_ENABLE 0x04 /* Count in = SUPERVISOR mode */ >>> +#define MIPS_PMC_KERNEL_ENABLE 0x02 /* Count in KERNEL = mode */ >>>=20 >>> If that is the case, then you should support those modifiers in >>> libpmc's event parsing. The libpmc code in the patch appears to be >>> a stub: >>>=20 >>> +static int >>> +mips_allocate_pmc(enum pmc_event pe, char *ctrspec __unused, >>> + struct pmc_op_pmcallocate *pmc_config __unused) >>> +{ >>> + switch (pe) { >>> + default: >>> + break; >>> + } >>> + =20 >>> + return (0); >>> +} >>>=20 >>>=20 >> Is there any other processor that does this? Right now I make the = chip >> sample in all modes by fiat. >=20 > All the Intel and AMD PMCs: see the handling of the "usr" and "os" > qualifiers. >=20 OK, done. >>> 8) You can reduce the size of the following table in "hwpmc_mips.c", >>> by treating the pe_counter field as a set of flags. >>>=20 >>> +struct mips_event_code_map { >>> + enum pmc_event pe_ev; /* enum value */ >>> + uint8_t pe_counter; /* Which counter this can be = counted in. */ >>> + uint8_t pe_code; /* numeric code */ >>> +}; >>>=20 >>> +const struct mips_event_code_map mips_event_codes[] =3D { >>> + { PMC_EV_MIPS_CYCLE, 0, 0}, >>> + { PMC_EV_MIPS_CYCLE, 1, 0}, <<<--- repeated information=20 >=20 > Most Intel CPUs have restrictions on the events that PMCs support. > You may want to look at the P6, or Intel Core support code for = examples. >=20 >>> 9) You'd want to support flags that control counting based on >>> processor modes. For this, you would want to pass down flags >>> from userland and change the `pm_mips_evsel' field to suit: >>>=20 >>> +static int >>> +mips_allocate_pmc(int cpu, int ri, struct pmc *pm, >>> + const struct pmc_op_pmcallocate *a) >>> +{ >>> ... >>> + pm->pm_md.pm_mips.pm_mips_evsel =3D config; >>>=20 >=20 >> Again, for both of these, is there an example I should work from? >=20 > See P6, Pentium IV, AMD, Intel Core for examples. >=20 Done. > Additional comments on patch #3: >=20 > * The manual page still has UTF 8. E.g.,- > +Count all pipeline bubbles that are a result of multicycle ISPRAM > +access. Pipeline bubbles are defined as all cycles that IFU = doesn<80><99>t > +present an instruction to ALU. The four cycles after a redirect are > * The convention is that sentences always start on a new line in > -mdoc input. Fixed. Thanks, George From owner-freebsd-embedded@FreeBSD.ORG Sun Feb 28 23:56:53 2010 Return-Path: Delivered-To: embedded@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 099C0106564A; Sun, 28 Feb 2010 23:56:53 +0000 (UTC) (envelope-from gnn@neville-neil.com) Received: from mail.meer.net (mail.meer.net [64.13.141.3]) by mx1.freebsd.org (Postfix) with ESMTP id E175C8FC13; Sun, 28 Feb 2010 23:56:52 +0000 (UTC) Received: from mail2.meer.net (mail2.meer.net [64.13.141.16]) by mail.meer.net (8.13.3/8.13.3/meer) with ESMTP id o1SNqiR7056352; Sun, 28 Feb 2010 15:52:44 -0800 (PST) (envelope-from gnn@neville-neil.com) Received: from [192.168.0.12] (cpe-68-175-72-246.nyc.res.rr.com [68.175.72.246]) (authenticated bits=0) by mail2.meer.net (8.14.1/8.14.3) with ESMTP id o1SNqhDk089400 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NO); Sun, 28 Feb 2010 15:52:44 -0800 (PST) (envelope-from gnn@neville-neil.com) Mime-Version: 1.0 (Apple Message framework v1077) Content-Type: text/plain; charset=us-ascii From: George Neville-Neil In-Reply-To: <4FDD422C-DF35-4FFC-9D3F-77801574DCB9@neville-neil.com> Date: Sun, 28 Feb 2010 18:52:43 -0500 Content-Transfer-Encoding: quoted-printable Message-Id: References: <42B59FCC-7A59-4383-BE4E-366B80B504BF@neville-neil.com> <867hqa9d0h.wl%koshy@unixconsulting.co.in> <3BF42672-9790-4D7F-9723-3D80601930B7@neville-neil.com> <861vg54mr7.wl%koshy@unixconsulting.co.in> <4FDD422C-DF35-4FFC-9D3F-77801574DCB9@neville-neil.com> To: George Neville-Neil X-Mailer: Apple Mail (2.1077) Cc: Joseph Koshy , embedded@freebsd.org, fabient@freebsd.org Subject: Re: First cut at hwpmc support on MIPS X-BeenThere: freebsd-embedded@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Dedicated and Embedded Systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 28 Feb 2010 23:56:53 -0000 FYI, latest patch is here: http://people.freebsd.org/~gnn/mipshwpmc_4.diff This should address all the issues identified. I ran a simple test of = running ls under each event in both system and process modes and that worked like a = charm. Best, George From owner-freebsd-embedded@FreeBSD.ORG Mon Mar 1 11:06:57 2010 Return-Path: Delivered-To: freebsd-embedded@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DFD571065688 for ; Mon, 1 Mar 2010 11:06:57 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id CD80C8FC1C for ; Mon, 1 Mar 2010 11:06:57 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.3/8.14.3) with ESMTP id o21B6vfH017748 for ; Mon, 1 Mar 2010 11:06:57 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.3/8.14.3/Submit) id o21B6vhU017746 for freebsd-embedded@FreeBSD.org; Mon, 1 Mar 2010 11:06:57 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 1 Mar 2010 11:06:57 GMT Message-Id: <201003011106.o21B6vhU017746@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-embedded@FreeBSD.org Cc: Subject: Current problem reports assigned to freebsd-embedded@FreeBSD.org X-BeenThere: freebsd-embedded@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Dedicated and Embedded Systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 01 Mar 2010 11:06:58 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o misc/136889 embedded [nanobsd] [path] nanobsd error reporting and other ref o misc/135588 embedded [nanobsd] simple patch for adding amd64 support o misc/52256 embedded [picobsd] picobsd build script does not read in user/s o kern/42728 embedded [picobsd] many problems in src/usr.sbin/ppp/* after c 4 problems total. From owner-freebsd-embedded@FreeBSD.ORG Mon Mar 1 17:32:55 2010 Return-Path: Delivered-To: embedded@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7CFF9106564A; Mon, 1 Mar 2010 17:32:55 +0000 (UTC) (envelope-from jkoshy.freebsd@gmail.com) Received: from mail-bw0-f228.google.com (mail-bw0-f228.google.com [209.85.218.228]) by mx1.freebsd.org (Postfix) with ESMTP id 8E2C98FC0C; Mon, 1 Mar 2010 17:32:48 +0000 (UTC) Received: by bwz28 with SMTP id 28so602471bwz.14 for ; Mon, 01 Mar 2010 09:32:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:sender:message-id:to:cc :subject:in-reply-to:references:user-agent:mime-version:content-type :from:date; bh=y++oqr+6+iLPaL5WH1OB7KdymnZrHvlgnes9HFD7vzE=; b=vtrh82SCFv047XUaQAyNTNSh3nMGQZm2/MXgHg2qs5OBvEB+H41T95MisXITAzhEAe kMB/rDRp2pmdFnIKoE6okPeichfrlo/a0LGBQmBJpwkhkocd2sPnAE+6NaYAR/irCFG6 Z+2S6q0Wg4GBlR4j76wTzlDR01OlVOMGB52uk= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=sender:message-id:to:cc:subject:in-reply-to:references:user-agent :mime-version:content-type:from:date; b=DeIVpI0FhM1rHQVfa+CxUytb6g8OwSK/kGe2KcHIXZvOBGKusfYIZjY9wlbubvZRn7 Cvzo/uSCTctmXp9Rge1WteCHJxuh8ATCOnC812iaXAKc/F9bKq9zHqk0hue2YU5ZrtQA PcelY/fVl3EbXR6/wAtpRGqL6ZtKl25XhzGgk= Received: by 10.204.132.207 with SMTP id c15mr3155529bkt.102.1267464762835; Mon, 01 Mar 2010 09:32:42 -0800 (PST) Received: from moria.unixconsulting.co.in ([122.166.160.79]) by mx.google.com with ESMTPS id 15sm2171564bwz.0.2010.03.01.09.32.37 (version=TLSv1/SSLv3 cipher=RC4-MD5); Mon, 01 Mar 2010 09:32:40 -0800 (PST) Sender: Joseph Koshy Message-ID: <86bpf83qii.wl%koshy@unixconsulting.co.in> To: George Neville-Neil In-Reply-To: References: <42B59FCC-7A59-4383-BE4E-366B80B504BF@neville-neil.com> <867hqa9d0h.wl%koshy@unixconsulting.co.in> <3BF42672-9790-4D7F-9723-3D80601930B7@neville-neil.com> <861vg54mr7.wl%koshy@unixconsulting.co.in> <4FDD422C-DF35-4FFC-9D3F-77801574DCB9@neville-neil.com> User-Agent: Wanderlust/2.14.0 (Africa) SEMI/1.14.6 (Maruoka) FLIM/1.14.8 (=?ISO-8859-4?Q?Shij=F2?=) APEL/10.7 Emacs/22.3 (amd64-portbld-freebsd6.3) MULE/5.0 (SAKAKI) MIME-Version: 1.0 (generated by SEMI 1.14.6 - "Maruoka") Content-Type: text/plain; charset=US-ASCII From: Joseph Koshy Date: Mon, 01 Mar 2010 17:26:36 -0000 Cc: Joseph Koshy , embedded@freebsd.org, fabient@freebsd.org Subject: Re: First cut at hwpmc support on MIPS X-BeenThere: freebsd-embedded@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Dedicated and Embedded Systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 01 Mar 2010 17:32:55 -0000 > FYI, latest patch is here: > > http://people.freebsd.org/~gnn/mipshwpmc_4.diff > > This should address all the issues identified. I ran a simple test of running ls > under each event in both system and process modes and that worked like a charm. These PMCs appear to have the ability to discriminate between 'USER', 'SUPER' and 'KERNEL' CPU modes, but the proposed code in libpmc does not allow a user to select one or more of these. [libpmc.c] +static int +mips24k_allocate_pmc(enum pmc_event pe, char *ctrspec __unused, + struct pmc_op_pmcallocate *pmc_config __unused) +{ + switch (pe) { + default: + break; + } + + return (0); +} If you wish to implement these qualifiers, function iaf_allocate_pmc() in libpmc.c would be useful as a template. If not, it would be prudent to add a sentence in the manual page so that users know exactly what is being measured. The patch looks fine otherwise. Nice work! Koshy From owner-freebsd-embedded@FreeBSD.ORG Tue Mar 2 07:48:41 2010 Return-Path: Delivered-To: embedded@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 25EB71065785; Tue, 2 Mar 2010 07:48:41 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (chello089077043238.chello.pl [89.77.43.238]) by mx1.freebsd.org (Postfix) with ESMTP id 6CB5A8FC13; Tue, 2 Mar 2010 07:48:40 +0000 (UTC) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 080A845EC0; Tue, 2 Mar 2010 08:17:44 +0100 (CET) Received: from localhost (chello089077043238.chello.pl [89.77.43.238]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id DFD084569A; Tue, 2 Mar 2010 08:17:38 +0100 (CET) Date: Tue, 2 Mar 2010 08:17:36 +0100 From: Pawel Jakub Dawidek To: Alexandr Rybalko Message-ID: <20100302071736.GF1946@garage.freebsd.pl> References: <20100219163644.da89e882.ray@dlink.ua> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="VuQYccsttdhdIfIP" Content-Disposition: inline In-Reply-To: <20100219163644.da89e882.ray@dlink.ua> User-Agent: Mutt/1.4.2.3i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 9.0-CURRENT i386 X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-0.6 required=4.5 tests=BAYES_00,RCVD_IN_SORBS_DUL autolearn=no version=3.0.4 Cc: geom@freebsd.org, embedded@freebsd.org, hackers@freebsd.org Subject: Re: GEOM_ULZMA X-BeenThere: freebsd-embedded@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Dedicated and Embedded Systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 02 Mar 2010 07:48:41 -0000 --VuQYccsttdhdIfIP Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Feb 19, 2010 at 04:36:44PM +0200, Alexandr Rybalko wrote: > Hi, > I wrote a module GEOM_ULZMA (such as GEOM_UZIP, but compression with lzma= ), [...] Wouldn't it be better to modify geom_uzip to be universal decompression class with various algorithms implemented as plugins? This is bascially what I did for the LABEL class - before we had VOL_FFS class only for UFS labels. > [...] in connection with this is an issue best left lzma > code in the file "geom_ulzma.c" or store lzma library separately. If sepa= rately, then where better? Definiatelly separately, not sure where. There is ongoing discussion somwhere on importing this algorithm to the base for tar(1) to use, it would be best to have only one copy of code in the tree. --=20 Pawel Jakub Dawidek http://www.wheelsystems.com pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --VuQYccsttdhdIfIP Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.14 (FreeBSD) iEYEARECAAYFAkuMu48ACgkQForvXbEpPzT9oACgxw5SguVaFp1a8cEysw98rXfM o6MAniVWtClI9kJ63gkJSoRPX0Hc/LGE =uCwV -----END PGP SIGNATURE----- --VuQYccsttdhdIfIP-- From owner-freebsd-embedded@FreeBSD.ORG Tue Mar 2 08:47:33 2010 Return-Path: Delivered-To: embedded@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5B2041065675; Tue, 2 Mar 2010 08:47:33 +0000 (UTC) (envelope-from ray@dlink.ua) Received: from dlink.ua (smtp.dlink.ua [193.138.187.146]) by mx1.freebsd.org (Postfix) with ESMTP id A52328FC0A; Tue, 2 Mar 2010 08:47:32 +0000 (UTC) Received: from gw ([192.168.10.10] helo=terran) by dlink.ua with esmtpsa (TLS-1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.63) (envelope-from ) id 1NmNiy-0005iQ-Mn; Tue, 02 Mar 2010 10:45:04 +0200 Date: Tue, 2 Mar 2010 10:47:48 +0200 From: Alexandr Rybalko To: Pawel Jakub Dawidek Message-Id: <20100302104748.0f27136c.ray@dlink.ua> In-Reply-To: <20100302071736.GF1946@garage.freebsd.pl> References: <20100219163644.da89e882.ray@dlink.ua> <20100302071736.GF1946@garage.freebsd.pl> Organization: D-Link X-Mailer: Sylpheed 2.7.1 (GTK+ 2.16.6; i386-portbld-freebsd8.0) Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Cc: geom@freebsd.org, embedded@freebsd.org, hackers@freebsd.org Subject: Re: GEOM_ULZMA X-BeenThere: freebsd-embedded@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Dedicated and Embedded Systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 02 Mar 2010 08:47:33 -0000 Hi, On Tue, 2 Mar 2010 08:17:36 +0100 Pawel Jakub Dawidek wrote: >> On Fri, Feb 19, 2010 at 04:36:44PM +0200, Alexandr Rybalko wrote: >> > Hi, >> > I wrote a module GEOM_ULZMA (such as GEOM_UZIP, but compression with lzma), [...] >> >> Wouldn't it be better to modify geom_uzip to be universal decompression >> class with various algorithms implemented as plugins? >> This is bascially what I did for the LABEL class - before we had VOL_FFS >> class only for UFS labels. Yes, you are right, but problem where in kernel code store LZMA code, and what to do with different versions of it? >> >> > [...] in connection with this is an issue best left lzma >> > code in the file "geom_ulzma.c" or store lzma library separately. If separately, then where better? >> >> Definiatelly separately, not sure where. There is ongoing discussion >> somwhere on importing this algorithm to the base for tar(1) to use, it >> would be best to have only one copy of code in the tree. I have already said, that it would be good for embedded platforms have only one copy of the code for the kernel and userland. It is not thought of how done it. >> >> -- >> Pawel Jakub Dawidek http://www.wheelsystems.com >> pjd@FreeBSD.org http://www.FreeBSD.org >> FreeBSD committer Am I Evil? Yes, I Am! -- Рыбалко Александр Консультант D-Link Украина From owner-freebsd-embedded@FreeBSD.ORG Tue Mar 2 19:32:18 2010 Return-Path: Delivered-To: embedded@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3191A106566B; Tue, 2 Mar 2010 19:32:18 +0000 (UTC) (envelope-from dimitry@andric.com) Received: from tensor.andric.com (cl-327.ede-01.nl.sixxs.net [IPv6:2001:7b8:2ff:146::2]) by mx1.freebsd.org (Postfix) with ESMTP id EB2C88FC13; Tue, 2 Mar 2010 19:32:17 +0000 (UTC) Received: from [IPv6:2001:7b8:3a7:0:3561:7d61:b408:b6c] (unknown [IPv6:2001:7b8:3a7:0:3561:7d61:b408:b6c]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by tensor.andric.com (Postfix) with ESMTPSA id 146CE5C43; Tue, 2 Mar 2010 20:32:16 +0100 (CET) Message-ID: <4B8D67C4.9050709@andric.com> Date: Tue, 02 Mar 2010 20:32:20 +0100 From: Dimitry Andric User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.9.2.2pre) Gecko/20100227 Lanikai/3.1b1pre MIME-Version: 1.0 To: Alexandr Rybalko References: <20100219163644.da89e882.ray@dlink.ua> <20100302071736.GF1946@garage.freebsd.pl> <20100302104748.0f27136c.ray@dlink.ua> In-Reply-To: <20100302104748.0f27136c.ray@dlink.ua> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Cc: hackers@freebsd.org, geom@freebsd.org, embedded@freebsd.org, Pawel Jakub Dawidek Subject: Re: GEOM_ULZMA X-BeenThere: freebsd-embedded@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Dedicated and Embedded Systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 02 Mar 2010 19:32:18 -0000 On 2010-03-02 09:47, Alexandr Rybalko wrote: >>> Definiatelly separately, not sure where. There is ongoing discussion >>> somwhere on importing this algorithm to the base for tar(1) to use, it >>> would be best to have only one copy of code in the tree. > I have already said, that it would be good for embedded platforms have only one copy of the code for the kernel and userland. > It is not thought of how done it. I think Pawel means the *source* code in this case, not the executable code. E.g. lzma source should most likely go under /usr/src/contrib, and be built separately for kernel and userland. From owner-freebsd-embedded@FreeBSD.ORG Tue Mar 2 21:58:26 2010 Return-Path: Delivered-To: embedded@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 65BE3106566C; Tue, 2 Mar 2010 21:58:26 +0000 (UTC) (envelope-from ray@ddteam.net) Received: from mail-fx0-f223.google.com (mail-fx0-f223.google.com [209.85.220.223]) by mx1.freebsd.org (Postfix) with ESMTP id A8B368FC08; Tue, 2 Mar 2010 21:58:25 +0000 (UTC) Received: by fxm23 with SMTP id 23so200279fxm.3 for ; Tue, 02 Mar 2010 13:58:22 -0800 (PST) Received: by 10.223.7.69 with SMTP id c5mr7380197fac.14.1267565769987; Tue, 02 Mar 2010 13:36:09 -0800 (PST) Received: from localhost (131-84-133-95.pool.ukrtel.net [95.133.84.131]) by mx.google.com with ESMTPS id 21sm7942573fks.53.2010.03.02.13.36.07 (version=SSLv3 cipher=RC4-MD5); Tue, 02 Mar 2010 13:36:08 -0800 (PST) Date: Tue, 2 Mar 2010 23:35:29 +0200 From: Alex RAY To: Dimitry Andric Message-Id: <20100302233529.77625a5a.ray@ddteam.net> In-Reply-To: <4B8D67C4.9050709@andric.com> References: <20100219163644.da89e882.ray@dlink.ua> <20100302071736.GF1946@garage.freebsd.pl> <20100302104748.0f27136c.ray@dlink.ua> <4B8D67C4.9050709@andric.com> Organization: DDTeam.net X-Mailer: Sylpheed 2.7.1 (GTK+ 2.16.6; i386-portbld-freebsd8.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: Alexandr Rybalko , geom@freebsd.org, embedded@freebsd.org, Pawel Jakub Dawidek , hackers@freebsd.org Subject: Re: GEOM_ULZMA X-BeenThere: freebsd-embedded@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Dedicated and Embedded Systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 02 Mar 2010 21:58:26 -0000 On Tue, 02 Mar 2010 20:32:20 +0100 Dimitry Andric wrote: > On 2010-03-02 09:47, Alexandr Rybalko wrote: > >>> Definiatelly separately, not sure where. There is ongoing discussion > >>> somwhere on importing this algorithm to the base for tar(1) to use, it > >>> would be best to have only one copy of code in the tree. > > I have already said, that it would be good for embedded platforms have only one copy of the code for the kernel and userland. > > It is not thought of how done it. > > I think Pawel means the *source* code in this case, not the executable > code. E.g. lzma source should most likely go under /usr/src/contrib, > and be built separately for kernel and userland. I understand. I'm trying to think about the future of FreeBSD in embedded. :) -- Alexandr Rybalko aka Alex RAY From owner-freebsd-embedded@FreeBSD.ORG Wed Mar 3 06:36:07 2010 Return-Path: Delivered-To: embedded@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 764B6106566C; Wed, 3 Mar 2010 06:36:07 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (chello089077043238.chello.pl [89.77.43.238]) by mx1.freebsd.org (Postfix) with ESMTP id B30558FC0A; Wed, 3 Mar 2010 06:36:05 +0000 (UTC) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id BA1F445EC0; Wed, 3 Mar 2010 07:36:03 +0100 (CET) Received: from localhost (chello089077043238.chello.pl [89.77.43.238]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 5E70445E90; Wed, 3 Mar 2010 07:35:58 +0100 (CET) Date: Wed, 3 Mar 2010 07:35:55 +0100 From: Pawel Jakub Dawidek To: Dimitry Andric Message-ID: <20100303063555.GA6992@garage.freebsd.pl> References: <20100219163644.da89e882.ray@dlink.ua> <20100302071736.GF1946@garage.freebsd.pl> <20100302104748.0f27136c.ray@dlink.ua> <4B8D67C4.9050709@andric.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="yrj/dFKFPuw6o+aM" Content-Disposition: inline In-Reply-To: <4B8D67C4.9050709@andric.com> User-Agent: Mutt/1.4.2.3i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 9.0-CURRENT i386 X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-0.6 required=4.5 tests=BAYES_00,RCVD_IN_SORBS_DUL autolearn=no version=3.0.4 Cc: Alexandr Rybalko , geom@freebsd.org, embedded@freebsd.org, hackers@freebsd.org Subject: Re: GEOM_ULZMA X-BeenThere: freebsd-embedded@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Dedicated and Embedded Systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 03 Mar 2010 06:36:07 -0000 --yrj/dFKFPuw6o+aM Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Mar 02, 2010 at 08:32:20PM +0100, Dimitry Andric wrote: > On 2010-03-02 09:47, Alexandr Rybalko wrote: > >>>Definiatelly separately, not sure where. There is ongoing discussion > >>>somwhere on importing this algorithm to the base for tar(1) to use, it > >>>would be best to have only one copy of code in the tree. > >I have already said, that it would be good for embedded platforms have= =20 > >only one copy of the code for the kernel and userland. > >It is not thought of how done it. >=20 > I think Pawel means the *source* code in this case, not the executable > code. E.g. lzma source should most likely go under /usr/src/contrib, > and be built separately for kernel and userland. If it is going to be used be the kernel it has to be under sys/. And yes, I was talking about one copy of the source, not executable. I think it would be bad idea to do compression in the kernel for userland applications for many reasons - the most important one is security. Look at projects like Capsicum where Robert closed for example gzip in a tight sandbox and gzip is not even set-uid and giving it chance to gain kernel access when bug is found is very, very bad. Another reason is performance. You can see how much faster, eg. openssl crypto is when doing it in userland and when forcing it to use software crypto from the opencrypto kernel framework. --=20 Pawel Jakub Dawidek http://www.wheelsystems.com pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --yrj/dFKFPuw6o+aM Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.14 (FreeBSD) iEYEARECAAYFAkuOA0sACgkQForvXbEpPzQAfgCgulguY4hsHTHm+bBtx6qje1dT 9hMAnj7bebI/ppgNMBHOhcs68Afp0poH =znag -----END PGP SIGNATURE----- --yrj/dFKFPuw6o+aM-- From owner-freebsd-embedded@FreeBSD.ORG Thu Mar 4 09:08:49 2010 Return-Path: Delivered-To: embedded@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5C04F106567D; Thu, 4 Mar 2010 09:08:49 +0000 (UTC) (envelope-from ray@dlink.ua) Received: from dlink.ua (smtp.dlink.ua [193.138.187.146]) by mx1.freebsd.org (Postfix) with ESMTP id 7808E8FC17; Thu, 4 Mar 2010 09:08:48 +0000 (UTC) Received: from gw ([192.168.10.10] helo=terran) by dlink.ua with esmtpsa (TLS-1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.63) (envelope-from ) id 1Nn70Z-0001mX-BK; Thu, 04 Mar 2010 11:06:15 +0200 Date: Thu, 4 Mar 2010 11:08:44 +0200 From: Alexandr Rybalko To: Pawel Jakub Dawidek Message-Id: <20100304110844.2e5c904b.ray@dlink.ua> In-Reply-To: <20100303063555.GA6992@garage.freebsd.pl> References: <20100219163644.da89e882.ray@dlink.ua> <20100302071736.GF1946@garage.freebsd.pl> <20100302104748.0f27136c.ray@dlink.ua> <4B8D67C4.9050709@andric.com> <20100303063555.GA6992@garage.freebsd.pl> Organization: D-Link X-Mailer: Sylpheed 2.7.1 (GTK+ 2.16.6; i386-portbld-freebsd8.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: embedded@freebsd.org, geom@freebsd.org, Dimitry Andric , hackers@freebsd.org Subject: Re: GEOM_ULZMA X-BeenThere: freebsd-embedded@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Dedicated and Embedded Systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 04 Mar 2010 09:08:49 -0000 On Wed, 3 Mar 2010 07:35:55 +0100 Pawel Jakub Dawidek wrote: >> On Tue, Mar 02, 2010 at 08:32:20PM +0100, Dimitry Andric wrote: >> > On 2010-03-02 09:47, Alexandr Rybalko wrote: >> > >>>Definiatelly separately, not sure where. There is ongoing discussion >> > >>>somwhere on importing this algorithm to the base for tar(1) to use, it >> > >>>would be best to have only one copy of code in the tree. >> > >I have already said, that it would be good for embedded platforms have >> > >only one copy of the code for the kernel and userland. >> > >It is not thought of how done it. >> > >> > I think Pawel means the *source* code in this case, not the executable >> > code. E.g. lzma source should most likely go under /usr/src/contrib, >> > and be built separately for kernel and userland. >> >> If it is going to be used be the kernel it has to be under sys/. >> >> And yes, I was talking about one copy of the source, not executable. >> I think it would be bad idea to do compression in the kernel for >> userland applications for many reasons - the most important one is >> security. Look at projects like Capsicum where Robert closed for example >> gzip in a tight sandbox and gzip is not even set-uid and giving it >> chance to gain kernel access when bug is found is very, very bad. >> Another reason is performance. You can see how much faster, eg. openssl >> crypto is when doing it in userland and when forcing it to use software >> crypto from the opencrypto kernel framework. Ok, already forgotten. Well, LZMA code is not so big, so will use two copies for kernel and for userland. It is possible to have number of different version of LZMA in kernel source tree? >> >> -- >> Pawel Jakub Dawidek http://www.wheelsystems.com >> pjd@FreeBSD.org http://www.FreeBSD.org >> FreeBSD committer Am I Evil? Yes, I Am! -- Alexandr Rybalko aka Alex RAY From owner-freebsd-embedded@FreeBSD.ORG Thu Mar 4 10:23:46 2010 Return-Path: Delivered-To: embedded@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 76731106564A; Thu, 4 Mar 2010 10:23:46 +0000 (UTC) (envelope-from lulf@pvv.ntnu.no) Received: from hylle01.itea.ntnu.no (hylle01.itea.ntnu.no [IPv6:2001:700:300:3::100]) by mx1.freebsd.org (Postfix) with ESMTP id C550E8FC13; Thu, 4 Mar 2010 10:23:45 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by hylle01.itea.ntnu.no (Postfix) with ESMTP id 7213031E01C; Thu, 4 Mar 2010 11:23:44 +0100 (CET) X-Virus-Scanned: Debian amavisd-new at hylle01.itea.ntnu.no Received: from nobby.geeknest.org (caracal.stud.ntnu.no [IPv6:2001:700:300:3::185]) by hylle01.itea.ntnu.no (Postfix) with ESMTP id C42B931E031; Thu, 4 Mar 2010 11:23:43 +0100 (CET) Date: Thu, 4 Mar 2010 11:21:59 +0100 From: Ulf Lilleengen To: Alexandr Rybalko Message-ID: <20100304102158.GA8092@nobby.geeknest.org> References: <20100219163644.da89e882.ray@dlink.ua> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20100219163644.da89e882.ray@dlink.ua> User-Agent: Mutt/1.5.20 (2009-06-14) Cc: geom@freebsd.org, embedded@freebsd.org, hackers@freebsd.org Subject: Re: GEOM_ULZMA X-BeenThere: freebsd-embedded@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Dedicated and Embedded Systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 04 Mar 2010 10:23:46 -0000 On Fri, Feb 19, 2010 at 04:36:44PM +0200, Alexandr Rybalko wrote: > Hi, > I wrote a module GEOM_ULZMA (such as GEOM_UZIP, but compression with lzma), in connection with this is an issue best left lzma > code in the file "geom_ulzma.c" or store lzma library separately. If separately, then where better? > > Maybe in future make lzma and gzip library kernel interface for embedded? > Then in one instance of code, userland can use compression via kernel. > What are the cons against combining uzip/ulzma into a geom_z/geom_compress module that can support different compression schemes? I think this makes more sense than having different geom modules for each compression scheme. -- Ulf Lilleengen From owner-freebsd-embedded@FreeBSD.ORG Thu Mar 4 11:39:51 2010 Return-Path: Delivered-To: embedded@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B3D76106564A; Thu, 4 Mar 2010 11:39:51 +0000 (UTC) (envelope-from ray@dlink.ua) Received: from dlink.ua (smtp.dlink.ua [193.138.187.146]) by mx1.freebsd.org (Postfix) with ESMTP id C566B8FC0A; Thu, 4 Mar 2010 11:39:50 +0000 (UTC) Received: from gw ([192.168.10.10] helo=terran) by dlink.ua with esmtpsa (TLS-1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.63) (envelope-from ) id 1Nn9Mj-000144-63; Thu, 04 Mar 2010 13:37:17 +0200 Date: Thu, 4 Mar 2010 13:39:47 +0200 From: Alexandr Rybalko To: Ulf Lilleengen Message-Id: <20100304133947.2fa4e66f.ray@dlink.ua> In-Reply-To: <20100304102158.GA8092@nobby.geeknest.org> References: <20100219163644.da89e882.ray@dlink.ua> <20100304102158.GA8092@nobby.geeknest.org> Organization: D-Link X-Mailer: Sylpheed 2.7.1 (GTK+ 2.16.6; i386-portbld-freebsd8.0) Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Cc: geom@freebsd.org, embedded@freebsd.org, hackers@freebsd.org Subject: Re: GEOM_ULZMA X-BeenThere: freebsd-embedded@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Dedicated and Embedded Systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 04 Mar 2010 11:39:51 -0000 On Thu, 4 Mar 2010 11:21:59 +0100 Ulf Lilleengen wrote: >> On Fri, Feb 19, 2010 at 04:36:44PM +0200, Alexandr Rybalko wrote: >> > Hi, >> > I wrote a module GEOM_ULZMA (such as GEOM_UZIP, but compression with lzma), in connection with this is an issue best left >> > lzma code in the file "geom_ulzma.c" or store lzma library separately. If separately, then where better? >> > >> > Maybe in future make lzma and gzip library kernel interface for embedded? >> > Then in one instance of code, userland can use compression via kernel. >> > >> >> What are the cons against combining uzip/ulzma into a geom_z/geom_compress >> module that can support different compression schemes? I think this makes >> more sense than having different geom modules for each compression scheme. I agree with you, since this modules need for reducing sizes, so user need configure what type they need. >> >> -- >> Ulf Lilleengen -- Рыбалко Александр Консультант D-Link Украина From owner-freebsd-embedded@FreeBSD.ORG Thu Mar 4 15:27:06 2010 Return-Path: Delivered-To: embedded@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7AD13106564A; Thu, 4 Mar 2010 15:27:06 +0000 (UTC) (envelope-from imp@bsdimp.com) Received: from harmony.bsdimp.com (bsdimp.com [199.45.160.85]) by mx1.freebsd.org (Postfix) with ESMTP id 3B7F58FC0A; Thu, 4 Mar 2010 15:27:06 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by harmony.bsdimp.com (8.14.3/8.14.1) with ESMTP id o24FIVup001243; Thu, 4 Mar 2010 08:18:32 -0700 (MST) (envelope-from imp@bsdimp.com) Date: Thu, 04 Mar 2010 08:18:48 -0700 (MST) Message-Id: <20100304.081848.200754750200144876.imp@bsdimp.com> To: lulf@pvv.ntnu.no From: "M. Warner Losh" In-Reply-To: <20100304102158.GA8092@nobby.geeknest.org> References: <20100219163644.da89e882.ray@dlink.ua> <20100304102158.GA8092@nobby.geeknest.org> X-Mailer: Mew version 6.3 on Emacs 22.3 / Mule 5.0 (SAKAKI) Mime-Version: 1.0 Content-Type: Text/Plain; charset=us-ascii Content-Transfer-Encoding: 7bit Cc: ray@dlink.ua, geom@freebsd.org, embedded@freebsd.org, hackers@freebsd.org Subject: Re: GEOM_ULZMA X-BeenThere: freebsd-embedded@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Dedicated and Embedded Systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 04 Mar 2010 15:27:06 -0000 In message: <20100304102158.GA8092@nobby.geeknest.org> Ulf Lilleengen writes: : On Fri, Feb 19, 2010 at 04:36:44PM +0200, Alexandr Rybalko wrote: : > Hi, : > I wrote a module GEOM_ULZMA (such as GEOM_UZIP, but compression with lzma), in connection with this is an issue best left lzma : > code in the file "geom_ulzma.c" or store lzma library separately. If separately, then where better? : > : > Maybe in future make lzma and gzip library kernel interface for embedded? : > Then in one instance of code, userland can use compression via kernel. : > : : What are the cons against combining uzip/ulzma into a geom_z/geom_compress : module that can support different compression schemes? I think this makes : more sense than having different geom modules for each compression scheme. Pros are it is easier to configure. Cons are it uses more memory and the code fights against the normal layering and abstraction by implementing things in two forks. Which one wins should likely be decided on size since this is for an embedded environment. Warner