From owner-freebsd-hackers@FreeBSD.ORG Fri May 8 05:28:40 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4B3AD106566B for ; Fri, 8 May 2009 05:28:40 +0000 (UTC) (envelope-from buganini@gmail.com) Received: from yw-out-2324.google.com (yw-out-2324.google.com [74.125.46.29]) by mx1.freebsd.org (Postfix) with ESMTP id F15E58FC22 for ; Fri, 8 May 2009 05:28:39 +0000 (UTC) (envelope-from buganini@gmail.com) Received: by yw-out-2324.google.com with SMTP id 9so728883ywe.13 for ; Thu, 07 May 2009 22:28:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=0yQ28qmXTsJgl9kobptOINsnXo4oVy7wb1Mr9sqP84k=; b=vTgtlNoWG542Ccs/JvNlJnkmUwy3L3+6LYJLf58GQAqZAVWhj/mBiq0y+NYqCtbQ/y QXgY9PPlCvXOTKH/98MEUgMQQ0b/zackODk+ujU4cPamlf8NVOSQj03hFV8JXmuSZ7r0 hFO0AexT+1B5tmte//YUynqOkiauEZsTLo4jc= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=A1WyFczF7Rp3TdDfjTPtqOlqA7jTalnhKA5zBRvtOZGNICqZxxGS/J6eNsqHGA5R86 qPa/z3n+347rHrqYg35NRcTieECXAn9mFQzPolrJw45WOIZsnuEBysndSOlyfEvKkuxQ NPn0/U93QLthGjX2JZw0uE1ji/lcRXZZspZnQ= MIME-Version: 1.0 Received: by 10.100.47.10 with SMTP id u10mr7493313anu.17.1241758877442; Thu, 07 May 2009 22:01:17 -0700 (PDT) In-Reply-To: <20090506162247.GA23015@britannica.bec.de> References: <20090427183836.GA10793@zim.MIT.EDU> <20090427193326.GA7654@britannica.bec.de> <20090427194904.GA11137@zim.MIT.EDU> <49F6C7A1.6070708@FreeBSD.org> <20090428122225.GA2862@britannica.bec.de> <24e9a86bf5995ba551db8f27aa204191.squirrel@webmail.kovesdan.org> <20090428180624.GA2223@britannica.bec.de> <4A00B897.809@FreeBSD.org> <3cb459ed0905060328n4ad05d98xb5ba0c2e01d356e2@mail.gmail.com> <20090506162247.GA23015@britannica.bec.de> Date: Fri, 8 May 2009 13:01:17 +0800 Message-ID: From: Buganini To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Subject: Re: SoC 2009: BSD-licensed libiconv in base system X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 08 May 2009 05:28:41 -0000 Hi all, I'm also working on a BSDL charset converter library: http://github.com/buganini/bsdconv/ It's *NOT* compatible with iconv. It try to provide more function, including fallback charset, intermediary mapping. Intermediary mapping could be used to do conversion between Traditional/Simplified Chinese, CRLF/CR/LF, etc. Currently iconv can only convert Chinese from/to big5/gb2312, it can't convert Chinese in unicode data. Unicode is prefixed with 0x01 in internal encoding. Therefore charsets like CNS11643, which has symbols not in UNICODE can use other prefix. It's in early developement, supporting few charset by now. Buganini