From owner-freebsd-i18n Mon Nov 27 10:24:37 2000 Delivered-To: freebsd-i18n@freebsd.org Received: from mail.rpi.edu (mail.rpi.edu [128.113.100.7]) by hub.freebsd.org (Postfix) with ESMTP id 9B72637B479; Mon, 27 Nov 2000 10:24:27 -0800 (PST) Received: from [128.113.24.47] (gilead.acs.rpi.edu [128.113.24.47]) by mail.rpi.edu (8.9.3/8.9.3) with ESMTP id NAA362454; Mon, 27 Nov 2000 13:23:59 -0500 Mime-Version: 1.0 X-Sender: drosih@mail.rpi.edu Message-Id: In-Reply-To: <20001122123155.O18037@fw.wintelcom.net> References: <200011222034.MAA12121@screech.weirdnoise.com> <20001122123155.O18037@fw.wintelcom.net> Date: Mon, 27 Nov 2000 13:23:57 -0500 To: Alfred Perlstein , Ed Hall From: Garance A Drosihn Subject: Re: Standard wchar_t functions missing Cc: FreeBSD-questions@FreeBSD.ORG, FreeBSD-I18N@FreeBSD.ORG Content-Type: text/plain; charset="us-ascii" ; format="flowed" Sender: owner-freebsd-i18n@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.ORG At 12:31 PM -0800 11/22/00, Alfred Perlstein wrote: >* Ed Hall [001122 12:28] wrote: > > We have a senior developer at Yahoo! who is complaining > > about FreeBSD's lack of support for wchar_t. [...] > > > > Now, I've done a bit of digging in the FreeBSD archives, > > and discovered that Itojun and his group have announced > > that their support for wchar_t is ready for integration. > > This was a month ago--has there been any progress in > > getting this going? Anything I can do to speed the > > process? > >Give me a url to the patches? > >:) > >The funny thing is that over a year ago I could have sworn >I saw people almost completeing this project. I'm going to >dig around a bit and see what I can find. The thing you're remembering is probably David Cross (RPI) working on the wchar routines. I *think* that what Itojun has is David's code, plus some additional work. It would obviously be nice to get this in. Even if it is not complete, the longer we go without it the more likely someone is going to start from scratch because they won't be aware of the work which is already done but not committed. -- Garance Alistair Drosehn = gad@eclipse.acs.rpi.edu Senior Systems Programmer or gad@freebsd.org Rensselaer Polytechnic Institute or drosih@rpi.edu To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-i18n" in the body of the message From owner-freebsd-i18n Mon Nov 27 20:59: 1 2000 Delivered-To: freebsd-i18n@freebsd.org Received: from peorth.iteration.net (peorth.iteration.net [208.190.180.178]) by hub.freebsd.org (Postfix) with ESMTP id 3FCB137B479 for ; Mon, 27 Nov 2000 20:58:59 -0800 (PST) Received: by peorth.iteration.net (Postfix, from userid 1001) id A2FB957311; Mon, 27 Nov 2000 22:59:42 -0600 (CST) Date: Mon, 27 Nov 2000 22:59:42 -0600 From: "Michael C . Wu" To: itojun@netbsd.org Cc: freebsd-i18n@freebsd.org Subject: NetBSD libintl, import of CITRUS * Message-ID: <20001127225942.B558@peorth.iteration.net> Reply-To: "Michael C . Wu" Mail-Followup-To: "Michael C . Wu" , itojun@netbsd.org, freebsd-i18n@freebsd.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2.5i X-PGP-Fingerprint: 5025 F691 F943 8128 48A8 5025 77CE 29C5 8FA1 2E20 X-PGP-Key-ID: 0x8FA12E20 Sender: owner-freebsd-i18n@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.ORG Hi Itojun, I would like to produce a patchset for the latest NetBSD libintl changes ( BSDL gettext, etc.) and the CITRUS FreeBSD source tree this weekend. Do you have any objections or any suggestions? Are there any bugs or problems in the CITRUS code or the NetBSD libintl? Thank you, Michael -- +------------------------------------------------------------------+ | keichii@peorth.iteration.net | keichii@bsdconspiracy.net | | http://peorth.iteration.net/~keichii | Yes, BSD is a conspiracy. | +------------------------------------------------------------------+ To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-i18n" in the body of the message From owner-freebsd-i18n Mon Nov 27 21: 2:53 2000 Delivered-To: freebsd-i18n@freebsd.org Received: from coconut.itojun.org (coconut.itojun.org [210.160.95.97]) by hub.freebsd.org (Postfix) with ESMTP id D4F3E37B479 for ; Mon, 27 Nov 2000 21:02:50 -0800 (PST) Received: from kiwi.itojun.org (localhost.itojun.org [127.0.0.1]) by coconut.itojun.org (8.9.3+3.2W/3.7W) with ESMTP id OAA14604; Tue, 28 Nov 2000 14:02:26 +0900 (JST) To: "Michael C . Wu" Cc: freebsd-i18n@freebsd.org In-reply-to: keichii's message of Mon, 27 Nov 2000 22:59:42 CST. <20001127225942.B558@peorth.iteration.net> X-Template-Reply-To: itojun@itojun.org X-Template-Return-Receipt-To: itojun@itojun.org X-PGP-Fingerprint: F8 24 B4 2C 8C 98 57 FD 90 5F B4 60 79 54 16 E2 Subject: Re: NetBSD libintl, import of CITRUS * From: itojun@iijlab.net Date: Tue, 28 Nov 2000 14:02:26 +0900 Message-ID: <14602.975387746@coconut.itojun.org> Sender: owner-freebsd-i18n@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.ORG >I would like to produce a patchset for the latest NetBSD libintl >changes ( BSDL gettext, etc.) and the CITRUS FreeBSD source tree >this weekend. Do you have any objections or any suggestions? >Are there any bugs or problems in the CITRUS code or the NetBSD >libintl? i think it a bit early to integrate full citrus code, it may break exisitng applications if you do - you need to be really careful about endianness and some other stuffs. libintl (which is actually a part of citrus code) should be okay, but pls expect some updates, it's not finalized! to enjoy build-in libintl better, you need to update ports/devel/gettext and some interdependencies between ports too. itojun To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-i18n" in the body of the message From owner-freebsd-i18n Mon Nov 27 21:17:49 2000 Delivered-To: freebsd-i18n@freebsd.org Received: from peorth.iteration.net (peorth.iteration.net [208.190.180.178]) by hub.freebsd.org (Postfix) with ESMTP id EECAE37B4C5 for ; Mon, 27 Nov 2000 21:17:43 -0800 (PST) Received: by peorth.iteration.net (Postfix, from userid 1001) id 07C5B57311; Mon, 27 Nov 2000 23:18:27 -0600 (CST) Date: Mon, 27 Nov 2000 23:18:26 -0600 From: "Michael C . Wu" To: itojun@iijlab.net Cc: freebsd-i18n@freebsd.org Subject: Re: NetBSD libintl, import of CITRUS * Message-ID: <20001127231826.A7425@peorth.iteration.net> Reply-To: "Michael C . Wu" Mail-Followup-To: "Michael C . Wu" , itojun@iijlab.net, freebsd-i18n@freebsd.org References: <20001127225942.B558@peorth.iteration.net> <14602.975387746@coconut.itojun.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2.5i In-Reply-To: <14602.975387746@coconut.itojun.org>; from itojun@iijlab.net on Tue, Nov 28, 2000 at 02:02:26PM +0900 X-PGP-Fingerprint: 5025 F691 F943 8128 48A8 5025 77CE 29C5 8FA1 2E20 X-PGP-Key-ID: 0x8FA12E20 Sender: owner-freebsd-i18n@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.ORG On Tue, Nov 28, 2000 at 02:02:26PM +0900, itojun@iijlab.net scribbled: | >I would like to produce a patchset for the latest NetBSD libintl | >changes ( BSDL gettext, etc.) and the CITRUS FreeBSD source tree | >this weekend. Do you have any objections or any suggestions? | >Are there any bugs or problems in the CITRUS code or the NetBSD | >libintl? | i think it a bit early to integrate full citrus code, it may break | exisitng applications if you do - you need to be really careful about | endianness and some other stuffs. | | libintl (which is actually a part of citrus code) should be okay, but | pls expect some updates, it's not finalized! | to enjoy build-in libintl better, you need to update | ports/devel/gettext and some interdependencies between ports too. Hi Itojun, How about just libc and includes? (i.e. wchar.h and related stuff) Regarding BSDL gettext, is it "finalized?" Thanks, -- +------------------------------------------------------------------+ | keichii@peorth.iteration.net | keichii@bsdconspiracy.net | | http://peorth.iteration.net/~keichii | Yes, BSD is a conspiracy. | +------------------------------------------------------------------+ To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-i18n" in the body of the message From owner-freebsd-i18n Mon Nov 27 21:27:13 2000 Delivered-To: freebsd-i18n@freebsd.org Received: from coconut.itojun.org (coconut.itojun.org [210.160.95.97]) by hub.freebsd.org (Postfix) with ESMTP id 4EB1137B4F9 for ; Mon, 27 Nov 2000 21:27:10 -0800 (PST) Received: from kiwi.itojun.org (localhost.itojun.org [127.0.0.1]) by coconut.itojun.org (8.9.3+3.2W/3.7W) with ESMTP id OAA14894; Tue, 28 Nov 2000 14:26:57 +0900 (JST) To: "Michael C . Wu" Cc: freebsd-i18n@freebsd.org In-reply-to: keichii's message of Mon, 27 Nov 2000 23:18:26 CST. <20001127231826.A7425@peorth.iteration.net> X-Template-Reply-To: itojun@itojun.org X-Template-Return-Receipt-To: itojun@itojun.org X-PGP-Fingerprint: F8 24 B4 2C 8C 98 57 FD 90 5F B4 60 79 54 16 E2 Subject: Re: NetBSD libintl, import of CITRUS * From: itojun@iijlab.net Date: Tue, 28 Nov 2000 14:26:57 +0900 Message-ID: <14892.975389217@coconut.itojun.org> Sender: owner-freebsd-i18n@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.ORG >How about just libc and includes? (i.e. wchar.h and related stuff) that is a bit early to integrate libc locale (LC_CTYPE) part. i won't stop you, but it will be a major amount of work, regarding to backward compatibility issues - i'm not 100% sure about freebsd binary backward compatibility requirement between releases, but it won't be pretty if you break existing binaries. you just need to be careful. also, we need a better integration with other locale handlers (LC_COLLATE, LC_TIME and others), and CITRUS-friendly iconv(3). >Regarding BSDL gettext, is it "finalized?" not really. libintl (gettext) works just like GNU gettext, so it works as GNU gettext replacement. however, our goal is much more complete system - we don't want to hardcode our library to certain locale. current gettext library (both GNU and CITRUS) assumes that you are using single encoding for setlocale(3) and the message catalog file. for example, if your $LANG equals to ko_KR.eucKR, message catalog file must be encoded in euc-kr. we would like to make them more independent (like allowing ksc5601 catalog file). look for /*XXX*/ comments in libintl source code. itojun To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-i18n" in the body of the message From owner-freebsd-i18n Tue Nov 28 2:13:55 2000 Delivered-To: freebsd-i18n@freebsd.org Received: from alpha.dante.org.uk (alpha.dante.org.uk [193.63.211.19]) by hub.freebsd.org (Postfix) with ESMTP id 19A9B37B402 for ; Tue, 28 Nov 2000 02:13:52 -0800 (PST) Received: from theta.dante.org.uk ([193.63.211.7]) by alpha.dante.org.uk with esmtp (Exim 3.12 #4) id 140hl1-0000QL-00; Tue, 28 Nov 2000 10:13:03 +0000 Received: from localhost ([127.0.0.1] helo=dante.org.uk) by theta.dante.org.uk with esmtp (Exim 3.12 #4) id 140hkw-0001AL-00; Tue, 28 Nov 2000 10:12:58 +0000 Message-ID: <3A23852A.F27190F8@dante.org.uk> Date: Tue, 28 Nov 2000 10:12:58 +0000 From: Konstantin Chuguev Organization: Delivery of Advanced Networking Technology to Europe Ltd. X-Mailer: Mozilla 4.75 [en] (X11; U; SunOS 5.6 sun4u) X-Accept-Language: en, ru MIME-Version: 1.0 To: itojun@iijlab.net Cc: "Michael C . Wu" , freebsd-i18n@freebsd.org Subject: Re: NetBSD libintl, import of CITRUS * References: <14892.975389217@coconut.itojun.org> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Sender: owner-freebsd-i18n@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.ORG Hi All, itojun@iijlab.net wrote: > >Regarding BSDL gettext, is it "finalized?" > > not really. libintl (gettext) works just like GNU gettext, so it works > as GNU gettext replacement. however, our goal is much more complete > system - we don't want to hardcode our library to certain locale. > current gettext library (both GNU and CITRUS) assumes that you are > using single encoding for setlocale(3) and the message catalog file. > for example, if your $LANG equals to ko_KR.eucKR, message catalog file > must be encoded in euc-kr. we would like to make them more independent > (like allowing ksc5601 catalog file). > Just for your information. iconv-2.0 is ready. It works fine on my home computer. I'll submit 3 new ports (iconv, iconv-extra, iconv-rfc-1345) tonight. Major differences of the previous (1.1) version are: * use of binary files for table-driven charsets (shared modules are still used for Unicode and EUC); table files are mmap'ped; * the ability to built in both tables and modules into the library by listing corresponding charsets in a make environment variable at compilation time; all modules are included into the static library; * use of the aliases file (text/plain) instead of symbolic links; the advantages are much smaller amount of files in pkg-plist and the ability (not tested though) to compile the port on FreeBSD < 4; aliases for built-in charsets are built in into the library automatically. Given all the above, I hope, iconv is ready to be included to the distribution, either as a standalone library, or into libc. No code for kernel yet, but it should not be a problem. If iconv is included into libc, it is perfectly possible to expose a few internal functions for use by libintl/CITRUS, such as reading/writing strings in a particular charses using Unicode (UCS-4) characters one by one, or even accessing charset conversion tables etc... I don't think it is good using such functions from client applications, as they are not standardised, and the applications won't be able to work with other iconv implementations. Well, and one drawback I've decided to go for. The shared library version has been raised to 2, mostly because of incompatible changes in CES module structure. Although for client software the API remains the same, for building charset modules everything has been changed. As a result, you will need to keep the old libiconv.so.1 until you recompile all ports using iconv (about 15, mostly GNOME). I will ask to raise PORTREVISION numbers of the corresponding ports when I submit iconv. Regards, Konstantin. -- * * Konstantin Chuguev - Application Engineer * * Francis House, 112 Hills Road * Cambridge CB2 1PQ, United Kingdom D A N T E WWW: http://www.dante.net To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-i18n" in the body of the message From owner-freebsd-i18n Tue Nov 28 3:56:48 2000 Delivered-To: freebsd-i18n@freebsd.org Received: from daemon.kr.freebsd.org (unknown [211.176.62.31]) by hub.freebsd.org (Postfix) with ESMTP id C604137B400 for ; Tue, 28 Nov 2000 03:56:44 -0800 (PST) Received: from gnomaniac.myhome (adsl-dongjak-210205033222.usr2.hananet.net [210.205.33.222]) by daemon.kr.freebsd.org (8.11.0/8.11.0) with ESMTP id eASBxh766250; Tue, 28 Nov 2000 20:59:43 +0900 (KST) (envelope-from cjh@kr.FreeBSD.org) Received: (from cjh@localhost) by gnomaniac.myhome (8.11.1/8.11.1) id eASBseT34095; Tue, 28 Nov 2000 20:54:40 +0900 (KST) (envelope-from cjh@kr.FreeBSD.org) X-Authentication-Warning: gnomaniac.myhome: cjh set sender to cjh@kr.FreeBSD.org using -f To: itojun@iijlab.net Cc: "Michael C . Wu" , freebsd-i18n@FreeBSD.ORG Subject: Re: NetBSD libintl, import of CITRUS * References: <14892.975389217@coconut.itojun.org> From: CHOI Junho Date: 28 Nov 2000 20:54:40 +0900 In-Reply-To: itojun@iijlab.net's message of "Tue, 28 Nov 2000 14:26:57 +0900" Message-ID: <86elzwtipr.fsf@gnomaniac.myhome> Lines: 32 User-Agent: Gnus/5.0807 (Gnus v5.8.7) Emacs/20.7 MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Sender: owner-freebsd-i18n@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.ORG >>>>> "i" == itojun writes: > Regarding BSDL gettext, is it "finalized?" i> not really. libintl (gettext) works just like GNU gettext, so it works i> as GNU gettext replacement. however, our goal is much more complete i> system - we don't want to hardcode our library to certain locale. i> current gettext library (both GNU and CITRUS) assumes that you are i> using single encoding for setlocale(3) and the message catalog file. i> for example, if your $LANG equals to ko_KR.eucKR, message catalog file i> must be encoded in euc-kr. we would like to make them more independent In recent glibc(2.2), it converts its encoding according to LC_CTYPE LC_CTYPE=ko_KR LC_MESSAGES=ja_JP foo foo: Although it is not complete(euc-jp != euc-kr) but at least Kana and some Kanji existing in euc-kr will be shown(maybe glibc does euc-jp -> UCS4 -> euc-kr conversion). I don't know internals of citrus code, but can we do this? i> (like allowing ksc5601 catalog file). ksx1001(ksc5601) is CCS... we may have euc-kr or utf-8 for Korean catalog. -- +++ Any opinions in this posting are my own and not those of my employers +++ CHOI Junho [now sleeping] [when sleeping] Korea FreeBSD Users Group/www.kr.FreeBSD.org Web Data Bank/www.wdb.co.kr To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-i18n" in the body of the message From owner-freebsd-i18n Tue Nov 28 4: 2:57 2000 Delivered-To: freebsd-i18n@freebsd.org Received: from coconut.itojun.org (coconut.itojun.org [210.160.95.97]) by hub.freebsd.org (Postfix) with ESMTP id 8739537B400 for ; Tue, 28 Nov 2000 04:02:53 -0800 (PST) Received: from kiwi.itojun.org (localhost.itojun.org [127.0.0.1]) by coconut.itojun.org (8.9.3+3.2W/3.7W) with ESMTP id VAA19815; Tue, 28 Nov 2000 21:01:51 +0900 (JST) To: CHOI Junho Cc: "Michael C . Wu" , freebsd-i18n@FreeBSD.ORG In-reply-to: cjh's message of 28 Nov 2000 20:54:40 JST. <86elzwtipr.fsf@gnomaniac.myhome> X-Template-Reply-To: itojun@itojun.org X-Template-Return-Receipt-To: itojun@itojun.org X-PGP-Fingerprint: F8 24 B4 2C 8C 98 57 FD 90 5F B4 60 79 54 16 E2 Subject: Re: NetBSD libintl, import of CITRUS * From: itojun@iijlab.net Date: Tue, 28 Nov 2000 21:01:51 +0900 Message-ID: <19813.975412911@coconut.itojun.org> Sender: owner-freebsd-i18n@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.ORG >In recent glibc(2.2), it converts its encoding according to LC_CTYPE > LC_CTYPE=ko_KR LC_MESSAGES=ja_JP foo > foo: >Although it is not complete(euc-jp != euc-kr) but at least Kana and >some Kanji existing in euc-kr will be shown(maybe glibc does euc-jp -> >UCS4 -> euc-kr conversion). in the above case i believe we should bail, but anyway, it's good to know. >I don't know internals of citrus code, but can we do this? yes, the above behavior is needed for citrus gettext(3). we know the place where we need to call iconv(3) from within gettext(3), we have a /* XXX */ there. > i> (like allowing ksc5601 catalog file). >ksx1001(ksc5601) is CCS... we may have euc-kr or utf-8 for Korean catalog. oops, iso-2022-kr (RFC1557). itojun To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-i18n" in the body of the message From owner-freebsd-i18n Tue Nov 28 4:10:48 2000 Delivered-To: freebsd-i18n@freebsd.org Received: from daemon.kr.freebsd.org (unknown [211.176.62.31]) by hub.freebsd.org (Postfix) with ESMTP id 8A90A37B402 for ; Tue, 28 Nov 2000 04:10:45 -0800 (PST) Received: from gnomaniac.myhome (adsl-dongjak-210205033222.usr2.hananet.net [210.205.33.222]) by daemon.kr.freebsd.org (8.11.0/8.11.0) with ESMTP id eASCDu767264; Tue, 28 Nov 2000 21:13:56 +0900 (KST) (envelope-from cjh@kr.FreeBSD.org) Received: (from cjh@localhost) by gnomaniac.myhome (8.11.1/8.11.1) id eASC8t935269; Tue, 28 Nov 2000 21:08:55 +0900 (KST) (envelope-from cjh@kr.FreeBSD.org) X-Authentication-Warning: gnomaniac.myhome: cjh set sender to cjh@kr.FreeBSD.org using -f To: itojun@iijlab.net Cc: "Michael C . Wu" , freebsd-i18n@FreeBSD.ORG Subject: Re: NetBSD libintl, import of CITRUS * References: <19813.975412911@coconut.itojun.org> From: CHOI Junho Date: 28 Nov 2000 21:08:54 +0900 In-Reply-To: itojun@iijlab.net's message of "Tue, 28 Nov 2000 21:01:51 +0900" Message-ID: <86snocs3hl.fsf@gnomaniac.myhome> Lines: 15 User-Agent: Gnus/5.0807 (Gnus v5.8.7) Emacs/20.7 MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Sender: owner-freebsd-i18n@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.ORG >>>>> "i" == itojun writes: > (like allowing ksc5601 catalog file). > ksx1001(ksc5601) is CCS... we may have euc-kr or utf-8 for Korean catalog. i> oops, iso-2022-kr (RFC1557). iso-2022-kr is not used in Korea anymore. We just use euc-kr in any case(text, mail, news, webpages, etc...) -- +++ Any opinions in this posting are my own and not those of my employers +++ CHOI Junho [now sleeping] [when sleeping] Korea FreeBSD Users Group/www.kr.FreeBSD.org Web Data Bank/www.wdb.co.kr To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-i18n" in the body of the message