From jin@spode.pacbell.net  Mon Dec 11 18:59:28 2000
Return-Path: <jin@spode.pacbell.net>
Received: from spode.pacbell.net (adsl-63-198-35-122.dsl.snfc21.pacbell.net [63.198.35.122])
	by hub.freebsd.org (Postfix) with ESMTP id E2D6D37B400
	for <FreeBSD-gnats-submit@freebsd.org>; Mon, 11 Dec 2000 18:59:27 -0800 (PST)
Received: (from jin@localhost)
	by spode.pacbell.net (8.11.1/8.11.1) id eBC31Om01400;
	Mon, 11 Dec 2000 19:01:24 -0800 (PST)
	(envelope-from jin)
Message-Id: <200012120301.eBC31Om01400@spode.pacbell.net>
Date: Mon, 11 Dec 2000 19:01:24 -0800 (PST)
From: "Jin Guojun[VFF]" <jin@spode.pacbell.net>
Reply-To: j_guojun@lbl.gov
To: FreeBSD-gnats-submit@freebsd.org
Subject: tcsh fails to do file completion on non-English characters
X-Send-Pr-Version: 3.2

>Number:         23489
>Category:       bin
>Synopsis:       tcsh fails to do file completion on non-English characters
>Confidential:   no
>Severity:       serious
>Priority:       high
>Responsible:    freebsd-bugs
>State:          closed
>Quarter:        
>Keywords:       
>Date-Required:  
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Mon Dec 11 19:00:00 PST 2000
>Closed-Date:    Sun Jul 07 09:30:27 PDT 2002
>Last-Modified:  Thu Jul 11 11:10:08 PDT 2002
>Originator:     Jin Guojun[VFF]
>Release:        FreeBSD 4.2-RELEASE i386
>Organization:
>Environment:

	FreeBSD 4.2-RELEASE

>Description:

	tcsh fails to do the file completion on Chinese characters.
	This is discovered in the cxterm.
	It also fails to accept the cut and paste in cxterm, so there
	is no way to input Chinese command in cxterm/xterm.

>How-To-Repeat:

	open cxterm and try to type any Chinese charater, or cut and paste
	any Chinese character.

>Fix:

	A temp solution is to compile a real csh from 3.5.1-RELEASE, and
	to replace the fake csh (move it back to tcsh) for work-around.


>Release-Note:
>Audit-Trail:

From: Jonathan Chen <jon@spock.org>
To: freebsd-gnats-submit@FreeBSD.org, j_guojun@lbl.gov
Cc:  
Subject: Re: bin/23489: tcsh fails to do file completion on non-English characters
Date: Sat, 6 Jul 2002 03:56:43 -0400

 -----BEGIN PGP SIGNED MESSAGE-----
 Hash: SHA1
 
 I cannot reproduce this on my 4.6 -STABLE system:
 
 cxterm
 
 setenv LANG zh_TW.Big5
 setenv LC_ALL zh_TW.Big5
 
 touch aa<chinese><chinese>  <-- works
 touch aa<tab>		    <-- works
 touch <paste>		    <-- works
 
 Let me know if this is still a problem for you.
 
 - -Jon
 -----BEGIN PGP SIGNATURE-----
 Version: GnuPG v1.0.6 (FreeBSD)
 Comment: For info see http://www.gnupg.org
 
 iEUEARECAAYFAj0moroACgkQwvyGqiU5RosGjQCY+fO4sqv+4Zv0dm8qwy2xG6r0
 EgCfW8VuyFr6Bmam48UZzYZygfk5yBI=
 =HOyH
 -----END PGP SIGNATURE-----
State-Changed-From-To: open->closed 
State-Changed-By: mp 
State-Changed-When: Sun Jul 7 09:28:42 PDT 2002 
State-Changed-Why:  
This was fixed in the 4.6 release. 

http://www.freebsd.org/cgi/query-pr.cgi?pr=23489 

From: "Jin Guojun [DSD]" <j_guojun@lbl.gov>
To: Jonathan Chen <jon@spock.org>
Cc: freebsd-gnats-submit@FreeBSD.org
Subject: Re: bin/23489: tcsh fails to do file completion on non-English 
 characters
Date: Wed, 10 Jul 2002 12:11:27 -0700

 Jonathan Chen wrote:
 
 > -----BEGIN PGP SIGNED MESSAGE-----
 > Hash: SHA1
 >
 > I cannot reproduce this on my 4.6 -STABLE system:
 >
 > cxterm
 >
 > setenv LANG zh_TW.Big5
 > setenv LC_ALL zh_TW.Big5
 >
 > touch aa<chinese><chinese>  <-- works
 > touch aa<tab>               <-- works
 > touch <paste>               <-- works
 >
 > Let me know if this is still a problem for you.
 
 It is still a problem under 4.6. At prompt 115, what I did here is copy and
 paste.
 The tcsh does not know how to interpret the unicode. It decodes the first
 byte as some help flag, and put "." for rest characters.
 Notice that the file is in chinese, which is not shown properly on the screen.
 There is nothing shown on the first line of [115], but what happened here was
 pasting, which failed.
 
 -rw-------  1 html  advdev  26547 Dec 19  1998 վ.mid
 
 [115] : cat
 
 No help file for cat
 [115] : cat ....mid
 cat: ....mid: No such file or directory
 [116] : uname -sr
 FreeBSD 4.6-RELEASE
 
 
 --
 ------------ Jin Guojun ----------- v --- j_guojun@lbl.gov ---
 Distributed Systems Department          http://www.itg.lbl.gov/~jin
 M/S 50B-2239                            Ph#:(510) 486-7531 Fax: 486-6363
 Lawrence Berkeley National Laboratory,  Berkeley, CA 94720
 
 
 

From: Jonathan Chen <jon@spock.org>
To: "Jin Guojun [DSD]" <j_guojun@lbl.gov>
Cc: freebsd-gnats-submit@FreeBSD.org
Subject: Re: bin/23489: tcsh fails to do file completion on non-English characters
Date: Wed, 10 Jul 2002 15:44:59 -0400

 On Wed, Jul 10, 2002 at 12:11:27PM -0700, Jin Guojun [DSD] wrote:
 > It is still a problem under 4.6. At prompt 115, what I did here is copy and
 > paste.
 > The tcsh does not know how to interpret the unicode. It decodes the first
 > byte as some help flag, and put "." for rest characters.
 > Notice that the file is in chinese, which is not shown properly on the screen.
 > There is nothing shown on the first line of [115], but what happened here was
 > pasting, which failed.
 
 Could you let me know:
  - the value of your LANG environment variable
  - the value of your LC_ALL environment variable
  - the value of your LC_CTYPE environment variable
  - what program you were doing the cutting from
  - what version of cxterm you were using, and
  - what version of XFree86 you were using.
 
 -Jon

From: "Jin Guojun [DSD]" <j_guojun@lbl.gov>
To: Jonathan Chen <jon@spock.org>
Cc: freebsd-gnats-submit@FreeBSD.org
Subject: Re: bin/23489: tcsh fails to do file completion on non-English 
 characters
Date: Wed, 10 Jul 2002 13:43:08 -0700

 Jonathan Chen wrote:
 
 > On Wed, Jul 10, 2002 at 12:11:27PM -0700, Jin Guojun [DSD] wrote:
 > > It is still a problem under 4.6. At prompt 115, what I did here is copy and
 > > paste.
 > > The tcsh does not know how to interpret the unicode. It decodes the first
 > > byte as some help flag, and put "." for rest characters.
 > > Notice that the file is in chinese, which is not shown properly on the screen.
 > > There is nothing shown on the first line of [115], but what happened here was
 > > pasting, which failed.
 >
 > Could you let me know:
 >  - the value of your LANG environment variable
 >  - the value of your LC_ALL environment variable
 >  - the value of your LC_CTYPE environment variable
 >  - what program you were doing the cutting from
 >  - what version of cxterm you were using, and
 >  - what version of XFree86 you were using.
 >
 > -Jon
 
 zh-cxterm-5.0.3
 Information for zh-cxterm-5.0.3:
 cxterm is a xterm replacement with Chinese (Simple/GB and Complex/Big5)
 support.
 
 Tried on both XFree86 4.2.0_1,1 under FreeBSD 4.6 and 3.3.6 under FreeBSD 4.5
 None of these ENV was set.
 
 Two (2) problems:
 (1) Just simply use mouse to highlight the file name and paste into command line.
     This fails on both FreeBSD 4.5 and 4.6.
 (2) Chinese input mode --
     (2.1) under FreeBSD 4.5, it is able to locate the word, but it fails to upload
 the work onto
     command line. Uploading chinese character into a txst file opened by cvi works
 fine.
     (2.2) under FreeBSD 4.6, tcsh has the same problem. Furthermore, the cxterm has
 
     another bug, which only has two input modes F1 (ASCII) and F2 (internal code).
     F3 and F4 (spelling mode) are not funtioning, but this is not the tcsh problem.
 
 --
 ------------ Jin Guojun ----------- v --- j_guojun@lbl.gov ---
 Distributed Systems Department          http://www.itg.lbl.gov/~jin
 M/S 50B-2239                            Ph#:(510) 486-7531 Fax: 486-6363
 Lawrence Berkeley National Laboratory,  Berkeley, CA 94720
 
 
 

From: Jonathan Chen <jon@spock.org>
To: "Jin Guojun [DSD]" <j_guojun@lbl.gov>
Cc: freebsd-gnats-submit@FreeBSD.org
Subject: Re: bin/23489: tcsh fails to do file completion on non-English characters
Date: Thu, 11 Jul 2002 12:54:26 -0400

 On Wed, Jul 10, 2002 at 01:43:08PM -0700, Jin Guojun [DSD] wrote:
 > Tried on both XFree86 4.2.0_1,1 under FreeBSD 4.6 and 3.3.6 under FreeBSD 4.5
 > None of these ENV was set.
 
 I believe your problem was that none of the environment variables are set.  
 Without them set, tcsh won't know that the 8-bit half characters are valid, 
 and won't allow them.  I recommend setting both LANG and LC_ALL (in your rc 
 files if you like) to a chinese character set.  I use zh_TW.Big5 but you 
 can find out what other values are available by looking in 
 /usr/share/locale.
 
 Please try this and let me know if it works.
 
 -Jon

From: "Jin Guojun [NCS]" <j_guojun@lbl.gov>
To: Jonathan Chen <jon@spock.org>
Cc: freebsd-gnats-submit@FreeBSD.org
Subject: Re: bin/23489: tcsh fails to do file completion on non-English 
 characters
Date: Thu, 11 Jul 2002 11:10:39 -0700

 Jonathan Chen wrote:
 > 
 > On Wed, Jul 10, 2002 at 01:43:08PM -0700, Jin Guojun [DSD] wrote:
 > > Tried on both XFree86 4.2.0_1,1 under FreeBSD 4.6 and 3.3.6 under FreeBSD 4.5
 > > None of these ENV was set.
 > 
 > I believe your problem was that none of the environment variables are set.
 > Without them set, tcsh won't know that the 8-bit half characters are valid,
 > and won't allow them.  I recommend setting both LANG and LC_ALL (in your rc
 > files if you like) to a chinese character set.  I use zh_TW.Big5 but you
 > can find out what other values are available by looking in
 > /usr/share/locale.
 > 
 > Please try this and let me know if it works.
 > 
 > -Jon
 
 "setenv LANG" works at either before or after cxterm starts.
 "setenv LC_ALL" works only before cxterm starts.
 Both work under FreeBSD 4.6-RELEASE. They do not work under 4.5-RELEASE.
 
 This case can be closed, thanks.
 
 	-Jin
>Unformatted:
