[CASSANDRA-9898] cqlsh crashes if it load a utf-8 file.

• Type: Bug
• Status: Resolved
• Priority: Low
• Resolution: Fixed
• Fix Version/s: 2.1.9, 2.2.1, 3.0 beta 2
• Component/s: Legacy/Tools
• Labels: cqlsh

Environment

linux, os x yosemite.

• Severity: Low
• Assignee: Yasuharu Goto
• Reporter: Yasuharu Goto

Authors

Yasuharu Goto

Reviewers

Carl Yeksigian

• Created: 24/Jul/15 17:47
• Updated: 16/Apr/19 09:31
• Resolved: 25/Aug/15 01:11

Description

cqlsh crashes when it load a cql script file encoded in utf-8.

This is a reproduction procedure.

$cat ./test.cql
// 日本語のコメント
use system;
select * from system.peers;

$cqlsh --version
cqlsh 5.0.1

$cqlsh -f ./test.cql
Traceback (most recent call last):
  File "./cqlsh", line 2459, in <module>
    main(*read_options(sys.argv[1:], os.environ))
  File "./cqlsh", line 2451, in main
    shell.cmdloop()
  File "./cqlsh", line 940, in cmdloop
    line = self.get_input_line(self.prompt)
  File "./cqlsh", line 909, in get_input_line
    self.lastcmd = self.stdin.readline()
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/codecs.py", line 675, in readline
    return self.reader.readline(size)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/codecs.py", line 530, in readline
    data = self.read(readsize, firstline=True)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/codecs.py", line 477, in read
    newchars, decodedbytes = self.decode(data, self.errors)
UnicodeDecodeError: 'ascii' codec can't decode byte 0xe6 in position 3: ordinal not in range(128)

Issue Links

• is duplicated by: CASSANDRA-9670 Cannot run CQL scripts on Windows AND having error Ubuntu Linux