[CASSANDRA-10948] CQLSH error when trying to insert non-ascii statement

• Type: Bug
• Status: Resolved
• Priority: Low
• Resolution: Fixed
• Fix Version/s: 2.2.5, 3.0.3, 3.3
• Component/s: Legacy/Tools
• Labels: lhf
• Severity: Low
• Assignee: Matthieu Nantern
• Reporter: Matthieu Nantern

Authors

Matthieu Nantern

Reviewers

Paulo Motta

• Created: 29/Dec/15 09:12
• Updated: 26/Jun/19 09:23
• Resolved: 22/Jan/16 15:10

Description

We recently upgraded Cassandra to v2.2.4 with CQLSH 5.0.1 and we are now unable to import some CQL file (with French character like 'ê'). It was working on v2.0.12.

The issue:

Using CQL driver: <module 'cassandra' from '/OPT/cassandra/dsc-cassandra-2.2.4/bin/../lib/cassandra-driver-internal-only-3.0.0-6af642d.zip/cassandra-driver-3.0.0-6af642d/cassandra/__init__.py'>
Using connect timeout: 5 seconds
Traceback (most recent call last):
  File "/OPT/cassandra/dsc-cassandra/bin/cqlsh.py", line 1110, in onecmd
    self.handle_statement(st, statementtext)
  File "/OPT/cassandra/dsc-cassandra/bin/cqlsh.py", line 1135, in handle_statement
    readline.add_history(new_hist)
UnicodeEncodeError: 'ascii' codec can't encode character u'\xea' in position 7192: ordinal not in range(128)

The issue was corrected by changing line 1135 of cqlsh.py (but I don't know if it's the correct way to do it):
readline.add_history(new_hist) -> readline.add_history(new_hist.encode('utf8'))