[CASSANDRA-16400] cqlsh cannot DESC TYPE with non-ascii character in the identifier

• Type: Bug
• Status: Resolved
• Priority: Normal
• Resolution: Fixed
• Fix Version/s: 4.0-rc2, 4.0
• Component/s: Tool/cqlsh
• Bug Category: Availability - Unavailable
• Severity: Low
• Complexity: Low Hanging Fruit
• Discovered By: User Report
• Platform: All
• Since Version: 4.0-alpha1

Source Control Link

https://github.com/apache/cassandra/commit/0301fc6cea733b939066d197effa611a41bb787b

Test and Documentation Plan

unit test expanded

• Assignee: Adam Holmberg
• Reporter: Adam Holmberg

Authors

Adam Holmberg

Reviewers

Brandon Williams, Ekaterina Dimitrova

• Created: 22/Jan/21 19:06
• Updated: 17/May/21 19:57
• Resolved: 17/May/21 19:57

Description

cqlsh fails to describe types with non-ascii characters. This is specific to Python 2 and does not occur in Python 3 (only tested on trunk so far).

CREATE TYPE ks."ࠑ " (
    v int
);

aholmberg-rmbp16:cassandra adamholmberg$ pyenv shell 2.7.17
aholmberg-rmbp16:cassandra adamholmberg$ bin/cqlsh
Connected to Test Cluster at 127.0.0.1:9042.
[cqlsh 5.0.1 | Cassandra 4.0-beta4-SNAPSHOT | CQL spec 3.4.5 | Native protocol v4]
Use HELP for help.
cqlsh> desc types;
Traceback (most recent call last):
  File "/Users/adamholmberg/code/cassandra/bin/cqlsh.py", line 1391, in do_describe
    self.describe_list(result)
  File "/Users/adamholmberg/code/cassandra/bin/cqlsh.py", line 1438, in describe_list
    names.append(str(row['name']))
UnicodeEncodeError: 'ascii' codec can't encode character u'\u0811' in position 1: ordinal not in range(128)

3.11 appears to handle everything properly.

Issue Links

• depends upon: CASSANDRA-16539 cqlsh encoding error with unicode in multi-line statement