[HIVE-17049] hive doesn't support chinese comments for columns

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.2.1
• Component/s: CLI

Environment

hive 1.2.1 in HDP

• Assignee: Unassigned
• Reporter: liugaopeng
• Due: 31/Jul/17
• Created: 06/Jul/17 03:28
• Updated: 06/Jul/17 07:09

Description

1. alter table stg.test_chinese change chinesetitle chinesetitle tinyint comment '中文';
2. desc stg.test_chinese;
Result: chinese comment "中文" becase "??"

also, if i modify the comment via hive view, it will still display the messy code "??".

I did some testing, but cannot fix it, such as:
1. change the hive.COLUMNS_V2 to UTF-8 chartset.
2. append the characterEncoding=UTF-8 to hive_to_mysqlmetadata url

i found some ideas that need to apply some patch to fix it, but seems they all effects in 0.x version, i use the 1.2.1 version.

Please give some guidance.....