Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-11837

comments do not support unicode characters well.

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Duplicate
    • 0.13.1, 1.1.0
    • None
    • Hive
    • None
    • Hadoop 2.7
      Hive 0.13.1 / Hive 1.1.0
      RHEL 6.4 / SLES 11.3

    Description

      the terminal encoding is set to UTF-8, It can display Chinese characters.

      then I create a table with a comment in Chinese, both "show create table" and "desc formatted table" can not display the Chinese characters in the table comments, meanwhile it can display Chinese characters in column comment.. See below:

      0: jdbc:hive2://ha-cluster/default> create table tt(id int comment '列中文测试') comment '表中文测试';
      No rows affected (0.152 seconds)
      0: jdbc:hive2://ha-cluster/default>
      0: jdbc:hive2://ha-cluster/default>
      0: jdbc:hive2://ha-cluster/default> desc formatted tt;
      -------------------------------------------------------------------------------------------------------------------

      col_name data_type comment

      -------------------------------------------------------------------------------------------------------------------

      1. col_name
      data_type comment
        NULL NULL
      id int 列中文测试
        NULL NULL
      1. Detailed Table Information
      NULL NULL
      Database: default NULL
      Owner: admin NULL
      CreateTime: Wed Sep 16 11:13:34 CST 2015 NULL
      LastAccessTime: UNKNOWN NULL
      Protect Mode: None NULL
      Retention: 0 NULL
      Location: hdfs://hacluster/user/hive/warehouse/tt NULL
      Table Type: MANAGED_TABLE NULL
      Table Parameters: NULL NULL
        comment \u8868\u4E2D\u6587\u6D4B\u8BD5
        transient_lastDdlTime 1442373214
        NULL NULL
      1. Storage Information
      NULL NULL
      SerDe Library: org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe NULL
      InputFormat: org.apache.hadoop.hive.ql.io.RCFileInputFormat NULL
      OutputFormat: org.apache.hadoop.hive.ql.io.RCFileOutputFormat NULL
      Compressed: No NULL
      Num Buckets: -1 NULL
      Bucket Columns: [] NULL
      Sort Columns: [] NULL
      Storage Desc Params: NULL NULL
        serialization.format 1

      -------------------------------------------------------------------------------------------------------------------
      27 rows selected (0.172 seconds)
      0: jdbc:hive2://ha-cluster/default> show create table tt;
      ------------------------------------------------------------

      createtab_stmt

      ------------------------------------------------------------

      CREATE TABLE `tt`(
      `id` int COMMENT '-�K�')
      COMMENT 'h-�K�'
      ROW FORMAT SERDE
      'org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe'
      STORED AS INPUTFORMAT
      'org.apache.hadoop.hive.ql.io.RCFileInputFormat'
      OUTPUTFORMAT
      'org.apache.hadoop.hive.ql.io.RCFileOutputFormat'
      LOCATION
      'hdfs://hacluster/user/hive/warehouse/tt'
      TBLPROPERTIES (
      'transient_lastDdlTime'='1442373214')

      ------------------------------------------------------------
      13 rows selected (0.129 seconds)
      0: jdbc:hive2://ha-cluster/default>

      Attachments

        1. HIVE-11837.patch
          1 kB
          Rudd Chen
        2. HIVE-11837.1.patch
          1 kB
          Yongzhi Chen

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            LueChen Rudd Chen Assign to me
            LueChen Rudd Chen
            Votes:
            1 Vote for this issue
            Watchers:
            11 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment