[HIVE-24181] Hive bug prevents allowed characters in nested column

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.3.5
• Component/s: Hive
• Assignee: Unassigned
• Reporter: Jainik Vora
• Created: 18/Sep/20 17:24
• Updated: 18/Sep/20 17:24

Description

Hive allows any unicode character in column name when specified within backtick (`). But this behavior didn’t work for a nested column containing hyphen which points to a possible bug in hive DDL parsing logic.

 

Special characters at first level column works fine

 CREATE EXTERNAL TABLE test_dwh.sample_parquet_table (
  `user-agent`: string,     -- first level column with “-” works
  `context` struct<
        `os`: struct<
            `name`: string,
            `version`: string
            >
    >
) PARTITIONED BY (day string)
STORED as PARQUET
LOCATION 's3://xxx/tmp/sample_data/events'
 

 

Special characters in nested column throws error

 

CREATE EXTERNAL TABLE test_dwh.sample_parquet_table (
  `context` struct<
        `os`: struct<
            `name`: string,
            `version`: string,
            `is-test`: string  -- nested column with “-” throws error
            >
    >
) PARTITIONED BY (day string)
STORED as PARQUET
LOCATION 's3://xxx/tmp/sample_data/events' 

 

FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. java.lang.IllegalArgumentException: Error: : expected at the position 46 of 'struct<os:struct<name:string,version:string,is-test:string>>' but '-' is found.