[HIVE-99] serde fails when field name starts with underscore

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Duplicate
• Fix Version/s: 0.3.0
• Component/s: Serializers/Deserializers
• Assignee: Unassigned
• Reporter: Michi Mutsuzaki
• Created: 02/Dec/08 06:52
• Updated: 17/Dec/11 00:08
• Resolved: 02/Dec/08 19:02

Description

(Not sure if this is a metastore bug or serde bug)

For the query:

select count(1) from table

HiveInterface.getSchema() returns:

struct result

{ string _c0}

DynamicSerDe.initialize() raises a lexical error:

[junit] Lexical error at line 1, column 24. Encountered: "_" (95), after : ""
[junit] org.apache.hadoop.hive.serde2.dynamic_type.TokenMgrError: Lexical error at line 1, column 24. Encountered: "_" (95), after : ""
[junit] at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammarTokenManager.getNextToken(thrift_grammarTokenManager.java:1457)
[junit] at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.jj_consume_token(thrift_grammar.java:2233)
[junit] at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1547)
[junit] at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501)
[junit] at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171)
[junit] at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497)
[junit] at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439)

Issue Links

• blocks: HIVE-73 Thrift Server and Client for Hive