[HIVE-14531] Support deep nested struct for INSERT OVER DIRECTORY

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.2.0
• Component/s: Query Processor, Serializers/Deserializers
• Assignee: Wei Yan
• Reporter: Chao Sun
• Created: 12/Aug/16 21:11
• Updated: 07/Jan/18 18:52

Description

Currently if we do something similar to:

INSERT OVERWRITE DIRECTORY <dir> SELECT * FROM <table_with_deeply_nested_columns>

Then Hive may fail with error message like this:

Error: Error while compiling statement: FAILED: SemanticException org.apache.hadoop.hive.serde2.SerDeException: Number of levels of nesting supported for LazySimpleSerde is 7 Unable to work with level 8. Use hive.serialization.extend.nesting.levels serde property for tables using LazySimpleSerde. (state=42000,code=40000)

It seems there's no way to set serde properties in this case.