[HIVEMALL-88] Support a function to flatten a nested schema

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.5.0
• Labels: Spark
• Assignee: Takeshi Yamamuro
• Reporter: Takeshi Yamamuro
• Created: 08/Mar/17 15:04
• Updated: 09/Nov/17 03:33
• Resolved: 16/Mar/17 15:24

Description

Since parquet is first-citizen in Spark, most of users use nested schemas in DF. In some usecases, they need to flatten nested schemas into flat ones to dump data into the other systems that do not support nested schemas, e.g., RDBMS. So, it is useful to support conversion function from nested schemas to flat ones.

Issue Links

• links to: GitHub Pull Request #61