[SPARK-7550] Support setting the right schema & serde when writing to Hive metastore

• Type: Sub-task
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.4.0
• Fix Version/s: 1.5.0
• Component/s: SQL
• Target Version/s: 1.5.0
• Sprint: Spark 1.5 release
• Assignee: Cheng Hao
• Reporter: Reynold Xin
• Shepherd: Cheng Lian
• Created: 12/May/15 00:05
• Updated: 12/Aug/15 05:32
• Resolved: 06/Aug/15 03:15

Description

As of 1.4, Spark SQL does not properly set the table schema and serde when writing a table to Hive's metastore. Would be great to do that properly so users can use non-Spark SQL systems to read those tables.

Issue Links

• contains: SPARK-6413 For data source tables, we should provide better output for DESCRIBE FORMATTED
• is duplicated by: SPARK-6923 Spark SQL CLI does not read Data Source schema correctly
• is related to: SPARK-6923 Spark SQL CLI does not read Data Source schema correctly
• links to: [Github] Pull Request #5733 (chenghao-intel)
• links to: [Github] Pull Request #6067 (rxin)
• links to: [Github] Pull Request #7967 (liancheng)
• links to: [Github] Pull Request #8021 (liancheng)