[SPARK-9764] Spark SQL uses table metadata inconsistently

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.4.1
• Component/s: SQL
• Labels: hive sql

Environment

Ubuntu on AWS

• Assignee: Unassigned
• Reporter: Simeon Simeonov
• Created: 09/Aug/15 03:28
• Updated: 08/Oct/16 04:39
• Resolved: 08/Oct/16 04:39

Description

For the same table, DESCRIBE and SHOW COLUMNS produce different results. The former shows the correct column names. The latter always shows just a single column named col. This is true for any table created with HiveContext.read.json.

Issue Links

• relates to: SPARK-9342 Spark SQL views don't work
• relates to: SPARK-9761 Inconsistent metadata handling with ALTER TABLE
• relates to: SPARK-9762 ALTER TABLE cannot find column