[SPARK-14776] Merge HiveSqlAstBuilder and SparkSqlAstBuilder

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Component/s: SQL
• Target Version/s: 2.0.0
• Assignee: Reynold Xin
• Reporter: Reynold Xin
• Created: 20/Apr/16 22:43
• Updated: 25/Apr/16 07:39
• Resolved: 25/Apr/16 07:39

Description

In Spark 2.0 we shouldn't have two parsers anymore. There should be only a single one.

Issue Links

• blocks: SPARK-14825 Merge functionality in Hive module into SQL core module

Sub-Tasks

• Remove TestHiveSparkSession.rewritePaths: Resolved
• Remove unused queries in hive module test resources: Resolved
• Create built-in functionality for variable substitution: Resolved
• Remove HiveSessionState.substitutor: Resolved
• Remove HiveConf dependency from HiveSqlAstBuilder: Resolved
• Move as many parsing rules as possible into SQL parser: Resolved
• Don't pass analyze command into Hive: Resolved
• Remove the use of Hive's variable substitution: Resolved
• Move native command and script transformation parsing into SparkSqlAstBuilder: Resolved
• Move MetastoreRelation to its own file: Resolved
• Remove MetastoreRelation dependency from AnalyzeTable: Resolved
• Move analyze table parsing into SparkSqlAstBuilder: Resolved
• Finally, merge HiveSqlAstBuilder and SparkSqlAstBuilder: Resolved
• When creating a CatalogColumn, we should use catalogString of a DataType: Resolved