[SPARK-17452] Spark 2.0.0 is not supporting the "partition" keyword on a "describe" statement when using Hive Support

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 2.0.0
• Component/s: SQL

Environment

Amazon EMR 5.0.0

• Assignee: Unassigned
• Reporter: Hernan Vivani
• Created: 08/Sep/16 15:49
• Updated: 04/Oct/16 23:37
• Resolved: 04/Oct/16 23:37

Description

Changes introduced in Spark 2 are not supporting the "partition" keyword on a "describe" statement.

EMR 5 (Spark 2.0):
==================
scala> import org.apache.spark.sql.SparkSession
scala> val sess=SparkSession.builder().appName("test").enableHiveSupport().getOrCreate()

scala> sess.sql("describe formatted page_view partition (dt='2008-06-08', country='AR')").show
org.apache.spark.sql.catalyst.parser.ParseException:
Unsupported SQL statement
== SQL ==
describe formatted page_view partition (dt='2008-06-08', country='AR')
at org.apache.spark.sql.catalyst.parser.AbstractSqlParser$$anonfun$parsePlan$1.apply(ParseDriver.scala:58)
at org.apache.spark.sql.catalyst.parser.AbstractSqlParser$$anonfun$parsePlan$1.apply(ParseDriver.scala:53)
at org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parse(ParseDriver.scala:82)
at org.apache.spark.sql.execution.SparkSqlParser.parse(SparkSqlParser.scala:46)
at org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parsePlan(ParseDriver.scala:53)
at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:582)
... 48 elided

Same statement is working fine on Spark 1.6.2 and Spark 1.5.2.

Issue Links

• duplicates: SPARK-17612 Support `DESCRIBE table PARTITION` SQL syntax