[SPARK-27266] Support ANALYZE TABLE to collect tables stats for cached catalog views

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0
• Component/s: SQL
• Assignee: Takeshi Yamamuro
• Reporter: Takeshi Yamamuro
• Created: 25/Mar/19 05:49
• Updated: 01/Apr/19 00:27
• Resolved: 01/Apr/19 00:25

Description

The master doesn't support ANALYZE TABLE to collect tables stats for catalog views even if they are cached;

scala> sql(s"CREATE VIEW v AS SELECT 1 c")
scala> sql(s"CACHE LAZY TABLE v")
scala> sql(s"ANALYZE TABLE v COMPUTE STATISTICS")
org.apache.spark.sql.AnalysisException: ANALYZE TABLE is not supported on views.;

  at org.apache.spark.sql.execution.command.AnalyzeTableCommand.run(AnalyzeTableCommand.scala:38)

  at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult$lzycompute(commands.scala:70)

  at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult(commands.scala:68)

  at org.apache.spark.sql.execution.command.ExecutedCommandExec.executeCollect(commands.scala:79)

Since SPARK-25196 has supported an ANALYZE command to collect column statistics for cached catalog view, we could support table stats, too.

Issue Links

• links to: GitHub Pull Request #24200