[SPARK-33963] `isCached` return `false` for cached Hive table

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.0, 3.2.0
• Fix Version/s: 3.0.2, 3.1.0
• Component/s: SQL
• Assignee: Max Gekk
• Reporter: Max Gekk
• Created: 02/Jan/21 19:15
• Updated: 12/Dec/22 18:10
• Resolved: 03/Jan/21 02:24

Description

The same works in Spark 3.0 but fails in Spark 3.2.0-SNAPSHOT (and 3.1.0 probably):
Spark 3.0:

Welcome to
      ____              __
     / __/__  ___ _____/ /__
    _\ \/ _ \/ _ `/ __/  '_/
   /___/ .__/\_,_/_/ /_/\_\   version 3.0.1
      /_/
scala> sql("CREATE TABLE tbl (col int)")
res2: org.apache.spark.sql.DataFrame = []
scala> spark.catalog.isCached("tbl")
res3: Boolean = false

scala> sql("CACHE TABLE tbl")
res4: org.apache.spark.sql.DataFrame = []

scala> spark.catalog.isCached("tbl")
res5: Boolean = true

Spark master:

Welcome to
      ____              __
     / __/__  ___ _____/ /__
    _\ \/ _ \/ _ `/ __/  '_/
   /___/ .__/\_,_/_/ /_/\_\   version 3.2.0-SNAPSHOT
      /_/
scala> sql("CREATE TABLE tbl (col int)")
res1: org.apache.spark.sql.DataFrame = []

scala> spark.catalog.isCached("tbl")
res2: Boolean = false

scala> sql("CACHE TABLE tbl")
res3: org.apache.spark.sql.DataFrame = []

scala> spark.catalog.isCached("tbl")
res4: Boolean = false

Issue Links

• links to: [Github] Pull Request #30995 (MaxGekk)
• links to: [Github] Pull Request #30995 (MaxGekk)