[SPARK-33965] CACHE TABLE does not support `spark_catalog` in Hive table names

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.2.0
• Component/s: SQL
• Assignee: Max Gekk
• Reporter: Max Gekk
• Created: 03/Jan/21 09:14
• Updated: 04/Jan/21 08:28
• Resolved: 04/Jan/21 08:28

Description

The test fails:

  test("SPARK-XXXXX: cache table in spark_catalog") {
    withNamespace("spark_catalog.ns") {
      sql("CREATE NAMESPACE spark_catalog.ns")
      val t = "spark_catalog.ns.tbl"
      withTable(t) {
        sql(s"CREATE TABLE $t (col int)")
        assert(!spark.catalog.isCached(t))
        sql(s"CACHE TABLE $t")
        assert(spark.catalog.isCached(t))
      }
    }
  }

with the exception:

[info] - SPARK-XXXXX: cache table in spark_catalog *** FAILED *** (278 milliseconds)
[info]   org.apache.spark.sql.AnalysisException: spark_catalog.ns.tbl is not a valid TableIdentifier as it has more than 2 name parts.
[info]   at org.apache.spark.sql.connector.catalog.CatalogV2Implicits$MultipartIdentifierHelper.asTableIdentifier(CatalogV2Implicits.scala:130)
[info]   at org.apache.spark.sql.hive.test.TestHiveQueryExecution.$anonfun$analyzed$1(TestHive.scala:600)

Issue Links

• links to: [Github] Pull Request #30997 (MaxGekk)