[SPARK-18549] Failed to Uncache a View that References a Dropped Table.

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 2.0.2
• Fix Version/s: 2.1.1, 2.2.0
• Component/s: SQL
• Target Version/s: 2.2.0
• Assignee: Wenchen Fan
• Reporter: Xiao Li
• Created: 22/Nov/16 23:20
• Updated: 17/Mar/17 02:59
• Resolved: 07/Mar/17 17:22

Description

      spark.range(1, 10).toDF("id1").write.format("json").saveAsTable("jt1")
      spark.range(1, 10).toDF("id2").write.format("json").saveAsTable("jt2")
      sql("CREATE VIEW testView AS SELECT * FROM jt1 JOIN jt2 ON id1 == id2")
      // Cache is empty at the beginning
      assert(spark.sharedState.cacheManager.isEmpty)
      sql("CACHE TABLE testView")
      assert(spark.catalog.isCached("testView"))
      // Cache is not empty
      assert(!spark.sharedState.cacheManager.isEmpty)

      // drop a table referenced by a cached view
      sql("DROP TABLE jt1")

-- So far everything is fine

      // Failed to unache the view
      val e = intercept[AnalysisException] {
        sql("UNCACHE TABLE testView")
      }.getMessage
      assert(e.contains("Table or view not found: `default`.`jt1`"))

      // We are unable to drop it from the cache
      assert(!spark.sharedState.cacheManager.isEmpty)

Issue Links

• supercedes: SPARK-18169 Suppress warnings when dropping views on a dropped table
• links to: [Github] Pull Request #17097 (cloud-fan)