[SPARK-19128] Refresh Metadata Cache After ALTER TABLE SET LOCATION

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 2.1.0
• Component/s: SQL
• Labels: correctness
• Assignee: Xiao Li
• Reporter: Xiao Li
• Created: 08/Jan/17 18:55
• Updated: 02/Apr/18 22:16
• Resolved: 02/Apr/18 22:16

Description

ALTER TABLE SET LOCATION is missing refresh table cache.

      val catalog = spark.sessionState.catalog
      sql("CREATE TABLE tab1 using parquet AS SELECT 1 as a")
      sql("CREATE TABLE tab2 using parquet AS SELECT 2 as a")
      checkAnswer(spark.table("tab1"), Seq(Row(1)))
      checkAnswer(spark.table("tab2"), Seq(Row(2)))
      val metadataTab1 = catalog.getTableMetadata(TableIdentifier("tab1"))
      val locTab1 = metadataTab1.storage.locationUri
      sql(s"ALTER TABLE tab2 SET LOCATION '${locTab1.get}'")
      spark.table("tab2").show()

The above codes still output the contents of the previous location after changing location.

Issue Links

• links to: [Github] Pull Request #16514 (gatorsmile)