[SPARK-5881] RDD remains cached after the table gets overridden by "CACHE TABLE"

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Component/s: SQL
• Assignee: Unassigned
• Reporter: Yin Huai
• Created: 18/Feb/15 05:06
• Updated: 07/Oct/16 22:42
• Resolved: 07/Oct/16 22:42

Description

val rdd = sc.parallelize((1 to 10).map(i => s"""{"a":$i, "b":"str${i}"}"""))
sqlContext.jsonRDD(rdd).registerTempTable("jt")

sqlContext.sql("CACHE TABLE foo AS SELECT * FROM jt")
sqlContext.sql("CACHE TABLE foo AS SELECT a FROM jt")

After the second CACHE TABLE command, the RDD for the first table still remains in the cache.

Issue Links

• links to: [Github] Pull Request #4689 (yhuai)