[SPARK-33786] Cache's storage level is not respected when a table name is altered.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.0.2, 3.1.0
• Component/s: SQL
• Assignee: Terry Kim
• Reporter: Terry Kim
• Created: 15/Dec/20 03:43
• Updated: 16/Dec/20 13:52
• Resolved: 16/Dec/20 05:46

Description

To repro:

        Seq(1 -> "a").toDF("i", "j").write.parquet(path.getCanonicalPath)
        sql(s"CREATE TABLE old USING parquet LOCATION '${path.toURI}'")
        sql("CACHE TABLE old OPTIONS('storageLevel' 'MEMORY_ONLY')")
        val oldStorageLevel = getStorageLevel("old")

        sql("ALTER TABLE old RENAME TO new")
        val newStorageLevel = getStorageLevel("new")
        assert(oldStorageLevel === newStorageLevel)

The assert fails:
Expected :StorageLevel(disk, memory, deserialized, 1 replicas)
Actual :StorageLevel(memory, deserialized, 1 replicas)

Issue Links

• links to: [Github] Pull Request #30774 (imback82)
• links to: [Github] Pull Request #30793 (imback82)