[SPARK-37963] Need to update Partition URI after renaming table in InMemoryCatalog

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.0, 3.2.2
• Component/s: SQL
• Labels: correctness
• Assignee: Gengliang Wang
• Reporter: Gengliang Wang
• Created: 19/Jan/22 12:09
• Updated: 17/Jul/22 05:16
• Resolved: 20/Jan/22 13:40

Description

After renaming a partitioned table, select from the new table from InMemoryCatalog will get an empty result.

The following checkAnswer will fail as the result is empty.

sql(s"create table foo(i int, j int) using PARQUET partitioned by (j)")
sql("insert into table foo partition(j=2) values (1)")
sql(s"alter table foo rename to bar")
checkAnswer(spark.table("bar"), Row(1, 2)) 

To fix the bug, we need to update Partition URI after renaming a table in InMemoryCatalog

 

Issue Links

• links to: [Github] Pull Request #35251 (gengliangwang)