[IMPALA-10946] RECOVER PARTITIONS might create non-existing partitions

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 4.1.0
• Component/s: Catalog, Frontend
• Labels: ramp-up
• Epic Color: ghx-label-13
• Assignee: Gergely Fürnstáhl
• Reporter: Zoltán Borók-Nagy
• Created: 01/Oct/21 09:26
• Updated: 03/Aug/22 09:42
• Resolved: 03/Aug/22 09:42

Description

The following commands reproduce the bug:

create table test_table (id int)
partitioned by (part_field string)
stored as parquet
LOCATION ‘/test-warehouse/abc/test’;

insert into test_table (id, part_field) select 1, ‘abc+’;

show partitions test_table; ----> it will show one partition “abc+”

alter table test_table recover partitions;

show partitions test_table; ----> result is showing two partitions, “abc” and “abc+”

The + character can occur anywhere in the string, RECOVER PARTITIONS will create a partition where the + is replaced by a space.

Seems like other characters don't cause this bug.