[IMPALA-9994] Add exhaustive test to verify not leaking partitions in statestore catalog topic

• Type: Test
• Status: Open
• Priority: Critical
• Resolution: Unresolved
• Component/s: Catalog
• Epic Link: fine-grained metadata in catalogd
• Epic Color: ghx-label-10
• Assignee: Quanlong Huang
• Reporter: Quanlong Huang
• Created: 22/Jul/20 22:51
• Updated: 22/Dec/20 19:54

Description

After IMPALA-3127, catalogd sends metadata update in partition level, which dramatically increases the catalog topic size. We should make sure no leaks of partitions in the topic, i.e. all dropped or invalidated partitions have a deletion update in the catalog topic.