[HIVE-9490] [Parquet] Support Alter Table/Partition Concatenate

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Dong Chen
• Reporter: Dong Chen
• Created: 28/Jan/15 02:35
• Updated: 24/Dec/20 09:32

Description

Parquet should support
ALTER TABLE table_name [PARTITION (partition_key = 'partition_value')] CONCATENATE;

If the table or partition contains many small Parquet files, then the above command will merge them into larger files. The merge should happen at row group level thereby avoiding the overhead of decompressing and decoding the data.
It is only supported by RCFiles or ORCFiles now.

Issue Links

• is related to: PARQUET-382 Add a way to append encoded blocks in ParquetFileWriter