[HIVE-16669] Fine tune Compaction to take advantage of Acid 2.0

• Type: Bug
• Status: Open
• Priority: Critical
• Resolution: Unresolved
• Affects Version/s: 3.1.3
• Component/s: Transactions
• Target Version/s: 3.0.0
• Assignee: Unassigned
• Reporter: Eugene Koifman
• Created: 16/May/17 00:15
• Updated: 21/Dec/23 20:06

Description

• There is little point using 2.0 vectorized reader since there is no operator pipeline in compaction
• If minor compaction just concats delete_delta files together, then the 2 stage compaction should always ensure that we have a limited number of Orc readers to do the merging and current OrcRawRecordMerger should be fine
• ...

Issue Links

• is related to: HIVE-14035 Enable predicate pushdown to delta files created by ACID Transactions
• relates to: HIVE-9995 ACID compaction tries to compact a single file
• relates to: HIVE-17089 make acid 2.0 the default