[HIVE-22701] New Compaction for subsequent read's optimisations.

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Transactions
• Assignee: Unassigned
• Reporter: Aditya Shah
• Created: 07/Jan/20 10:15
• Updated: 07/Jan/20 13:44

Description

Introducing a new Compaction Type say "OPTIMIZE" to have the following optimizations for better reads:

1. Sort data
2. Re-bucket data
3. z-ordering
4. removing ROW_IDs

I've attached a design doc with the JIRA. Feel free to comment on the same.

cc: t3rmin4t0r pvary  lpinter  asomani

Sub-Tasks

• Create new command for "optimize" compaction and have basic implementation.: Patch Available