[HIVE-13354] Add ability to specify Compaction options per table and per request

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.3.0, 2.0.0
• Fix Version/s: 1.3.0, 2.1.0
• Target Version/s: 1.3.0, 2.1.0
• Assignee: Wei Zheng
• Reporter: Eugene Koifman
• Created: 24/Mar/16 17:16
• Updated: 16/Jan/18 22:01
• Resolved: 27/May/16 22:17

Description

Currently the are a few options that determine when automatic compaction is triggered. They are specified once for the warehouse.
This doesn't make sense - some table may be more important and need to be compacted more often.
We should allow specifying these on per table basis.

Also, compaction is an MR job launched from within the metastore. There is currently no way to control job parameters (like memory, for example) except to specify it in hive-site.xml for metastore which means they are site wide.

Should add a way to specify these per table (perhaps even per compaction if launched via ALTER TABLE)

Issue Links

• is blocked by: HIVE-13395 Lost Update problem in ACID
• is broken by: HIVE-18460 Compactor doesn't pass Table properties to the Orc writer
• is related to: HIVE-13972 Resolve class dependency issue introduced by HIVE-13354