[HIVE-13354] Add ability to specify Compaction options per table and per request - ASF JIRA

Log work

Agile Board

Rank to Top

Rank to Bottom

Bulk Copy Attachments

Bulk Move Attachments

Voters

Watch issue

Watchers

Create sub-task

Convert to sub-task

Move

Link

Clone

Labels

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: 1.3.0, 2.0.0
Fix Version/s: 1.3.0, 2.1.0
Component/s: None
Labels:
None

Target Version/s:

1.3.0, 2.1.0

Description

Currently the are a few options that determine when automatic compaction is triggered. They are specified once for the warehouse.
This doesn't make sense - some table may be more important and need to be compacted more often.
We should allow specifying these on per table basis.

Also, compaction is an MR job launched from within the metastore. There is currently no way to control job parameters (like memory, for example) except to specify it in hive-site.xml for metastore which means they are site wide.

Should add a way to specify these per table (perhaps even per compaction if launched via ALTER TABLE)