[HBASE-21883] Enhancements to Major Compaction tool

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 3.0.0-alpha-1, 1.5.0, 2.3.0
• Component/s: Client, Compaction, tooling

Release Note

MajorCompactorTTL Tool allows to compact all regions in a table that have been TTLed out. This saves space on DFS and is useful for tables which are similar to time series data. This is typically scheduled to run frequently (say via cron) to cleanup old data on an ongoing basis.

RSGroupMajorCompactionTTL tool is similar to MajorCompactorTTL but runs at a region server group level. If multiple tables in an rsgroup are similar to time-series data, then it runs a single command to clean them up. As more tables are added/removed from rsgroup, it's easy to have a single command to take care of all of them.

• Assignee: Thiruvel Thirumoolan
• Reporter: Thiruvel Thirumoolan
• Created: 12/Feb/19 22:38
• Updated: 01/May/19 09:01
• Resolved: 01/May/19 00:38

Description

I would like to add new compaction tools based on churromorales's tool at HBASE-19528.

We internally have tools that pick and compact regions based on multiple criteria. Since Rahul already has a version in community, we would like to build on top of it instead of pushing yet another tool.

With this jira, I would like to add a tool which looks at regions beyond TTL and compacts them in a rsgroup. We have time series data and those regions will become dead after a while, so we compact those regions to save disk space. We also merge those empty regions to reduce load, but that tool comes later.

Will prep a patch for 2.x once 1.5 gets in.

Issue Links

• links to: Review Board (branch-1)
• links to: Review Board (master)