[HBASE-17854] Use StealJobQueue in HFileCleaner after HBASE-17215

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0
• Fix Version/s: 2.0.0
• Hadoop Flags: Reviewed
• Assignee: Yu Li
• Reporter: Yu Li
• Created: 30/Mar/17 09:11
• Updated: 14/Dec/18 10:09
• Resolved: 05/Apr/17 09:57

Description

In HBASE-17215 we use specific threads for deleting large/small (archived) hfiles, and will improve it from below aspects in this JIRA:
1. Using StealJobQueue to allow large file deletion thread to steal jobs from small queue, based on the experience that in real world there'll be much more small hfiles
2. StealJobQueue is a kind of PriorityQueue, so we could also delete from the larger file in the queues.

Issue Links

• is blocked by: HBASE-17215 Separate small/large file delete threads in HFileCleaner to accelerate archived hfile cleanup speed