[HIVE-8258] Compactor cleaners can be starved on a busy table or partition.

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.13.1
• Fix Version/s: 0.14.0
• Component/s: Transactions
• Assignee: Alan Gates
• Reporter: Alan Gates
• Created: 25/Sep/14 20:31
• Updated: 01/Oct/19 22:06
• Resolved: 13/Oct/14 21:33

Description

Currently the cleaning thread in the compactor does not run on a table or partition while any locks are held on this partition. This leaves it open to starvation in the case of a busy table or partition. It only needs to wait until all locks on the table/partition at the time of the compaction have expired. Any jobs initiated after that (and thus any locks obtained) will be for the new versions of the files.