[HIVE-24314] compactor.Cleaner should not set state "mark cleaned" if it didn't remove any files

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Labels: pull-request-available
• Assignee: Karen Coppage
• Reporter: Karen Coppage
• Created: 27/Oct/20 10:53
• Updated: 17/Nov/22 08:47
• Resolved: 25/Nov/20 09:13

Description

If the Cleaner didn't remove any files, don't mark the compaction queue entry as "succeeded" but instead leave it in "ready for cleaning" state for later cleaning. If it removed at least one file, then the compaction queue entry as "succeeded". This is a partial fix, HIVE-24291 is the complete fix.

Issue Links

• Is contained by: HIVE-24291 Compaction Cleaner prematurely cleans up deltas
• is related to: HIVE-25115 Compaction queue entries may accumulate in "ready for cleaning" state
• links to: GitHub Pull Request #1613