[HIVE-25883] Enhance Compaction Cleaner to skip when there is nothing to do

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Labels: pull-request-available
• Assignee: Zoltan Haindrich
• Reporter: Zoltan Haindrich
• Created: 20/Jan/22 16:05
• Updated: 17/Nov/22 08:48
• Resolved: 23/Jan/22 07:49

Description

the cleaner works the following way:

• it identifies obsolete directories (delta dirs ; which doesn't have open txns)
• removes them and done

if there are no obsolete directoris that is attributed to that there might be open txns so the request should be retried later.

however if for some reason the directory was already cleaned - similarily it has no obsolete directories; and thus the request is retried for forever

Issue Links

• is related to: HIVE-25977 Enhance Compaction Cleaner to skip when there is nothing to do #2
• links to: GitHub Pull Request #2958
• links to: GitHub Pull Request #2971
• links to: GitHub Pull Request #3102