[HUDI-6056] Add guard rails to archival configs when cleaner configs is based on hours

• Type: Improvement
• Status: Open
• Priority: Critical
• Resolution: Unresolved
• Component/s: archiving, cleaning, table-service, writer-core
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: sivabalan narayanan
• Created: 11/Apr/23 00:49
• Updated: 30/Mar/24 07:18

Description

if both archival and cleaner is based on num_commits, we do have some validations in place that archival should not be aggressive compared to cleaner. but if cleaner is based on hours, we don't have any such conditions. we need to add them to ensure archival does not clean up any commits which cleaner has not cleaned up yet. 

 

Issue Links

• links to: GitHub Pull Request #8422