[HUDI-5054] Ensure archival also considers actual clean timeline files before archiving

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.12.2
• Fix Version/s: 0.14.0
• Component/s: archiving
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: sivabalan narayanan
• Created: 19/Oct/22 00:01
• Updated: 29/Mar/23 10:20
• Resolved: 29/Mar/23 10:20

Description

if a user sets clean.automatic=false, cleaner will not trigger any cleans only. But the archival will still make progress assuming cleaner is making progress as usual. 

 

we need to fix this to ensure archival does not make progress further than latest clean. 

 

https://github.com/apache/hudi/issues/6938

Issue Links

• links to: GitHub Pull Request #7067