[HUDI-7320] hive-sync unexpectedly loads archived timeline

• Type: Bug
• Status: Open
• Priority: Critical
• Resolution: Unresolved
• Affects Version/s: 0.13.1
• Component/s: meta-sync
• Assignee: Unassigned
• Reporter: Raymond Xu
• Created: 22/Jan/24 18:54
• Updated: 30/Jan/24 22:26

Description

investigation shows that hive-sync step loaded archived timeline and caused long delay in the overall write process. And full scan for changes in all partitions is not used. need to dig further.