[HUDI-74] Improve compaction support in HoodieDeltaStreamer & CLI

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Won't Do
• Fix Version/s: 0.12.1
• Component/s: cli, deltastreamer
• Epic Link: Improve Hudi CLI
• Assignee: Unassigned
• Reporter: Balaji Varadarajan
• Created: 07/Mar/19 17:45
• Updated: 22/Aug/22 10:16
• Resolved: 22/Aug/22 10:15

Description

Currently, the only way to safely schedule and execute a compaction which will preserve checkpoints is through inline compaction. But this is diasbled by default for HoodieDeltaStreamer. 

 

Also, the other option to schedule a compaction is through Hoodie CLI. We need to support option to copy last delta-instant's extra-metadata  to make this a viable option for working with DeltaStreamer.