[HUDI-2164] Build cluster plan and execute this plan at once for HoodieClusteringJob

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.9.0
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: Yue Zhang
• Created: 12/Jul/21 08:28
• Updated: 12/Aug/21 22:52
• Resolved: 12/Aug/21 22:52

Description

For now, Hudi can let users submit a HoodieClusteringJob to build a clustering plan or execute a clustering plan through --schedule or --instant-time config.

If users want to trigger a clustering job, he has to 

1. Submit a HoodieClusteringJob to build a clustering job through --schedule config
2. Copy the created clustering Instant time form Log info.
3. Submit the HoodieClusteringJob again to execute this created clustering plan through --instant-time config.

The pain point is that there are too many steps when trigger a clustering and need to copy and paste the instant time from log file manually so that we can't make it automatically.

 

I just raise a PR to offer a new config named --mode or -m in short 

--mode	remarks
execute	Execute a cluster plan at given instant which means --instant-time is needed here. default value.
schedule	Make a clustering plan.
scheduleAndExecute	Make a cluster plan first and execute that plan immediately

Now users can use --mode scheduleAndExecute to Build cluster plan and execute this plan at once using HoodieClusteringJob.

 

Issue Links

• links to: GitHub Pull Request #3259