[HUDI-7090] Set maxParallelism for singleton operator ,for example compact_plan_generate、split_monitor、compact_commit

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.14.1, 1.0.0
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: hehuiyuan
• Created: 14/Nov/23 13:22
• Updated: 17/Nov/23 01:44
• Resolved: 17/Nov/23 01:44

Description

The parallelism of singleton operator should be strictly controlled,  which can avoid some problems caused by modifying parallelism through other means.

For example:

if set the split_monitor operator parallelism to 10 , it will read data 10 times.

Issue Links

• links to: GitHub Pull Request #10089
• links to: GitHub Pull Request #10090