[HUDI-4477] Add an option for bulk insert tasks to adjust parallelism

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 0.12.0
• Labels: pull-request-available
• Assignee: Lewin Ma
• Reporter: Lewin Ma
• Created: 26/Jul/22 06:50
• Updated: 09/Aug/22 16:24
• Resolved: 09/Aug/22 16:24

Description

Currently, the maximum parallelism of bulk insertion write tasks is 128, refer to `StreamGraher.DEFAULT_LOWER_BOUND_MAX_PARALLELISM`.

It can not satisfy the workloads which hold a large amount of traffics and user can not adjust it for now.

Issue Links

• links to: GitHub Pull Request #6218