[FLINK-3114] Read cluster's default parallelism upon remote job submission

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Won't Do
• Affects Version/s: 0.10.0, 0.10.1, 1.0.0
• Component/s: Runtime / Coordination
• Assignee: Unassigned
• Reporter: Maximilian Michels
• Created: 04/Dec/15 12:13
• Updated: 28/Feb/19 14:01
• Resolved: 26/Feb/19 16:21

Description

When default.parallelism has been set in the cluster configuration, users wonder why the default parallelism is 1 when they submit program from their local machine, e.g. using the RemoteEnvironment.

The reason for that is that the default parallelism is only picked up locally. I propose to change this behavior by querying the JobManager for its default parallelism before JobGraph generation.

Issue Links

• is related to: FLINK-937 Change the YARN Client to allocate all cluster resources, if no argument given