[FLINK-10291] Generate JobGraph with fixed/configurable JobID in StandaloneJobClusterEntrypoint

• Type: Improvement
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.6.0, 1.7.0
• Fix Version/s: 1.6.2, 1.7.0
• Component/s: Runtime / Coordination
• Labels: pull-request-available
• Release Note: The {{StandaloneJobClusterEntrypoint}} now starts all jobs with a fixed {{JobID}}. Thus, in order to run a cluster in HA mode, one needs to set a different cluster id {{high-availability.cluster-id}} for each job/cluster.
• Assignee: vinoyang
• Reporter: Till Rohrmann
• Created: 06/Sep/18 08:15
• Updated: 01/Oct/18 11:38
• Resolved: 01/Oct/18 11:38

Description

The StandaloneJobClusterEntrypoint currently generates the JobGraph from the user code when being started. Due to the nature of how the JobGraph is generated, it will get a random JobID assigned. This is problematic in case of a failover because then, the JobMaster won't be able to detect the checkpoints. In order to solve this problem, we need to either fix the JobID assignment or make it configurable.

Issue Links

• is related to: FLINK-10292 Generate JobGraph in StandaloneJobClusterEntrypoint only once
• links to: GitHub Pull Request #6733