Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-10291

Generate JobGraph with fixed/configurable JobID in StandaloneJobClusterEntrypoint

    XMLWordPrintableJSON

Details

    • The {{StandaloneJobClusterEntrypoint}} now starts all jobs with a fixed {{JobID}}. Thus, in order to run a cluster in HA mode, one needs to set a different cluster id {{high-availability.cluster-id}} for each job/cluster.

    Description

      The StandaloneJobClusterEntrypoint currently generates the JobGraph from the user code when being started. Due to the nature of how the JobGraph is generated, it will get a random JobID assigned. This is problematic in case of a failover because then, the JobMaster won't be able to detect the checkpoints. In order to solve this problem, we need to either fix the JobID assignment or make it configurable.

      Attachments

        Issue Links

          Activity

            People

              yanghua vinoyang
              trohrmann Till Rohrmann
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: