Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-2287 Implement JobManager high availability
  3. FLINK-2288

Setup ZooKeeper for distributed coordination

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Implemented
    • Affects Version/s: None
    • Fix Version/s: 0.10.0
    • Component/s: Runtime / Coordination
    • Labels:
      None

      Description

      Having standby JM instances for job manager high availabilty requires distributed coordination between JM, TM, and clients. For this, we will use ZooKeeper (ZK).

      Pros:

      • Proven solution (other projects use it for this as well)
      • Apache TLP with large community, docs, and library with required "recipies" like leader election (see below)

      Related Wiki: https://cwiki.apache.org/confluence/display/FLINK/JobManager+High+Availability

        Attachments

          Activity

            People

            • Assignee:
              uce Ufuk Celebi
              Reporter:
              uce Ufuk Celebi
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: