Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-14460 Active Kubernetes integration phase 2 - Advanced Features
  3. FLINK-12884

Implement HighAvailabilityService based on native k8s APIs

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Runtime / Coordination
    • Labels:
      None

      Description

      Currently flink only supports HighAvailabilityService using zookeeper. As a result, it requires a zookeeper cluster to be deployed on k8s cluster if our customers needs high availability for flink. If we support HighAvailabilityService based on native k8s APIs, it will save the efforts of zookeeper deployment as well as the resources used by zookeeper cluster. It might be especially helpful for customers who run small-scale k8s clusters so that flink HighAvailabilityService may not cause too much overhead on k8s clusters.

      Previously FLINK-11105 has proposed a HighAvailabilityService using etcd. As Nathan Howell suggested in FLINK-11105, since k8s doesn't expose its own etcd cluster by design (see Securing etcd clusters), it also requires the deployment of etcd cluster if flink uses etcd to achieve HA.

        Attachments

          Activity

            People

            • Assignee:
              ssy MalcolmSanders
              Reporter:
              ssy MalcolmSanders
            • Votes:
              2 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

              • Created:
                Updated: