Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-12884

Implement HighAvailabilityService based on native k8s APIs

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Runtime / Coordination
    • Labels:
      None

      Description

      Currently flink only supports HighAvailabilityService using zookeeper. As a result, it requires a zookeeper cluster to be deployed on k8s cluster if our customers needs high availability for flink. If we support HighAvailabilityService based on native k8s APIs, it will save the efforts of zookeeper deployment as well as the resources used by zookeeper cluster. It might be especially helpful for customers who run small-scale k8s clusters so that flink HighAvailabilityService may not cause too much overhead on k8s clusters.

      Previously FLINK-11105 has proposed a HighAvailabilityService using etcd. As Nathan Howell suggested in FLINK-11105, since k8s doesn't expose its own etcd cluster by design (see Securing etcd clusters), it also requires the deployment of etcd cluster if flink uses etcd to achieve HA.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ssy MalcolmSanders
                Reporter:
                ssy MalcolmSanders
              • Votes:
                2 Vote for this issue
                Watchers:
                14 Start watching this issue

                Dates

                • Created:
                  Updated: