Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-9953

Active Kubernetes integration

    XMLWordPrintableJSON

    Details

    • Release Note:
      Hide
      Support natively running Flink on Kubernetes
      * Active resource management. Flink KubernetesResourceManager will allocate TaskManager pods dynamically based on the resource requirement of the jobs.
      * Using Flink bundled scripts to start/stop session cluster on Kuberenetes. Do not need external tools anymore.
      * Compared with Yarn deployment, different Flink cluster could get better isolation by leveraging the ability of Kubernetes.
      Show
      Support natively running Flink on Kubernetes * Active resource management. Flink KubernetesResourceManager will allocate TaskManager pods dynamically based on the resource requirement of the jobs. * Using Flink bundled scripts to start/stop session cluster on Kuberenetes. Do not need external tools anymore. * Compared with Yarn deployment, different Flink cluster could get better isolation by leveraging the ability of Kubernetes.

      Description

      This is the umbrella issue tracking Flink's active Kubernetes integration. Active means in this context that the ResourceManager can talk to Kubernetes to launch new pods similar to Flink's Yarn and Mesos integration.

      Phase1 implementation will have complete functions to make flink running on kubernetes. Only session cluster is supported.

      Phrase2 is mainly focused on production optimization, including per-job cluster, k8s native high-availability, storage, network, log collector and etc.

        Attachments

          Issue Links

          There are no Sub-Tasks for this issue.

            Activity

              People

              • Assignee:
                fly_in_gis Yang Wang
                Reporter:
                trohrmann Till Rohrmann
              • Votes:
                13 Vote for this issue
                Watchers:
                65 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 9h 20m
                  9h 20m