Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-31589

Reduce the pressure of the list pod method on the k8s cluster

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Duplicate
    • None
    • None
    • None

    Description

      In the production environment, we found that if a cluster-level failure occurs, the jobs of a cluster will failover at the same time, which puts a lot of pressure on the k8s cluster.
      Through the monitoring of k8s, we found that the method of list pod caused relatively high pressure.
      By querying the relevant information of fabric8, we found an optimization scheme for the list pod, that is, adding the parameter of 

      ResourceVersion=0

       in the list pod can greatly reduce the pressure on the k8s cluster.

      After adding this configuration, even if a large number of jobs failover, it does not cause too much pressure on the cluster and has achieved certain results

      link

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              spoon-lz liuzhuo
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: