Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-34563

Autoscaling decision improvement

    XMLWordPrintableJSON

Details

    Description

      Hi, I'd like to propose a minor improvement based on my autoscaling experiments. The concept revolves around identifying the vertex with the highest level of parallelism and matching it to the maximum parallelism supported by our task manager.

      The primary goal of this enhancement is to prevent any task slots from remaining unused after the Flink autoscaler performs a rescaling operation. I've already tested this modification in a custom build of the operator, excluding the memory tuning feature. However, I believe it could be beneficial, especially in scenarios where the memory tuning feature is not enabled.

      And I have prepared this small pr also

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              yang Yang LI
              Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: