Details

    • Release Note:
      In order to use a scheduling strategy which is more similar to the pre FLIP-6 behaviour where Flink tries to spread out the workload across all available `TaskExecutors`, one needs to set `cluster.evenly-spread-out-slots: true` in the `flink-conf.yaml`

      Description

      With Flip-6, we changed the default behaviour how slots are assigned to TaskManagers. Instead of evenly spreading it out over all registered TaskManagers, we randomly pick slots from TaskManagers with a tendency to first fill up a TM before using another one. This is a regression wrt the pre Flip-6 code.

      I suggest to change the behaviour so that we try to evenly distribute slots across all available TaskManagers by considering how many of their slots are already allocated.

        Attachments

        1. image-2019-05-21-13-02-50-251.png
          72 kB
          Ben La Monica
        2. image-2019-05-21-12-28-29-538.png
          18 kB
          Ben La Monica

          Issue Links

            Activity

              People

              • Assignee:
                trohrmann Till Rohrmann
                Reporter:
                trohrmann Till Rohrmann
              • Votes:
                10 Vote for this issue
                Watchers:
                32 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m