Details

    • In order to use a scheduling strategy which is more similar to the pre FLIP-6 behaviour where Flink tries to spread out the workload across all available `TaskExecutors`, one needs to set `cluster.evenly-spread-out-slots: true` in the `flink-conf.yaml`

    Description

      With Flip-6, we changed the default behaviour how slots are assigned to TaskManagers. Instead of evenly spreading it out over all registered TaskManagers, we randomly pick slots from TaskManagers with a tendency to first fill up a TM before using another one. This is a regression wrt the pre Flip-6 code.

      I suggest to change the behaviour so that we try to evenly distribute slots across all available TaskManagers by considering how many of their slots are already allocated.

      Attachments

        1. image-2019-05-21-12-28-29-538.png
          18 kB
          Ben La Monica
        2. image-2019-05-21-13-02-50-251.png
          72 kB
          Ben La Monica

        Issue Links

          Activity

            People

              trohrmann Till Rohrmann
              trohrmann Till Rohrmann
              Votes:
              10 Vote for this issue
              Watchers:
              32 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m