Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-7866

Weigh list of preferred locations for scheduling

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.3.2, 1.4.0
    • 1.6.0
    • Runtime / Coordination
    • None

    Description

      sihuazhou proposed to not only use the list of preferred locations to decide where to schedule a task, but to also weigh the list according to how often a location appeared and then select the location based on the weight. That way, we would obtain better locality in some cases.

      Example:

      Preferred locations list: [location1, location2, location2]
      Weighted preferred locations list [(location2 , 2), (location1, 1)]

      Attachments

        Issue Links

          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. FLINK-7153 Eager Scheduling can't allocate source for ExecutionGraph correctly

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          links to

          Web Link GitHub Pull Request #4369

          Web Link GitHub Pull Request #4949

          Activity

            People

              sihuazhou Sihua Zhou
              trohrmann Till Rohrmann
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: