Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-4525

Drop the "eager split pre-assignment" code paths

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.1.2
    • 1.2.0
    • Runtime / Coordination
    • None

    Description

      There is currently an interface for input splits StrictlyLocalAssignment that is half-heartedly supported in the JobManager (it is, for example, not fault tolerant).

      I suggest to drop these special cases for the following reasons:

      • they do not fit the assumptions of all the rest of the system well (localize where possible, but never constrain)
      • they make the logic of implemented as part of dynamic resource acquisition hard
      • they are not fully implemented even today
      • I am not aware of anyone using this feature
      • It is complicated to maintain

      Attachments

        Activity

          People

            sewen Stephan Ewen
            sewen Stephan Ewen
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: