Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-2897

Use distinct initial indices for OutputEmitter round-robin

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.10.0
    • 1.0.0
    • Runtime / Coordination
    • None

    Description

      Currently, when performing a round-robin partitioning each task will sequentially partition starting with partition "1". This is fine in the usual case where the number of partitioned objects greatly exceeds the number of channels. However, in the case where the number of objects is relatively few (each, perhaps, requiring a large computation or access to an external system) it would be much better to begin partitioning at distinct indices (the task index).

      Attachments

        Activity

          People

            greghogan Greg Hogan
            greghogan Greg Hogan
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: