Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-19582 FLIP-148: Introduce sort-merge based blocking shuffle to Flink
  3. FLINK-19597

Introduce SortBuffer and PartitionSortedBuffer for sort-merge based blocking shuffle

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.12.0
    • 1.12.0
    • Runtime / Network
    • None

    Description

      Data of different channels can be appended to a SortBuffer and after the SortBuffer is finished, the appended data can be copied from it in channel index order. PartitionSortedBuffer is an implementation of SortBuffer and it sorts all appended records only by subpartition index. Records of the same subpartition keep the appended order.

      Attachments

        Activity

          People

            kevin.cyj Yingjie Cao
            kevin.cyj Yingjie Cao
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: