Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-19582 FLIP-148: Introduce sort-merge based blocking shuffle to Flink
  3. FLINK-19600

Introduce PartitionedFile and the corresponding writer/reader for sort-merge based blocking shuffle

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.12.0
    • 1.12.0
    • Runtime / Network
    • None

    Description

      PartitionedFile is the persistent file type of sort-merge based blocking shuffle. It stores data of all subpartitions in subpartition index order. PartitionedFile can be produced by PartitionedFileWriter and consumed by PartitionedFileReader. 

      Attachments

        Activity

          People

            kevin.cyj Yingjie Cao
            kevin.cyj Yingjie Cao
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: