[FLINK-19601] Introduce sort-merge based blocking result partition SortMergeResultPartition and the corresponding subpartition reader

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.12.0
• Fix Version/s: 1.12.0
• Component/s: Runtime / Network
• Assignee: Yingjie Cao
• Reporter: Yingjie Cao
• Created: 13/Oct/20 06:32
• Updated: 05/Nov/20 15:13
• Resolved: 05/Nov/20 15:06

Description

SortMergeResultPartition appends all added records and events to a SortBuffer and after the SortBuffer is full, all data in the SortBuffer will be copied and spilled to a PartitionedFile in subpartition index order. Different from the hash-based blocking shuffle implementation, SortMergeResultPartition can write at most one file concurrently.