Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-19582 FLIP-148: Introduce sort-merge based blocking shuffle to Flink
  3. FLINK-19602

Introduce new config options to enable sort-merge based blocking shuffle

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.12.0
    • 1.12.0
    • Runtime / Network
    • None

    Description

      1. taskmanager.network.sort-merge-blocking-shuffle.buffers-per-partition: Number of network buffers required for each sort-merge blocking result partition.

      2. taskmanager.network.sort-merge-blocking-shuffle.min-parallelism: Minimum parallelism to enable the sort-merge based blocking shuffle.

      With these new config options, the default behavior of blocking shuffle stays unchanged.

      Attachments

        Activity

          People

            kevin.cyj Yingjie Cao
            kevin.cyj Yingjie Cao
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: