Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-25636

FLIP-199: Change some default config values of blocking shuffle for better usability

    XMLWordPrintableJSON

Details

    • Hide
      Since 1.15, sort-shuffle has become the default blocking shuffle implementation and shuffle data compression is enabled by default. These changes only influence batch jobs and can improve the blocking shuffle performance and stability. For more information, please refer to the official document: https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/ops/batch/blocking_shuffle.
      Show
      Since 1.15, sort-shuffle has become the default blocking shuffle implementation and shuffle data compression is enabled by default. These changes only influence batch jobs and can improve the blocking shuffle performance and stability. For more information, please refer to the official document: https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/ops/batch/blocking_shuffle .

    Description

      This is the umbrella issue for FLIP-199, we will change the several default config value for batch shuffle and update the document accordingly.

      Attachments

        Issue Links

          There are no Sub-Tasks for this issue.

          Activity

            People

              kevin.cyj Yingjie Cao
              kevin.cyj Yingjie Cao
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: