Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-33742 Hybrid Shuffle should work well with Adaptive Query Execution
  3. FLINK-33745

Dynamically choose hybrid shuffle or AQE in a job level

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.19.0
    • None
    • Runtime / Network
    • None

    Description

      To enhance the initial integration of Hybrid Shuffle with Adaptive Query Execution (AQE), we could implement a coarse-grained mode selection strategy. For instance, we can opt for either Hybrid Shuffle or AQE at the granularity level of an entire job. This approach would allow us to better align the two features in the early stages of adoption.

      Attachments

        Activity

          People

            Unassigned Unassigned
            tanyuxin Yuxin Tan
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: