Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-33742 Hybrid Shuffle should work well with Adaptive Query Execution
  3. FLINK-33744

Hybrid shuffle avoids restarting the whole job when failover

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.19.0
    • None
    • Runtime / Network
    • None

    Description

      If Hybrid shuffle is enabled, the whole job will be restarted when failover. This is a critical issue for large-scale jobs. We should improve the logic and avoid restarting the whole job when failover.

      Attachments

        Activity

          People

            Unassigned Unassigned
            tanyuxin Yuxin Tan
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: