Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-4256 Fine-grained recovery
  3. FLINK-13223

Set jobmanager.execution.failover-strategy to region in default flink-conf.yaml

    XMLWordPrintableJSON

    Details

    • Release Note:
      Hide
      Flink will now by default use the "region" failover strategy. Flink will now attempt to only restart tasks that are connected to the failed task through a pipelined connection.

      Users who were not using a restart strategy or have already configured a failover strategy should not be affected.

      Streaming users who were not using a failover strategy may be affected if their jobs are embarrassingly parallel or contain multiple independent jobs. In this case, only the failed parallel pipeline or affected jobs will be restarted.

      Batch users may be affected if their job contains blocking exchanges (usually happens for shuffles) or the ExecutionMode was set to BATCH or BATCH_FORCED via the ExecutionConfig.

      Overall users should see an improvement in performance.
      Show
      Flink will now by default use the "region" failover strategy. Flink will now attempt to only restart tasks that are connected to the failed task through a pipelined connection. Users who were not using a restart strategy or have already configured a failover strategy should not be affected. Streaming users who were not using a failover strategy may be affected if their jobs are embarrassingly parallel or contain multiple independent jobs. In this case, only the failed parallel pipeline or affected jobs will be restarted. Batch users may be affected if their job contains blocking exchanges (usually happens for shuffles) or the ExecutionMode was set to BATCH or BATCH_FORCED via the ExecutionConfig. Overall users should see an improvement in performance.

      Description

      Set jobmanager.execution.failover-strategy to region in default flink-conf.yaml

        Attachments

          Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-15813 Set default value of jobmanager.execution.failover-strategy to region

          • Blocker - Blocks development and/or testing work, production could not run
          • Open
          links to

          Web Link GitHub Pull Request #9117

            Activity

              People

              • Assignee:
                chesnay Chesnay Schepler
                Reporter:
                gjy Gary Yao
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m