Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-4256 Fine-grained recovery
  3. FLINK-13223

Set jobmanager.execution.failover-strategy to region in default flink-conf.yaml

    XMLWordPrintableJSON

Details

    • Hide
      Flink will now by default use the "region" failover strategy. Flink will now attempt to only restart tasks that are connected to the failed task through a pipelined connection.

      Users who were not using a restart strategy or have already configured a failover strategy should not be affected.

      Streaming users who were not using a failover strategy may be affected if their jobs are embarrassingly parallel or contain multiple independent jobs. In this case, only the failed parallel pipeline or affected jobs will be restarted.

      Batch users may be affected if their job contains blocking exchanges (usually happens for shuffles) or the ExecutionMode was set to BATCH or BATCH_FORCED via the ExecutionConfig.

      Overall users should see an improvement in performance.
      Show
      Flink will now by default use the "region" failover strategy. Flink will now attempt to only restart tasks that are connected to the failed task through a pipelined connection. Users who were not using a restart strategy or have already configured a failover strategy should not be affected. Streaming users who were not using a failover strategy may be affected if their jobs are embarrassingly parallel or contain multiple independent jobs. In this case, only the failed parallel pipeline or affected jobs will be restarted. Batch users may be affected if their job contains blocking exchanges (usually happens for shuffles) or the ExecutionMode was set to BATCH or BATCH_FORCED via the ExecutionConfig. Overall users should see an improvement in performance.

    Description

      Set jobmanager.execution.failover-strategy to region in default flink-conf.yaml

      Attachments

        Issue Links

          Activity

            People

              chesnay Chesnay Schepler
              gjy Gary Yao
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m