[FLINK-12068] Backtrack failover regions if intermediate results are unavailable

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Implemented
• Fix Version/s: 1.9.0
• Component/s: Runtime / Coordination
• Labels: pull-request-available
• Assignee: Zhu Zhu
• Reporter: Till Rohrmann
• Created: 29/Mar/19 15:55
• Updated: 02/Oct/19 17:49
• Resolved: 17/Jun/19 11:19

Description

The batch failover strategy needs to be able to backtrack fail over regions if an intermediate result is unavailable. Either by explicitly checking whether the intermediate result partition is available or via a special exception indicating that a result partition is no longer available.

Issue Links

• is blocked by: FLINK-12369 Implement a region failover strategy based on new FailoverStrategy interfaces
• is related to: FLINK-6227 Introduce the abstract PartitionException for downstream task failure
• links to: Design Document
• links to: GitHub Pull Request #8430