[FLINK-1955] Improve error handling of sender task failures

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.10.0
• Fix Version/s: 0.9
• Component/s: Runtime / Coordination
• Assignee: Unassigned
• Reporter: Ufuk Celebi
• Created: 29/Apr/15 10:29
• Updated: 06/Oct/15 15:51
• Resolved: 01/Jun/15 07:25

Description

Currently, if a sender task fails, the produced partition is silently released.

We want:

• Produced result partition becomes erroneous with a SenderFailedException
• Receiver cancels itself when encountering the SenderFailedException
• May also be cancelled by the JobManager (if that call is faster than the detection of the failed sender)
• This closes the Netty channel

Issue Links

• is part of: FLINK-1954 Task Failures and Error Handling