[FLINK-24340] Misleading exception logged finished/canceled job restarted once

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.14.0, 1.13.3, 1.15.0
• Fix Version/s: 1.14.0, 1.13.3
• Component/s: Runtime / Coordination
• Labels: pull-request-available
• Assignee: Chesnay Schepler
• Reporter: Chesnay Schepler
• Created: 20/Sep/21 10:38
• Updated: 21/Sep/21 13:37
• Resolved: 21/Sep/21 13:37

Description

In FLINK-24015, code was introduced to ensure exceptions are logged on the JM (Dispatcher) so we have them at least once in case they arise from the initialization.

To this end the code checks whether the failureInfo is set in the ExecutionGraph. On the face of it this makes sense, but this failureInfo is also set when a job is restarted, and never reset.

As a result we may print the exception that caused the last restart when the job is finished/canceled.

Issue Links

• is caused by: FLINK-24015 Dispatcher does not log JobMaster initialization error on info level
• links to: GitHub Pull Request #17323