[FLINK-23843] Exceptions during "SplitEnumeratorContext.runInCoordinatorThread()" should cause Global Failure instead of Process Kill

• Type: Improvement
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.13.2, 1.14.4, 1.15.0
• Fix Version/s: 1.14.5, 1.15.0, 1.13.7
• Component/s: Connectors / Common
• Labels: pull-request-available
• Assignee: Etienne Chauchot
• Reporter: Stephan Ewen
• Created: 17/Aug/21 17:02
• Updated: 09/Mar/22 09:51
• Resolved: 09/Mar/22 09:44

Description

Currently, when a the method "SplitEnumeratorContext.runInCoordinatorThread()" throws an exception, the effect is a process kill of the JobManager process.

The chain how the process kill happens is:

• An exception bubbling up in the executor, killing the executor thread
• The executor starts a replacement thread, which is forbidden by the thread factory (as a safety net) and causes a process kill.

We should prevent such exceptions from bubbling up in the coordinator executor.

Issue Links

• links to: GitHub Pull Request #18610
• links to: GitHub Pull Request #18998
• links to: GitHub Pull Request #18999