[FLINK-5232] Add a Thread default uncaught exception handler on the JobManager

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.7.0
• Component/s: Runtime / Coordination
• Labels: pull-request-available
• Assignee: vinoyang
• Reporter: Stephan Ewen
• Created: 02/Dec/16 14:19
• Updated: 02/Oct/19 17:45
• Resolved: 15/Aug/18 06:59

Description

When some JobManager threads die because of uncaught exceptions, we should bring down the JobManager. If a thread dies from an uncaught exception, there is a high chance that the JobManager becomes dysfunctional.

The only sfae thing is to rely on the JobManager being restarted by YARN / Mesos / Kubernetes / etc.

I suggest to add this code to the JobManager launch:

Thread.setDefaultUncaughtExceptionHandler(new UncaughtExceptionHandler() {

    @Override
    public void uncaughtException(Thread t, Throwable e) {
        try {
            LOG.error("Thread {} died due to an uncaught exception. Killing process.", t.getName());
        } finally {
            Runtime.getRuntime().halt(-1);
        }
    }
});

Issue Links

• links to: GitHub Pull Request #6334
• links to: GitHub Pull Request #6334