[REEF-1658] Gracefully shut down all threads at the end of the REEF job

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.16
• Component/s: REEF Driver, REEF Runtime Local, REEF-Common, Wake
• Labels: cleanup close logging refactoring shutdown threads
• Assignee: Sergiy Matusevych
• Reporter: Sergiy Matusevych
• Created: 28/Oct/16 23:29
• Updated: 02/Nov/16 23:20
• Resolved: 02/Nov/16 19:50

Description

Currently, REEF launcher explicitly invokes System.exit(0); at the end of the REEF job to shut down all threads that are still running.

This is not acceptable when REEF is launched as a library alongside with other applications on the same JVM. We need to properly clean-up the resources and shut down all threads on REEF application shutdown.

Issue Links

• is related to: REEF-1661 RejectedExecutionException thrown when closing the acceptor in NettyMessageTransport
• relates to: REEF-1654 Implement graceful shutdown of Wake executor services