[REEF-1783] Run two unmanaged REEF applications from one REEF driver

• Type: Test
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: REEF Driver, REEF Runtime YARN

Environment

YARN 2.7.3+

• Assignee: Sergiy Matusevych
• Reporter: Sergiy Matusevych
• Created: 18/Apr/17 23:48
• Updated: 18/Apr/17 23:49

Description

We need to make sure that on completion unmanaged REEF driver cleans up after itself, and closes all resources it allocates – but not more.

REEF-1782 describes the situation when inner (unmanaged) REEF application apparently closes some resources that actually belong to the host driver. We need to make sure that upon unmanaged app completion, host driver is still fully functioning and can launch another unmanaged application.

To that end, we need to implement an application similar to the existing REEF-on-REEF example (see REEF-1667), but running two unmanaged applications one after another. That can be achieved with very little effort by refactoring the existing code of the ReefOnReefDriver class.

Issue Links

• relates to: REEF-1667 REEF-on-REEF example
• relates to: REEF-1782 REEF-on-REEF host driver closes prematurely