[REEF-1681] Allow REEF Driver to run in unmanaged AM mode

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.16
• Component/s: REEF Driver, REEF-Runtime-YARN
• Labels: configuration driver yarn
• Assignee: Sergiy Matusevych
• Reporter: Sergiy Matusevych
• Created: 30/Nov/16 22:27
• Updated: 08/Dec/16 00:05
• Resolved: 08/Dec/16 00:05

Description

To run REEF as a library, we need to be able to co-locate REEF Driver with some other Application Master process (e.g. Spark AM or other REEF Driver). To that end, we need to introduce a driver configuration flag (e.g. DriverIsUnmanaged), and allow REEF runtime to check it and set the proper value in AM request (e.g. ApplicationSubmissionContext.setUnmanagedAM() in YARN API).