[REEF-98] Run REEF Driver on a Mesos slave node

• Type: Task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: REEF-Runtime-Mesos
• Assignee: John Yang
• Reporter: John Yang
• Created: 23/Jan/15 04:40
• Updated: 23/Jan/15 04:40

Description

As Mesos framework scheduler runs as a local process by default, the current Mesos runtime runs REEF driver(which is effectively a Messo framework scheduler) at the machine the REEF job is submitted.

To be consistent with the abstraction REEF provides in a cluster environment, we need to enable running REEF Driver on a slave node of Mesos cluster.

We could come up with our own solution for doing this or make use of other meta-frameworks such as Marathon and Aurora.