[REEF-1820] Allow specify node names when requesting evaluators

• Type: Task
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: REEF, REEF Bridge
• Assignee: Achuth Raghavendra
• Reporter: Julia Wang
• Created: 05/Jul/17 05:31
• Updated: 10/Jul/17 20:03

Description

Currently, when clients request for evaluators, .Net REEF doesn't not expose node names in IEvaluatorRequest. It default to null node names therefore it is up to YARN to assign available containers.

Some of the REEF clients would like to specify node names when requesting for evaluators. We should allow the preferred node names to be specified through IEvaluatorRequest and pass it to Java EvaluatorRequestorBridge.

As resources requested may not be available for various reasons, we should also allow the client to specify RelaxLocality in the IEvaluatorRequest. Setting RelaxLocality to true would allow YARN to return another container if the specified one is not available.