[MYRIAD-102] Make all NM ports configurable

• Type: Sub-task
• Status: Resolved
• Resolution: Fixed
• Fix Version/s: Myriad 0.1.0
• Assignee: Darin J
• Reporter: Darin J
• Created: 15/May/15 02:44
• Updated: 10/Nov/15 20:44
• Resolved: 10/Nov/15 20:02

Description

Mesos now dynamically configures ports of the Node Manager. This addresses Issue MYRIAD-40 completely and Issue MYRIAD-45 partially.

This is done by first checking if three ports are available in the resource offer, if so they are added the TaskInfo object and passed to the executor via NMTaskConfig.

Added NMPorts.java, an immutable helper class used by TaskFactory.java, essentially a Tuple Object.

Tested on one node cluster, map reduce jobs complete as expected, all NM web ports are linked to the RM as expected.

Updated myriad-dev.md to reflect changes. Other than the modifications to yarn-site.xml no other changes are needed. If the modifications are left out, the node manage will use the default ports.

Issue Links

• is duplicated by: MYRIAD-45 Make all NM ports configurable