[MAPREDUCE-4079] Allow MR AppMaster to limit ephemeral port range.

• Type: Improvement
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.23.2, 2.0.0-alpha
• Fix Version/s: 0.23.3, 2.0.2-alpha
• Component/s: mr-am, mrv2
• Target Version/s: 0.23.3, 2.0.0-alpha
• Assignee: Robert Joseph Evans Assign to me
• Reporter: Robert Joseph Evans
• Created: 28/Mar/12 15:45
• Updated: 17/Jun/15 12:46
• Resolved: 24/Apr/12 13:07

Description

Having the MapReduce Application Masters bind to any ephemeral port makes it very difficult to setup ACLs. mapreduce.job.am-access-disabled from MAPREDUCE-3251 is not a practical permanent solution for all jobs. Especially for tools like pig where they are not aware of mapreduce.job.am-access-disabled and may deal with it properly.

We should add in a config option that would allow someone to restrict the range of ports that the MR-AM can bind to. It will slow down startup in some cases because we will have to probe for open ports instead of just asking the OS to find one for us. But we can make that conditional on this config so users who do not set this config do not see any performance degradation.

Issue Links

• depends upon: HADOOP-8227 Allow RPC to limit ephemeral port range.
• is related to: HADOOP-12097 Allow port range to be specified while starting webapp