[MAPREDUCE-3096] Add a good way to control the number of map/reduce tasks per node

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Fix Version/s: 0.20.204.0
• Assignee: Unassigned
• Reporter: Arsen Zahray
• Created: 26/Sep/11 20:38
• Updated: 27/Sep/11 07:59
• Resolved: 27/Sep/11 07:22

Description

Currently, controlling the number of map/reduce tasks is a hell.

I've tried for it many times, and it doesn't work right. Also, I am not the only one person, who seems to have this problem.

There must be a better way to do it.

Here's my proposal:

add following functions to Job:
setNumberOfMappersPerNode(int);
setNumberOfReducersPerNode(int);
setMaxMemoryPerMapper(int);
setMaxMemoryPerReducer(int);