[MAPREDUCE-2198] Allow FairScheduler to control the number of slots on each TaskTracker

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 0.23.0
• Fix Version/s: 0.23.0
• Component/s: contrib/fair-share
• Assignee: Scott Chen
• Reporter: Scott Chen
• Created: 23/Nov/10 02:38
• Updated: 15/Nov/11 00:49
• Resolved: 15/Sep/11 05:09

Description

We can set the number of slots on the TaskTracker to be high and let FairScheduler handles the slots.
This approach allows us to change the number of slots on each node dynamically.
The administrator can change the number of slots with a CLI tool.

One use case of this is for upgrading the MapReduce.
Instead of restarting the cluster, we can run the new MapReduce on the same cluster.
And use the CLI tool to gradually migrate the slots.
This way we don't lost the progress fo the jobs that's already executed.

Issue Links

• relates to: MAPREDUCE-2108 Allow TaskScheduler manage number slots on TaskTrackers