[MAPREDUCE-1761] FairScheduler should allow separate configuration of node and rack locality wait time

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.22.0
• Fix Version/s: 0.22.0
• Hadoop Flags: Reviewed
• Assignee: Scott Chen
• Reporter: Scott Chen
• Created: 06/May/10 19:13
• Updated: 12/Dec/11 06:20
• Resolved: 12/May/10 05:11

Description

It would be nice that we can separately assign rack locality wait time.
In our use case, we would set node locality wait to zero and wait only rack locality.

I propose that we add two parameters
mapred.fairscheduler.locality.delay.nodetorack
mapred.fairscheduler.locality.delay.racktoany
This allows specifying the wait time on each stage.

And we can use
mapred.fairscheduler.locality.delay
as the default value of the above fields so that this is backward compatible.

Thoughts?