[MAPREDUCE-6912] CompletedMapTask contains failed and killed will lead mapreduce.job.reduce.slowstart.completedmaps not work properly

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.6.2
• Component/s: mrv2
• Assignee: Unassigned
• Reporter: SuYan
• Created: 06/Jul/17 03:16
• Updated: 06/Jul/17 03:17

Description

if the conf is set to 1, is about to make reduce task to be scheduled only after all map task success

int completedMapsForReduceSlowstart = (int)Math.ceil(reduceSlowStart *
totalMaps);
if(completedMaps < completedMapsForReduceSlowstart) {}

///////////////////////////

int completedMaps = getJob().getCompletedMaps();

///////////////////////////
JobImpl
 @Override
public int getCompletedMaps() {
readLock.lock();
try {
return succeededMapTaskCount + failedMapTaskCount + killedMapTaskCount;
} finally {
readLock.unlock();
}
}