[MAPREDUCE-1635] ResourceEstimator does not work after MAPREDUCE-842

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.21.0
• Fix Version/s: 0.21.0
• Component/s: tasktracker
• Hadoop Flags: Reviewed
• Release Note: Fixed a bug related to resource estimation for disk-based scheduling by modifying TaskTracker to return correct map output size for the completed maps and -1 for other tasks or failures.
• Assignee: Amareshwari Sriramadasu
• Reporter: Amareshwari Sriramadasu
• Created: 26/Mar/10 10:35
• Updated: 24/Aug/10 21:21
• Resolved: 12/Apr/10 14:21

Description

MAPREDUCE-842 changed Child's mapred.local.dir to have attemptDir as the base local directory. Also assumption is that
org.apache.hadoop.mapred.MapOutputFile always gets Child's mapred.local.dir.
But, MapOuptutFile.getOutputFile() is called from TaskTracker's conf, which does not find the output file. Thus TaskTracker.tryToGetOutputSize() always returns -1.

Issue Links

• incorporates: MAPREDUCE-1321 Spurios logs with org.apache.hadoop.util.DiskChecker$DiskErrorException in TaskTracker
• relates to: MAPREDUCE-1662 TaskRunner.prepare() and close() can be removed