[MAPREDUCE-433] TestReduceFetch failed.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.20.2
• Hadoop Flags: Reviewed

Release Note

Resolves the test failure by modifying the test to base it on spill counters rather than on bytes read/written. It also introduces a new configuration parameter "mapred.job.shuffle.input.buffer.percent" to provide finer grained control on the memory limit to be used during shuffle.

• Assignee: Christopher Douglas
• Reporter: Tsz-wo Sze
• Created: 12/Jun/09 19:31
• Updated: 23/Feb/10 06:31
• Resolved: 26/Jan/10 07:54

Description

Testcase: testReduceFromMem took 23.625 sec
	FAILED
Non-zero read from local: 83
junit.framework.AssertionFailedError: Non-zero read from local: 83
	at org.apache.hadoop.mapred.TestReduceFetch.testReduceFromMem(TestReduceFetch.java:289)
	at junit.extensions.TestDecorator.basicRun(TestDecorator.java:24)
	at junit.extensions.TestSetup$1.protect(TestSetup.java:23)
	at junit.extensions.TestSetup.run(TestSetup.java:27)

Ran TestReduceFetch a few times on a clean trunk. It failed consistently.

Issue Links

• is duplicated by: MAPREDUCE-1172 TestReduceFetch failed in 0.20