[MAPREDUCE-6400] Multiple shuffle transfer fails because input is closed too early

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 2.8.0
• Fix Version/s: 2.8.0, 3.0.0-alpha1
• Component/s: task
• Target Version/s: 2.8.0
• Hadoop Flags: Reviewed
• Assignee: Brahma Reddy Battula
• Reporter: Akira Ajisaka
• Created: 15/Jun/15 23:58
• Updated: 14/Oct/19 15:38
• Resolved: 24/Jun/15 15:31

Description

TestReduceFetchFromPartialMem fails.

Running org.apache.hadoop.mapred.TestReduceFetchFromPartialMem
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 132.978 sec <<< FAILURE! - in org.apache.hadoop.mapred.TestReduceFetchFromPartialMem
testReduceFromPartialMem(org.apache.hadoop.mapred.TestReduceFetchFromPartialMem)  Time elapsed: 69.214 sec  <<< ERROR!
java.io.IOException: Job failed!
	at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:867)
	at org.apache.hadoop.mapred.TestReduceFetchFromPartialMem.runJob(TestReduceFetchFromPartialMem.java:300)
	at org.apache.hadoop.mapred.TestReduceFetchFromPartialMem.testReduceFromPartialMem(TestReduceFetchFromPartialMem.java:93)


Results :

Tests in error: 
  TestReduceFetchFromPartialMem.testReduceFromPartialMem:93->runJob:300 » IO Job...

Tests run: 1, Failures: 0, Errors: 1, Skipped: 0

Issue Links

• is broken by: MAPREDUCE-6174 Combine common stream code into parent class for InMemoryMapOutput and OnDiskMapOutput.