Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-433

TestReduceFetch failed.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.20.2
    • None
    • None
    • Reviewed
    • Hide
      Resolves the test failure by modifying the test to base it on spill counters rather than on bytes read/written. It also introduces a new configuration parameter "mapred.job.shuffle.input.buffer.percent" to provide finer grained control on the memory limit to be used during shuffle.
      Show
      Resolves the test failure by modifying the test to base it on spill counters rather than on bytes read/written. It also introduces a new configuration parameter "mapred.job.shuffle.input.buffer.percent" to provide finer grained control on the memory limit to be used during shuffle.

    Description

      Testcase: testReduceFromMem took 23.625 sec
	FAILED
Non-zero read from local: 83
junit.framework.AssertionFailedError: Non-zero read from local: 83
	at org.apache.hadoop.mapred.TestReduceFetch.testReduceFromMem(TestReduceFetch.java:289)
	at junit.extensions.TestDecorator.basicRun(TestDecorator.java:24)
	at junit.extensions.TestSetup$1.protect(TestSetup.java:23)
	at junit.extensions.TestSetup.run(TestSetup.java:27)

      Ran TestReduceFetch a few times on a clean trunk. It failed consistently.

      Attachments

        1. 6029-0.patch
          5 kB
          Christopher Douglas
        2. 6029-1.patch
          5 kB
          Christopher Douglas
        3. 6029-2.patch
          6 kB
          Christopher Douglas
        4. FAILING-PARTIALMEM-TEST-org.apache.hadoop.mapred.TestReduceFetch.txt
          288 kB
          Devaraj Das
        5. M433-0v20.patch
          5 kB
          Christopher Douglas
        6. M433-1v20.patch
          5 kB
          Christopher Douglas
        7. M433-1y20.patch
          5 kB
          Christopher Douglas
        8. M433-v20.another.patch
          5 kB
          Devaraj Das
        9. TEST-org.apache.hadoop.mapred.TestReduceFetch.txt
          288 kB
          Tsz-wo Sze
        10. TEST-org.apache.hadoop.mapred.TestReduceFetch.txt
          302 kB
          Devaraj Das
        11. testReduceFromMem.txt
          287 kB
          Tsz-wo Sze

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-1172 TestReduceFetch failed in 0.20

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              cdouglas Christopher Douglas
              szetszwo Tsz-wo Sze
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: