Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.17.0
    • Fix Version/s: 0.17.1
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Map-Reduce jobs which worked with 0.16.* are failing with OOM with the following trace:

      java.lang.OutOfMemoryError: Java heap space
              at java.util.Arrays.copyOf(Arrays.java:2786)
              at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:94)
              at java.io.DataOutputStream.write(DataOutputStream.java:90)
              at org.apache.hadoop.io.SequenceFile$UncompressedBytes.writeUncompressedBytes(SequenceFile.java:617)
              at org.apache.hadoop.mapred.ReduceTask$ValuesIterator.readNextValue(ReduceTask.java:289)
              at org.apache.hadoop.mapred.ReduceTask$ValuesIterator.next(ReduceTask.java:232)
              at org.apache.hadoop.mapred.ReduceTask$ReduceValuesIterator.next(ReduceTask.java:311)
              at org.apache.hadoop.streaming.PipeReducer.reduce(PipeReducer.java:67)
              at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:391)
              at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)
      
      1. 3550-0.patch
        1 kB
        Chris Douglas
      2. 3550-0v17.patch
        1 kB
        Chris Douglas

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Chris Douglas
              Reporter:
              Arun C Murthy
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development