Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.17.0
    • Fix Version/s: 0.17.1
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Map-Reduce jobs which worked with 0.16.* are failing with OOM with the following trace:

      java.lang.OutOfMemoryError: Java heap space
              at java.util.Arrays.copyOf(Arrays.java:2786)
              at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:94)
              at java.io.DataOutputStream.write(DataOutputStream.java:90)
              at org.apache.hadoop.io.SequenceFile$UncompressedBytes.writeUncompressedBytes(SequenceFile.java:617)
              at org.apache.hadoop.mapred.ReduceTask$ValuesIterator.readNextValue(ReduceTask.java:289)
              at org.apache.hadoop.mapred.ReduceTask$ValuesIterator.next(ReduceTask.java:232)
              at org.apache.hadoop.mapred.ReduceTask$ReduceValuesIterator.next(ReduceTask.java:311)
              at org.apache.hadoop.streaming.PipeReducer.reduce(PipeReducer.java:67)
              at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:391)
              at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)
      

        Attachments

        1. 3550-0v17.patch
          1 kB
          Chris Douglas
        2. 3550-0.patch
          1 kB
          Chris Douglas

          Issue Links

            Activity

              People

              • Assignee:
                chris.douglas Chris Douglas
                Reporter:
                acmurthy Arun C Murthy
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: