Hadoop Common
  1. Hadoop Common
  2. HADOOP-2053

OutOfMemoryError : Java heap space errors in hadoop 0.14

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.14.0, 0.14.1, 0.14.2
    • Fix Version/s: 0.14.3
    • Component/s: None
    • Labels:
      None

      Description

      In recent hadoop 0.14 we are seeing few jobs where map taskf fail with java.lang.OutOfMemoryError: Java heap space problem
      These were the same jobs which used to work fine with 0.13

      <stack>
      task_200710112103_0001_m_000015_1: java.lang.OutOfMemoryError: Java heap space
      at java.util.Arrays.copyOf(Arrays.java:2786)
      at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:94)
      at java.io.DataOutputStream.write(DataOutputStream.java:90)
      at org.apache.hadoop.io.Text.write(Text.java:243)
      at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:340)
      </stack>

        Issue Links

          Activity

          Lohit Vijayarenu created issue -
          Devaraj Das made changes -
          Field Original Value New Value
          Affects Version/s 0.14.0 [ 12312474 ]
          Fix Version/s 0.15.0 [ 12312565 ]
          Affects Version/s 0.14.2 [ 12312762 ]
          Priority Major [ 3 ] Blocker [ 1 ]
          Owen O'Malley made changes -
          Fix Version/s 0.14.3 [ 12312830 ]
          Assignee Arun C Murthy [ acmurthy ]
          Arun C Murthy made changes -
          Attachment HADOOP-2053_1_20071015.patch [ 12367742 ]
          Arun C Murthy made changes -
          Link This issue blocks HADOOP-2054 [ HADOOP-2054 ]
          Owen O'Malley made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Owen O'Malley made changes -
          Component/s mapred [ 12310690 ]

            People

            • Assignee:
              Arun C Murthy
              Reporter:
              Lohit Vijayarenu
            • Votes:
              1 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development