Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-3647

Corner-case in IFile leads to failed tasks

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.18.0
    • 0.18.0
    • None
    • None

    Description

      A couple of reduce tasks failed at IFile.Reader.next, one with:

      java.lang.NegativeArraySizeException
         at org.apache.hadoop.mapred.IFile$Reader.readNextBlock(IFile.java:246)
         at org.apache.hadoop.mapred.IFile$Reader.next(IFile.java:298)
         at org.apache.hadoop.mapred.Merger$Segment.next(Merger.java:134)
         at org.apache.hadoop.mapred.Merger$MergeQueue.adjustPriorityQueue(Merger.java:225)
         at org.apache.hadoop.mapred.Merger$MergeQueue.next(Merger.java:242)
         at org.apache.hadoop.mapred.Task$ValuesIterator.readNextKey(Task.java:720)
         at org.apache.hadoop.mapred.Task$ValuesIterator.next(Task.java:679)
         at org.apache.hadoop.mapred.ReduceTask$ReduceValuesIterator.next(ReduceTask.java:225)
         at org.apache.hadoop.mapred.lib.IdentityReducer.reduce(IdentityReducer.java:39)
         at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:316)
         at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2157)
      

      On a related note, another failed at:

      IFile.java:380
            // Position for the next record
            long skipped = dataIn.skip(recordLength);
            if (skipped != recordLength) {
              throw new IOException("Failed to skip past record of length: " + 
                                    recordLength);
            }
      

      where recordLength was -17.

      Attachments

        1. HADOOP-3647_0_20080708.patch
          17 kB
          Arun Murthy
        2. HADOOP-3647_1_20080710.patch
          18 kB
          Arun Murthy
        3. hadoop-logs.tar.gz
          132 kB
          Per Jacobsson

        Activity

          People

            acmurthy Arun Murthy
            acmurthy Arun Murthy
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: