Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-3647

Corner-case in IFile leads to failed tasks

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.18.0
    • Fix Version/s: 0.18.0
    • Component/s: None
    • Labels:
      None

      Description

      A couple of reduce tasks failed at IFile.Reader.next, one with:

      java.lang.NegativeArraySizeException
         at org.apache.hadoop.mapred.IFile$Reader.readNextBlock(IFile.java:246)
         at org.apache.hadoop.mapred.IFile$Reader.next(IFile.java:298)
         at org.apache.hadoop.mapred.Merger$Segment.next(Merger.java:134)
         at org.apache.hadoop.mapred.Merger$MergeQueue.adjustPriorityQueue(Merger.java:225)
         at org.apache.hadoop.mapred.Merger$MergeQueue.next(Merger.java:242)
         at org.apache.hadoop.mapred.Task$ValuesIterator.readNextKey(Task.java:720)
         at org.apache.hadoop.mapred.Task$ValuesIterator.next(Task.java:679)
         at org.apache.hadoop.mapred.ReduceTask$ReduceValuesIterator.next(ReduceTask.java:225)
         at org.apache.hadoop.mapred.lib.IdentityReducer.reduce(IdentityReducer.java:39)
         at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:316)
         at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2157)
      

      On a related note, another failed at:

      IFile.java:380
            // Position for the next record
            long skipped = dataIn.skip(recordLength);
            if (skipped != recordLength) {
              throw new IOException("Failed to skip past record of length: " + 
                                    recordLength);
            }
      

      where recordLength was -17.

        Attachments

        1. HADOOP-3647_0_20080708.patch
          17 kB
          Arun C Murthy
        2. HADOOP-3647_1_20080710.patch
          18 kB
          Arun C Murthy
        3. hadoop-logs.tar.gz
          132 kB
          Per Jacobsson

          Activity

            People

            • Assignee:
              acmurthy Arun C Murthy
              Reporter:
              acmurthy Arun C Murthy
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: