Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-2972 Umbrella ticket for test failures in 0.11/trunk
  3. PIG-2999

Regression after PIG-2975: BinInterSedesTupleRawComparator secondary sort failing

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.11, 0.12.0
    • 0.11
    • None
    • None

    Description

      I think I broke the build from PIG-2975. I see couple of tests failing at BinInterSedesTupleRawComparator.

      12/10/22 22:26:15 WARN mapred.LocalJobRunner: job_local_0022
      java.nio.BufferUnderflowException
      	at java.nio.Buffer.nextGetIndex(Buffer.java:478)
      	at java.nio.HeapByteBuffer.getLong(HeapByteBuffer.java:387)
      	at org.apache.pig.data.BinInterSedes$BinInterSedesTupleRawComparator.compareBinInterSedesDatum(BinInterSedes.java:829)
      	at org.apache.pig.data.BinInterSedes$BinInterSedesTupleRawComparator.compareBinSedesTuple(BinInterSedes.java:732)
      	at org.apache.pig.data.BinInterSedes$BinInterSedesTupleRawComparator.compare(BinInterSedes.java:695)
      	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigSecondaryKeyComparator.compare(PigSecondaryKeyComparator.java:78)
      	at org.apache.hadoop.mapred.Merger$MergeQueue.lessThan(Merger.java:373)
      	at org.apache.hadoop.util.PriorityQueue.downHeap(PriorityQueue.java:139)
      	at org.apache.hadoop.util.PriorityQueue.adjustTop(PriorityQueue.java:103)
      	at org.apache.hadoop.mapred.Merger$MergeQueue.adjustPriorityQueue(Merger.java:335)
      	at org.apache.hadoop.mapred.Merger$MergeQueue.next(Merger.java:350)
      	at org.apache.hadoop.mapred.ReduceTask$4.next(ReduceTask.java:625)
      	at org.apache.hadoop.mapreduce.ReduceContext.nextKeyValue(ReduceContext.java:117)
      	at org.apache.hadoop.mapreduce.ReduceContext.nextKey(ReduceContext.java:92)
      	at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:175)
      	at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:649)
      	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:417)
      	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:260)
      

      Attachments

        1. pig-2999-v1.txt
          0.9 kB
          Koji Noguchi
        2. pig-2999-v2.txt
          2 kB
          Koji Noguchi
        3. pig-2999-v3.txt
          6 kB
          Cheolsoo Park

        Issue Links

          Activity

            People

              knoguchi Koji Noguchi
              knoguchi Koji Noguchi
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: