Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-2835

IndexOutOfBoundsException in partition sender when doing streaming aggregate with LIMIT

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.8.0
    • Fix Version/s: 0.9.0
    • Component/s: Execution - RPC
    • Labels:
      None

      Description

      Following CTAS run on a TPC-DS 100GB scale factor on a 10-node cluster:

      alter session set `planner.enable_hashagg` = false;
      alter session set `planner.enable_multiphase_agg` = true;
      create table dfs.tmp.stream9 as 
      select cr_call_center_sk , cr_catalog_page_sk ,  cr_item_sk , cr_reason_sk , cr_refunded_addr_sk , count(*) from catalog_returns_dri100 
       group by cr_call_center_sk , cr_catalog_page_sk ,  cr_item_sk , cr_reason_sk , cr_refunded_addr_sk
       limit 100
      ;
      
      Caused by: java.lang.IndexOutOfBoundsException: index: 1023, length: 1 (expected: range(0, 0))
              at io.netty.buffer.DrillBuf.checkIndexD(DrillBuf.java:200) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:4.0.24.Final]
              at io.netty.buffer.DrillBuf.chk(DrillBuf.java:222) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:4.0.24.Final]
              at io.netty.buffer.DrillBuf.setByte(DrillBuf.java:621) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:4.0.24.Final]
              at org.apache.drill.exec.vector.UInt1Vector$Mutator.set(UInt1Vector.java:342) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
              at org.apache.drill.exec.vector.NullableBigIntVector$Mutator.set(NullableBigIntVector.java:372) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
              at org.apache.drill.exec.vector.NullableBigIntVector.copyFrom(NullableBigIntVector.java:284) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
              at org.apache.drill.exec.test.generated.PartitionerGen4$OutgoingRecordBatch.doEval(PartitionerTemplate.java:370) ~[na:na]
              at org.apache.drill.exec.test.generated.PartitionerGen4$OutgoingRecordBatch.copy(PartitionerTemplate.java:249) ~[na:na]
              at org.apache.drill.exec.test.generated.PartitionerGen4.doCopy(PartitionerTemplate.java:208) ~[na:na]
              at org.apache.drill.exec.test.generated.PartitionerGen4.partitionBatch(PartitionerTemplate.java:176) ~[na:na]
      

        Attachments

        1. DRILL-2835-1.patch
          2 kB
          Venki Korukanti
        2. DRILL-2835-2.patch
          3 kB
          Venki Korukanti

          Activity

            People

            • Assignee:
              vkorukanti Venki Korukanti
              Reporter:
              amansinha100 Aman Sinha
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: