Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-2835

IndexOutOfBoundsException in partition sender when doing streaming aggregate with LIMIT

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.8.0
    • 0.9.0
    • Execution - RPC
    • None

    Description

      Following CTAS run on a TPC-DS 100GB scale factor on a 10-node cluster:

      alter session set `planner.enable_hashagg` = false;
      alter session set `planner.enable_multiphase_agg` = true;
      create table dfs.tmp.stream9 as 
      select cr_call_center_sk , cr_catalog_page_sk ,  cr_item_sk , cr_reason_sk , cr_refunded_addr_sk , count(*) from catalog_returns_dri100 
       group by cr_call_center_sk , cr_catalog_page_sk ,  cr_item_sk , cr_reason_sk , cr_refunded_addr_sk
       limit 100
      ;
      
      Caused by: java.lang.IndexOutOfBoundsException: index: 1023, length: 1 (expected: range(0, 0))
              at io.netty.buffer.DrillBuf.checkIndexD(DrillBuf.java:200) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:4.0.24.Final]
              at io.netty.buffer.DrillBuf.chk(DrillBuf.java:222) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:4.0.24.Final]
              at io.netty.buffer.DrillBuf.setByte(DrillBuf.java:621) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:4.0.24.Final]
              at org.apache.drill.exec.vector.UInt1Vector$Mutator.set(UInt1Vector.java:342) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
              at org.apache.drill.exec.vector.NullableBigIntVector$Mutator.set(NullableBigIntVector.java:372) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
              at org.apache.drill.exec.vector.NullableBigIntVector.copyFrom(NullableBigIntVector.java:284) ~[drill-java-exec-0.9.0-SNAPSHOT-rebuffed.jar:0.9.0-SNAPSHOT]
              at org.apache.drill.exec.test.generated.PartitionerGen4$OutgoingRecordBatch.doEval(PartitionerTemplate.java:370) ~[na:na]
              at org.apache.drill.exec.test.generated.PartitionerGen4$OutgoingRecordBatch.copy(PartitionerTemplate.java:249) ~[na:na]
              at org.apache.drill.exec.test.generated.PartitionerGen4.doCopy(PartitionerTemplate.java:208) ~[na:na]
              at org.apache.drill.exec.test.generated.PartitionerGen4.partitionBatch(PartitionerTemplate.java:176) ~[na:na]
      

      Attachments

        1. DRILL-2835-2.patch
          3 kB
          Venki Korukanti
        2. DRILL-2835-1.patch
          2 kB
          Venki Korukanti

        Activity

          People

            vkorukanti Venki Korukanti
            amansinha100 Aman Sinha
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: