Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-6607

Index Out of Bounds Error in string_binary function

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.13.0
    • None
    • Server
    • None

    Description

      I am running a query with the pcap plugin.  When I run 

       

      select `type`, `timestamp`, `src_ip`, `dst_ip`, `src_port`, `dst_port`, `tcp_parsed_flags`, `packet_length`, `data`
      from dfs.root.`user/jomernik/bf2_7306.pcap` where `type` <> 'ARP' limit 10

       

      It returns properly, when I run:

      select `type`, `timestamp`, `src_ip`, `dst_ip`, `src_port`, `dst_port`, `tcp_parsed_flags`, `packet_length`, `data`, string_binary(`data`) as mydata
      from dfs.root.`user/jomernik/bf2_7306.pcap` where `type` <> 'ARP' limit 10

       

      SYSTEM ERROR: IndexOutOfBoundsException: index: 0, length: 1472 (expected: range(0, 256)) Fragment 0:0 [Error Id: 2b804cdf-16c3-4f55-80f5-1cf3b9b6610b on zeta3.brewingintel.com:20005]

      Full Error:

      2018-07-13 15:41:33,187 [24b6f183-8db2-a1ce-3fdb-293cc9d45b9b:frag:0:0] INFO  o.a.d.e.w.fragment.FragmentExecutor - 24b6f183-8db2-a1ce-3fdb-293cc9d45b9b:0:0: State change requested RUNNING --> FAILED

      2018-07-13 15:41:33,188 [24b6f183-8db2-a1ce-3fdb-293cc9d45b9b:frag:0:0] INFO  o.a.d.e.w.fragment.FragmentExecutor - 24b6f183-8db2-a1ce-3fdb-293cc9d45b9b:0:0: State change requested FAILED --> FINISHED

      2018-07-13 15:41:33,191 [24b6f183-8db2-a1ce-3fdb-293cc9d45b9b:frag:0:0] ERROR o.a.d.e.w.fragment.FragmentExecutor - SYSTEM ERROR: IndexOutOfBoundsException: index: 0, length: 1472 (expected: range(0, 256))

       

      Fragment 0:0

       

      [Error Id: 2b804cdf-16c3-4f55-80f5-1cf3b9b6610b on zeta3.brewingintel.com:20005]

      org.apache.drill.common.exceptions.UserException: SYSTEM ERROR: IndexOutOfBoundsException: index: 0, length: 1472 (expected: range(0, 256))

       

      Fragment 0:0

       

      [Error Id: 2b804cdf-16c3-4f55-80f5-1cf3b9b6610b on zeta3.brewingintel.com:20005]

      at org.apache.drill.common.exceptions.UserException$Builder.build(UserException.java:633) ~[drill-common-1.13.0-mapr.jar:1.13.0-mapr]

      at org.apache.drill.exec.work.fragment.FragmentExecutor.sendFinalState(FragmentExecutor.java:300) [drill-java-exec-1.13.0-mapr.jar:1.13.0-mapr]

      at org.apache.drill.exec.work.fragment.FragmentExecutor.cleanup(FragmentExecutor.java:160) [drill-java-exec-1.13.0-mapr.jar:1.13.0-mapr]

      at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:266) [drill-java-exec-1.13.0-mapr.jar:1.13.0-mapr]

      at org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38) [drill-common-1.13.0-mapr.jar:1.13.0-mapr]

      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_121]

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_121]

      at java.lang.Thread.run(Thread.java:745) [na:1.8.0_121]

      Caused by: java.lang.IndexOutOfBoundsException: index: 0, length: 1472 (expected: range(0, 256))

      at io.netty.buffer.AbstractByteBuf.checkIndex0(AbstractByteBuf.java:1125) ~[netty-buffer-4.0.48.Final.jar:4.0.48.Final]

      at io.netty.buffer.AbstractByteBuf.checkIndex(AbstractByteBuf.java:1120) ~[netty-buffer-4.0.48.Final.jar:4.0.48.Final]

      at io.netty.buffer.UnsafeByteBufUtil.setBytes(UnsafeByteBufUtil.java:349) ~[netty-buffer-4.0.48.Final.jar:4.0.48.Final]

      at io.netty.buffer.PooledUnsafeDirectByteBuf.setBytes(PooledUnsafeDirectByteBuf.java:199) ~[netty-buffer-4.0.48.Final.jar:4.0.48.Final]

      at io.netty.buffer.WrappedByteBuf.setBytes(WrappedByteBuf.java:397) ~[netty-buffer-4.0.48.Final.jar:4.0.48.Final]

      at io.netty.buffer.UnsafeDirectLittleEndian.setBytes(UnsafeDirectLittleEndian.java:37) ~[drill-memory-base-1.13.0-mapr.jar:4.0.48.Final]

      at io.netty.buffer.DrillBuf.setBytes(DrillBuf.java:767) ~[drill-memory-base-1.13.0-mapr.jar:4.0.48.Final]

      at io.netty.buffer.AbstractByteBuf.setBytes(AbstractByteBuf.java:528) ~[netty-buffer-4.0.48.Final.jar:4.0.48.Final]

      at org.apache.drill.exec.test.generated.ProjectorGen2.doEval(ProjectorTemplate.java:77) ~[na:na]

      at org.apache.drill.exec.test.generated.ProjectorGen2.projectRecords(ProjectorTemplate.java:67) ~[na:na]

      at org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doWork(ProjectRecordBatch.java:198) ~[drill-java-exec-1.13.0-mapr.jar:1.13.0-mapr]

      at org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:97) ~[drill-java-exec-1.13.0-mapr.jar:1.13.0-mapr]

      at org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:134) ~[drill-java-exec-1.13.0-mapr.jar:1.13.0-mapr]

      at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:164) ~[drill-java-exec-1.13.0-mapr.jar:1.13.0-mapr]

      at org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:105) ~[drill-java-exec-1.13.0-mapr.jar:1.13.0-mapr]

      at org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:83) ~[drill-java-exec-1.13.0-mapr.jar:1.13.0-mapr]

      at org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:95) ~[drill-java-exec-1.13.0-mapr.jar:1.13.0-mapr]

      at org.apache.drill.exec.work.fragment.FragmentExecutor$1.run(FragmentExecutor.java:233) ~[drill-java-exec-1.13.0-mapr.jar:1.13.0-mapr]

      at org.apache.drill.exec.work.fragment.FragmentExecutor$1.run(FragmentExecutor.java:226) ~[drill-java-exec-1.13.0-mapr.jar:1.13.0-mapr]

      at java.security.AccessController.doPrivileged(Native Method) ~[na:1.8.0_121]

      at javax.security.auth.Subject.doAs(Subject.java:422) ~[na:1.8.0_121]

      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1633) ~[hadoop-common-2.7.0-mapr-1710.jar:na]

      at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:226) [drill-java-exec-1.13.0-mapr.jar:1.13.0-mapr]

      ... 4 common frames omitted

      2018-07-13 15:41:33,216 [BitServer-5] WARN  o.a.d.exec.rpc.control.WorkEventBus - Fragment 24b6f183-8db2-a1ce-3fdb-293cc9d45b9b:0:0 manager is not found in the work bus.

      2018-07-13 15:41:33,217 [BitServer-5] INFO  o.a.d.e.w.fragment.FragmentExecutor - 24b6f183-8db2-a1ce-3fdb-293cc9d45b9b:0:0: State change requested FAILED --> CANCELLATION_REQUESTED

      2018-07-13 15:41:33,217 [BitServer-5] WARN  o.a.d.e.w.fragment.FragmentExecutor - 24b6f183-8db2-a1ce-3fdb-293cc9d45b9b:0:0: Ignoring unexpected state transition FAILED --> CANCELLATION_REQUESTED

       

       

       

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            mandoskippy John Omernik
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: