[DRILL-6607] Index Out of Bounds Error in string_binary function - ASF JIRA

Attach files

Attach Screenshot

Add vote

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Bug
Status: Open
Priority: Major
Resolution: Unresolved
Affects Version/s: 1.13.0
Fix Version/s: None
Component/s: Server
Labels:
None

Description

I am running a query with the pcap plugin. When I run

select `type`, `timestamp`, `src_ip`, `dst_ip`, `src_port`, `dst_port`, `tcp_parsed_flags`, `packet_length`, `data`
from dfs.root.`user/jomernik/bf2_7306.pcap` where `type` <> 'ARP' limit 10

It returns properly, when I run:

select `type`, `timestamp`, `src_ip`, `dst_ip`, `src_port`, `dst_port`, `tcp_parsed_flags`, `packet_length`, `data`, string_binary(`data`) as mydata
from dfs.root.`user/jomernik/bf2_7306.pcap` where `type` <> 'ARP' limit 10

SYSTEM ERROR: IndexOutOfBoundsException: index: 0, length: 1472 (expected: range(0, 256)) Fragment 0:0 [Error Id: 2b804cdf-16c3-4f55-80f5-1cf3b9b6610b on zeta3.brewingintel.com:20005]

Full Error:

2018-07-13 15:41:33,187 [24b6f183-8db2-a1ce-3fdb-293cc9d45b9b:frag:0:0] INFO o.a.d.e.w.fragment.FragmentExecutor - 24b6f183-8db2-a1ce-3fdb-293cc9d45b9b:0:0: State change requested RUNNING --> FAILED

2018-07-13 15:41:33,188 [24b6f183-8db2-a1ce-3fdb-293cc9d45b9b:frag:0:0] INFO o.a.d.e.w.fragment.FragmentExecutor - 24b6f183-8db2-a1ce-3fdb-293cc9d45b9b:0:0: State change requested FAILED --> FINISHED

2018-07-13 15:41:33,191 [24b6f183-8db2-a1ce-3fdb-293cc9d45b9b:frag:0:0] ERROR o.a.d.e.w.fragment.FragmentExecutor - SYSTEM ERROR: IndexOutOfBoundsException: index: 0, length: 1472 (expected: range(0, 256))

Fragment 0:0

[Error Id: 2b804cdf-16c3-4f55-80f5-1cf3b9b6610b on zeta3.brewingintel.com:20005]

org.apache.drill.common.exceptions.UserException: SYSTEM ERROR: IndexOutOfBoundsException: index: 0, length: 1472 (expected: range(0, 256))

Fragment 0:0

[Error Id: 2b804cdf-16c3-4f55-80f5-1cf3b9b6610b on zeta3.brewingintel.com:20005]

at org.apache.drill.common.exceptions.UserException$Builder.build(UserException.java:633) ~[drill-common-1.13.0-mapr.jar:1.13.0-mapr]

at org.apache.drill.exec.work.fragment.FragmentExecutor.sendFinalState(FragmentExecutor.java:300) [drill-java-exec-1.13.0-mapr.jar:1.13.0-mapr]

at org.apache.drill.exec.work.fragment.FragmentExecutor.cleanup(FragmentExecutor.java:160) [drill-java-exec-1.13.0-mapr.jar:1.13.0-mapr]

at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:266) [drill-java-exec-1.13.0-mapr.jar:1.13.0-mapr]

at org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38) [drill-common-1.13.0-mapr.jar:1.13.0-mapr]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_121]

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_121]

at java.lang.Thread.run(Thread.java:745) [na:1.8.0_121]

Caused by: java.lang.IndexOutOfBoundsException: index: 0, length: 1472 (expected: range(0, 256))

at io.netty.buffer.AbstractByteBuf.checkIndex0(AbstractByteBuf.java:1125) ~[netty-buffer-4.0.48.Final.jar:4.0.48.Final]

at io.netty.buffer.AbstractByteBuf.checkIndex(AbstractByteBuf.java:1120) ~[netty-buffer-4.0.48.Final.jar:4.0.48.Final]

at io.netty.buffer.UnsafeByteBufUtil.setBytes(UnsafeByteBufUtil.java:349) ~[netty-buffer-4.0.48.Final.jar:4.0.48.Final]

at io.netty.buffer.PooledUnsafeDirectByteBuf.setBytes(PooledUnsafeDirectByteBuf.java:199) ~[netty-buffer-4.0.48.Final.jar:4.0.48.Final]

at io.netty.buffer.WrappedByteBuf.setBytes(WrappedByteBuf.java:397) ~[netty-buffer-4.0.48.Final.jar:4.0.48.Final]

at io.netty.buffer.UnsafeDirectLittleEndian.setBytes(UnsafeDirectLittleEndian.java:37) ~[drill-memory-base-1.13.0-mapr.jar:4.0.48.Final]

at io.netty.buffer.DrillBuf.setBytes(DrillBuf.java:767) ~[drill-memory-base-1.13.0-mapr.jar:4.0.48.Final]

at io.netty.buffer.AbstractByteBuf.setBytes(AbstractByteBuf.java:528) ~[netty-buffer-4.0.48.Final.jar:4.0.48.Final]

at org.apache.drill.exec.test.generated.ProjectorGen2.doEval(ProjectorTemplate.java:77) ~[na:na]

at org.apache.drill.exec.test.generated.ProjectorGen2.projectRecords(ProjectorTemplate.java:67) ~[na:na]

at org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doWork(ProjectRecordBatch.java:198) ~[drill-java-exec-1.13.0-mapr.jar:1.13.0-mapr]

at org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:97) ~[drill-java-exec-1.13.0-mapr.jar:1.13.0-mapr]

at org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:134) ~[drill-java-exec-1.13.0-mapr.jar:1.13.0-mapr]

at org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:164) ~[drill-java-exec-1.13.0-mapr.jar:1.13.0-mapr]

at org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:105) ~[drill-java-exec-1.13.0-mapr.jar:1.13.0-mapr]

at org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:83) ~[drill-java-exec-1.13.0-mapr.jar:1.13.0-mapr]

at org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:95) ~[drill-java-exec-1.13.0-mapr.jar:1.13.0-mapr]

at org.apache.drill.exec.work.fragment.FragmentExecutor$1.run(FragmentExecutor.java:233) ~[drill-java-exec-1.13.0-mapr.jar:1.13.0-mapr]

at org.apache.drill.exec.work.fragment.FragmentExecutor$1.run(FragmentExecutor.java:226) ~[drill-java-exec-1.13.0-mapr.jar:1.13.0-mapr]

at java.security.AccessController.doPrivileged(Native Method) ~[na:1.8.0_121]

at javax.security.auth.Subject.doAs(Subject.java:422) ~[na:1.8.0_121]

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1633) ~[hadoop-common-2.7.0-mapr-1710.jar:na]

at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:226) [drill-java-exec-1.13.0-mapr.jar:1.13.0-mapr]

... 4 common frames omitted

2018-07-13 15:41:33,216 [BitServer-5] WARN o.a.d.exec.rpc.control.WorkEventBus - Fragment 24b6f183-8db2-a1ce-3fdb-293cc9d45b9b:0:0 manager is not found in the work bus.

2018-07-13 15:41:33,217 [BitServer-5] INFO o.a.d.e.w.fragment.FragmentExecutor - 24b6f183-8db2-a1ce-3fdb-293cc9d45b9b:0:0: State change requested FAILED --> CANCELLATION_REQUESTED

2018-07-13 15:41:33,217 [BitServer-5] WARN o.a.d.e.w.fragment.FragmentExecutor - 24b6f183-8db2-a1ce-3fdb-293cc9d45b9b:0:0: Ignoring unexpected state transition FAILED --> CANCELLATION_REQUESTED