[DRILL-4026] CTAS Auto Partition on a wide varchar column is giving an IllegalReferenceCountException

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Execution - Data Types, Storage - Writer
• Assignee: Unassigned
• Reporter: Rahul Kumar Challapalli
• Created: 04/Nov/15 01:06
• Updated: 14/Mar/17 22:15

Description

git.commit.id.abbrev=bb69f22

The below query fails

create table vc_part partition by (a) as select cast(columns[0] as varchar(6000)) a, columns[1] b from dfs.`/drill/testdata/abc.tbl`;
Error: SYSTEM ERROR: IllegalReferenceCountException: refCnt: 0

Fragment 0:0

[Error Id: 8bbfcadb-07bb-468c-a772-24c85cecbcf6 on qa-node191.qa.lab:31010]

  (io.netty.util.IllegalReferenceCountException) refCnt: 0
    io.netty.buffer.AbstractByteBuf.ensureAccessible():1178
    io.netty.buffer.DrillBuf.checkIndexD():184
    io.netty.buffer.DrillBuf.checkBytes():205
    org.apache.drill.exec.expr.fn.impl.ByteFunctionHelpers.compare():101
    org.apache.drill.exec.test.generated.ProjectorGen2.doEval():49
    org.apache.drill.exec.test.generated.ProjectorGen2.projectRecords():62
    org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doWork():173
    org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext():93
    org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():130
    org.apache.drill.exec.record.AbstractRecordBatch.next():156
    org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():119
    org.apache.drill.exec.record.AbstractRecordBatch.next():113
    org.apache.drill.exec.record.AbstractRecordBatch.next():103
    org.apache.drill.exec.physical.impl.WriterRecordBatch.innerNext():91
    org.apache.drill.exec.record.AbstractRecordBatch.next():156
    org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():119
    org.apache.drill.exec.record.AbstractRecordBatch.next():113
    org.apache.drill.exec.record.AbstractRecordBatch.next():103
    org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext():51
    org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():130
    org.apache.drill.exec.record.AbstractRecordBatch.next():156
    org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():119
    org.apache.drill.exec.physical.impl.BaseRootExec.next():104
    org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext():80
    org.apache.drill.exec.physical.impl.BaseRootExec.next():94
    org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():256
    org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():250
    java.security.AccessController.doPrivileged():-2
    javax.security.auth.Subject.doAs():415
    org.apache.hadoop.security.UserGroupInformation.doAs():1595
    org.apache.drill.exec.work.fragment.FragmentExecutor.run():250
    org.apache.drill.common.SelfCleaningRunnable.run():38
    java.util.concurrent.ThreadPoolExecutor.runWorker():1145
    java.util.concurrent.ThreadPoolExecutor$Worker.run():615
    java.lang.Thread.run():745 (state=,code=0)

The data set contains a widestring (5000 chars) as the first column

Issue Links

• Blocked: DRILL-4872 NPE from CTAS partitioned by a projected casted null