Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-1787

Memory leak in kvgen function

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.7.0
    • Functions - Drill
    • None

    Description

      Running a kvgen on a map with large values will produce a memory leak. This is due to improper use of the reallocIfNeeded() method on DrillBuf. This method returns a new buffer, it does not resize the buffer within the one that is calling the method. This buffer is automatically freed by the method itself, so a reference just needs to be saved in the same variable holding the original buffer.

      Error message produced is standard memory leak error in Drill, pasted below.

      Query failed: Failure while running fragment., Attempted to close accountor with 6 buffer(s) still allocatedfor QueryId: 64a39e3c-42a9-455d-aaee-0c7374492835, MajorFragmentId: 0, MinorFragmentId: 0.

      Total 1 allocation(s) of byte size(s): 16384, at stack location:
      org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.buffer(TopLevelAllocator.java:212)
      org.apache.drill.exec.vector.UInt4Vector.allocateNewSafe(UInt4Vector.java:137)
      org.apache.drill.exec.vector.complex.RepeatedMapVector.allocateNewSafe(RepeatedMapVector.java:232)
      org.apache.drill.exec.vector.complex.impl.RepeatedMapWriter.allocate(RepeatedMapWriter.java:135)
      org.apache.drill.exec.vector.complex.impl.SingleListWriter.allocate(SingleListWriter.java:116)
      org.apache.drill.exec.vector.complex.impl.ComplexWriterImpl.allocate(ComplexWriterImpl.java:157)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doAlloc(ProjectRecordBatch.java:217)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doWork(ProjectRecordBatch.java:144)
      org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:89)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:129)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:106)
      org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:124)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:86)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:76)
      org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:52)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:129)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:106)
      org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:124)
      org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:67)
      org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:122)
      org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:57)
      org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:113)
      org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:249)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      java.lang.Thread.run(Thread.java:744)

      Total 1 allocation(s) of byte size(s): 4096, at stack location:
      org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.buffer(TopLevelAllocator.java:212)
      org.apache.drill.exec.vector.UInt1Vector.allocateNewSafe(UInt1Vector.java:137)
      org.apache.drill.exec.vector.NullableVarCharVector.allocateNewSafe(NullableVarCharVector.java:170)
      org.apache.drill.exec.vector.complex.impl.NullableVarCharWriterImpl.allocate(NullableVarCharWriterImpl.java:113)
      org.apache.drill.exec.vector.complex.impl.RepeatedMapWriter.allocate(RepeatedMapWriter.java:137)
      org.apache.drill.exec.vector.complex.impl.SingleListWriter.allocate(SingleListWriter.java:116)
      org.apache.drill.exec.vector.complex.impl.ComplexWriterImpl.allocate(ComplexWriterImpl.java:157)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doAlloc(ProjectRecordBatch.java:217)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doWork(ProjectRecordBatch.java:144)
      org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:89)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:129)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:106)
      org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:124)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:86)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:76)
      org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:52)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:129)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:106)
      org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:124)
      org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:67)
      org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:122)
      org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:57)
      org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:113)
      org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:249)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      java.lang.Thread.run(Thread.java:744)

      Total 1 allocation(s) of byte size(s): 32768, at stack location:
      org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.buffer(TopLevelAllocator.java:212)
      org.apache.drill.exec.vector.VarCharVector.allocateNewSafe(VarCharVector.java:314)
      org.apache.drill.exec.vector.NullableVarCharVector.allocateNewSafe(NullableVarCharVector.java:169)
      org.apache.drill.exec.vector.complex.impl.NullableVarCharWriterImpl.allocate(NullableVarCharWriterImpl.java:113)
      org.apache.drill.exec.vector.complex.impl.RepeatedMapWriter.allocate(RepeatedMapWriter.java:137)
      org.apache.drill.exec.vector.complex.impl.SingleListWriter.allocate(SingleListWriter.java:116)
      org.apache.drill.exec.vector.complex.impl.ComplexWriterImpl.allocate(ComplexWriterImpl.java:157)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doAlloc(ProjectRecordBatch.java:217)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doWork(ProjectRecordBatch.java:144)
      org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:89)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:129)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:106)
      org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:124)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:86)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:76)
      org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:52)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:129)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:106)
      org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:124)
      org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:67)
      org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:122)
      org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:57)
      org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:113)
      org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:249)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      java.lang.Thread.run(Thread.java:744)

      Total 1 allocation(s) of byte size(s): 16384, at stack location:
      org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.buffer(TopLevelAllocator.java:212)
      org.apache.drill.exec.vector.IntVector.allocateNewSafe(IntVector.java:137)
      org.apache.drill.exec.vector.NullableIntVector.allocateNewSafe(NullableIntVector.java:172)
      org.apache.drill.exec.vector.complex.impl.NullableIntWriterImpl.allocate(NullableIntWriterImpl.java:113)
      org.apache.drill.exec.vector.complex.impl.RepeatedMapWriter.allocate(RepeatedMapWriter.java:137)
      org.apache.drill.exec.vector.complex.impl.SingleListWriter.allocate(SingleListWriter.java:116)
      org.apache.drill.exec.vector.complex.impl.ComplexWriterImpl.allocate(ComplexWriterImpl.java:157)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doAlloc(ProjectRecordBatch.java:217)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doWork(ProjectRecordBatch.java:144)
      org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:89)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:129)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:106)
      org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:124)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:86)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:76)
      org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:52)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:129)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:106)
      org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:124)
      org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:67)
      org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:122)
      org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:57)
      org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:113)
      org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:249)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      java.lang.Thread.run(Thread.java:744)

      Total 1 allocation(s) of byte size(s): 16384, at stack location:
      org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.buffer(TopLevelAllocator.java:212)
      org.apache.drill.exec.vector.UInt4Vector.allocateNewSafe(UInt4Vector.java:137)
      org.apache.drill.exec.vector.VarCharVector.allocateNewSafe(VarCharVector.java:320)
      org.apache.drill.exec.vector.NullableVarCharVector.allocateNewSafe(NullableVarCharVector.java:169)
      org.apache.drill.exec.vector.complex.impl.NullableVarCharWriterImpl.allocate(NullableVarCharWriterImpl.java:113)
      org.apache.drill.exec.vector.complex.impl.RepeatedMapWriter.allocate(RepeatedMapWriter.java:137)
      org.apache.drill.exec.vector.complex.impl.SingleListWriter.allocate(SingleListWriter.java:116)
      org.apache.drill.exec.vector.complex.impl.ComplexWriterImpl.allocate(ComplexWriterImpl.java:157)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doAlloc(ProjectRecordBatch.java:217)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doWork(ProjectRecordBatch.java:144)
      org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:89)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:129)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:106)
      org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:124)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:86)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:76)
      org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:52)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:129)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:106)
      org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:124)
      org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:67)
      org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:122)
      org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:57)
      org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:113)
      org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:249)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      java.lang.Thread.run(Thread.java:744)

      Total 1 allocation(s) of byte size(s): 4096, at stack location:
      org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.buffer(TopLevelAllocator.java:212)
      org.apache.drill.exec.vector.UInt1Vector.allocateNewSafe(UInt1Vector.java:137)
      org.apache.drill.exec.vector.NullableIntVector.allocateNewSafe(NullableIntVector.java:173)
      org.apache.drill.exec.vector.complex.impl.NullableIntWriterImpl.allocate(NullableIntWriterImpl.java:113)
      org.apache.drill.exec.vector.complex.impl.RepeatedMapWriter.allocate(RepeatedMapWriter.java:137)
      org.apache.drill.exec.vector.complex.impl.SingleListWriter.allocate(SingleListWriter.java:116)
      org.apache.drill.exec.vector.complex.impl.ComplexWriterImpl.allocate(ComplexWriterImpl.java:157)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doAlloc(ProjectRecordBatch.java:217)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doWork(ProjectRecordBatch.java:144)
      org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:89)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:129)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:106)
      org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:124)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:86)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:76)
      org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:52)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:129)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:106)
      org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:124)
      org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:67)
      org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:122)
      org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:57)
      org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:113)
      org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:249)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      java.lang.Thread.run(Thread.java:744)
      [ 629bcce3-6492-4cfb-af75-2aaeb466e9d0 on n4a:31010 ]
      (java.lang.IllegalStateException) Attempted to close accountor with 6 buffer(s) still allocatedfor QueryId: 64a39e3c-42a9-455d-aaee-0c7374492835, MajorFragmentId: 0, MinorFragmentId: 0.

      Total 1 allocation(s) of byte size(s): 16384, at stack location:
      org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.buffer(TopLevelAllocator.java:212)
      org.apache.drill.exec.vector.UInt4Vector.allocateNewSafe(UInt4Vector.java:137)
      org.apache.drill.exec.vector.complex.RepeatedMapVector.allocateNewSafe(RepeatedMapVector.java:232)
      org.apache.drill.exec.vector.complex.impl.RepeatedMapWriter.allocate(RepeatedMapWriter.java:135)
      org.apache.drill.exec.vector.complex.impl.SingleListWriter.allocate(SingleListWriter.java:116)
      org.apache.drill.exec.vector.complex.impl.ComplexWriterImpl.allocate(ComplexWriterImpl.java:157)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doAlloc(ProjectRecordBatch.java:217)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doWork(ProjectRecordBatch.java:144)
      org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:89)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:129)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:106)
      org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:124)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:86)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:76)
      org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:52)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:129)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:106)
      org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:124)
      org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:67)
      org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:122)
      org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:57)
      org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:113)
      org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:249)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      java.lang.Thread.run(Thread.java:744)

      Total 1 allocation(s) of byte size(s): 4096, at stack location:
      org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.buffer(TopLevelAllocator.java:212)
      org.apache.drill.exec.vector.UInt1Vector.allocateNewSafe(UInt1Vector.java:137)
      org.apache.drill.exec.vector.NullableVarCharVector.allocateNewSafe(NullableVarCharVector.java:170)
      org.apache.drill.exec.vector.complex.impl.NullableVarCharWriterImpl.allocate(NullableVarCharWriterImpl.java:113)
      org.apache.drill.exec.vector.complex.impl.RepeatedMapWriter.allocate(RepeatedMapWriter.java:137)
      org.apache.drill.exec.vector.complex.impl.SingleListWriter.allocate(SingleListWriter.java:116)
      org.apache.drill.exec.vector.complex.impl.ComplexWriterImpl.allocate(ComplexWriterImpl.java:157)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doAlloc(ProjectRecordBatch.java:217)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doWork(ProjectRecordBatch.java:144)
      org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:89)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:129)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:106)
      org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:124)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:86)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:76)
      org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:52)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:129)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:106)
      org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:124)
      org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:67)
      org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:122)
      org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:57)
      org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:113)
      org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:249)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      java.lang.Thread.run(Thread.java:744)

      Total 1 allocation(s) of byte size(s): 32768, at stack location:
      org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.buffer(TopLevelAllocator.java:212)
      org.apache.drill.exec.vector.VarCharVector.allocateNewSafe(VarCharVector.java:314)
      org.apache.drill.exec.vector.NullableVarCharVector.allocateNewSafe(NullableVarCharVector.java:169)
      org.apache.drill.exec.vector.complex.impl.NullableVarCharWriterImpl.allocate(NullableVarCharWriterImpl.java:113)
      org.apache.drill.exec.vector.complex.impl.RepeatedMapWriter.allocate(RepeatedMapWriter.java:137)
      org.apache.drill.exec.vector.complex.impl.SingleListWriter.allocate(SingleListWriter.java:116)
      org.apache.drill.exec.vector.complex.impl.ComplexWriterImpl.allocate(ComplexWriterImpl.java:157)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doAlloc(ProjectRecordBatch.java:217)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doWork(ProjectRecordBatch.java:144)
      org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:89)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:129)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:106)
      org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:124)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:86)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:76)
      org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:52)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:129)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:106)
      org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:124)
      org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:67)
      org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:122)
      org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:57)
      org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:113)
      org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:249)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      java.lang.Thread.run(Thread.java:744)

      Total 1 allocation(s) of byte size(s): 16384, at stack location:
      org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.buffer(TopLevelAllocator.java:212)
      org.apache.drill.exec.vector.IntVector.allocateNewSafe(IntVector.java:137)
      org.apache.drill.exec.vector.NullableIntVector.allocateNewSafe(NullableIntVector.java:172)
      org.apache.drill.exec.vector.complex.impl.NullableIntWriterImpl.allocate(NullableIntWriterImpl.java:113)
      org.apache.drill.exec.vector.complex.impl.RepeatedMapWriter.allocate(RepeatedMapWriter.java:137)
      org.apache.drill.exec.vector.complex.impl.SingleListWriter.allocate(SingleListWriter.java:116)
      org.apache.drill.exec.vector.complex.impl.ComplexWriterImpl.allocate(ComplexWriterImpl.java:157)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doAlloc(ProjectRecordBatch.java:217)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doWork(ProjectRecordBatch.java:144)
      org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:89)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:129)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:106)
      org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:124)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:86)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:76)
      org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:52)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:129)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:106)
      org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:124)
      org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:67)
      org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:122)
      org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:57)
      org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:113)
      org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:249)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      java.lang.Thread.run(Thread.java:744)

      Total 1 allocation(s) of byte size(s): 16384, at stack location:
      org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.buffer(TopLevelAllocator.java:212)
      org.apache.drill.exec.vector.UInt4Vector.allocateNewSafe(UInt4Vector.java:137)
      org.apache.drill.exec.vector.VarCharVector.allocateNewSafe(VarCharVector.java:320)
      org.apache.drill.exec.vector.NullableVarCharVector.allocateNewSafe(NullableVarCharVector.java:169)
      org.apache.drill.exec.vector.complex.impl.NullableVarCharWriterImpl.allocate(NullableVarCharWriterImpl.java:113)
      org.apache.drill.exec.vector.complex.impl.RepeatedMapWriter.allocate(RepeatedMapWriter.java:137)
      org.apache.drill.exec.vector.complex.impl.SingleListWriter.allocate(SingleListWriter.java:116)
      org.apache.drill.exec.vector.complex.impl.ComplexWriterImpl.allocate(ComplexWriterImpl.java:157)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doAlloc(ProjectRecordBatch.java:217)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doWork(ProjectRecordBatch.java:144)
      org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:89)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:129)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:106)
      org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:124)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:86)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:76)
      org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:52)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:129)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:106)
      org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:124)
      org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:67)
      org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:122)
      org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:57)
      org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:113)
      org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:249)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      java.lang.Thread.run(Thread.java:744)

      Total 1 allocation(s) of byte size(s): 4096, at stack location:
      org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.buffer(TopLevelAllocator.java:212)
      org.apache.drill.exec.vector.UInt1Vector.allocateNewSafe(UInt1Vector.java:137)
      org.apache.drill.exec.vector.NullableIntVector.allocateNewSafe(NullableIntVector.java:173)
      org.apache.drill.exec.vector.complex.impl.NullableIntWriterImpl.allocate(NullableIntWriterImpl.java:113)
      org.apache.drill.exec.vector.complex.impl.RepeatedMapWriter.allocate(RepeatedMapWriter.java:137)
      org.apache.drill.exec.vector.complex.impl.SingleListWriter.allocate(SingleListWriter.java:116)
      org.apache.drill.exec.vector.complex.impl.ComplexWriterImpl.allocate(ComplexWriterImpl.java:157)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doAlloc(ProjectRecordBatch.java:217)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.doWork(ProjectRecordBatch.java:144)
      org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:89)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:129)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:106)
      org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:124)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:86)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:76)
      org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:52)
      org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:129)
      org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:106)
      org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:124)
      org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:67)
      org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:122)
      org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:57)
      org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:113)
      org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:249)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      java.lang.Thread.run(Thread.java:744)

      Attachments

        Activity

          People

            jaltekruse Jason Altekruse
            jaltekruse Jason Altekruse
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: