Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-1582

Occasional resource leak in RawFile during test

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Not A Problem
    • Affects Version/s: None
    • Fix Version/s: 0.11.0
    • Component/s: Storage
    • Labels:
      None

      Description

      It looks that ByteBuf is not released properly.
      Here is the log.

      Run: testDistinctAggregationCasebyCase11[1] Used memory: 442MBytes
      2015-04-27 03:54:09,980 ERROR: io.netty.util.ResourceLeakDetector (error(527)) - LEAK: ByteBuf.release() was not called before it's garbage-collected.
      Recent access records: 1
      #1:
      	io.netty.buffer.AdvancedLeakAwareByteBuf.nioBuffer(AdvancedLeakAwareByteBuf.java:673)
      	org.apache.tajo.storage.RawFile$RawFileScanner.init(RawFile.java:99)
      	org.apache.tajo.engine.planner.physical.SeqScanExec.initScanner(SeqScanExec.java:200)
      	org.apache.tajo.engine.planner.physical.SeqScanExec.init(SeqScanExec.java:162)
      	org.apache.tajo.engine.planner.physical.UnaryPhysicalExec.init(UnaryPhysicalExec.java:53)
      	org.apache.tajo.engine.planner.physical.ExternalSortExec.init(ExternalSortExec.java:154)
      	org.apache.tajo.engine.planner.physical.UnaryPhysicalExec.init(UnaryPhysicalExec.java:53)
      	org.apache.tajo.engine.planner.physical.AggregationExec.init(AggregationExec.java:64)
      	org.apache.tajo.engine.planner.physical.DistinctGroupbySortAggregationExec.<init>(DistinctGroupbySortAggregationExec.java:71)
      	org.apache.tajo.engine.planner.PhysicalPlannerImpl.createSortAggregationDistinctGroupbyExec(PhysicalPlannerImpl.java:1135)
      	org.apache.tajo.engine.planner.PhysicalPlannerImpl.createDistinctGroupByPlan(PhysicalPlannerImpl.java:1066)
      	org.apache.tajo.engine.planner.PhysicalPlannerImpl.createPlanRecursive(PhysicalPlannerImpl.java:195)
      	org.apache.tajo.engine.planner.PhysicalPlannerImpl.createPlanRecursive(PhysicalPlannerImpl.java:158)
      	org.apache.tajo.engine.planner.PhysicalPlannerImpl.createPlan(PhysicalPlannerImpl.java:90)
      	org.apache.tajo.worker.TajoQueryEngine.createPlan(TajoQueryEngine.java:41)
      	org.apache.tajo.worker.Task.run(Task.java:417)
      	org.apache.tajo.worker.TaskRunner$1.run(TaskRunner.java:286)
      	java.lang.Thread.run(Thread.java:745)
      Created at:
      	io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:55)
      	io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:155)
      	io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:146)
      	org.apache.tajo.storage.BufferPool.directBuffer(BufferPool.java:99)
      	org.apache.tajo.storage.RawFile$RawFileScanner.init(RawFile.java:98)
      	org.apache.tajo.engine.planner.physical.SeqScanExec.initScanner(SeqScanExec.java:200)
      	org.apache.tajo.engine.planner.physical.SeqScanExec.init(SeqScanExec.java:162)
      	org.apache.tajo.engine.planner.physical.UnaryPhysicalExec.init(UnaryPhysicalExec.java:53)
      	org.apache.tajo.engine.planner.physical.ExternalSortExec.init(ExternalSortExec.java:154)
      	org.apache.tajo.engine.planner.physical.UnaryPhysicalExec.init(UnaryPhysicalExec.java:53)
      	org.apache.tajo.engine.planner.physical.AggregationExec.init(AggregationExec.java:64)
      	org.apache.tajo.engine.planner.physical.DistinctGroupbySortAggregationExec.<init>(DistinctGroupbySortAggregationExec.java:71)
      	org.apache.tajo.engine.planner.PhysicalPlannerImpl.createSortAggregationDistinctGroupbyExec(PhysicalPlannerImpl.java:1135)
      	org.apache.tajo.engine.planner.PhysicalPlannerImpl.createDistinctGroupByPlan(PhysicalPlannerImpl.java:1066)
      	org.apache.tajo.engine.planner.PhysicalPlannerImpl.createPlanRecursive(PhysicalPlannerImpl.java:195)
      	org.apache.tajo.engine.planner.PhysicalPlannerImpl.createPlanRecursive(PhysicalPlannerImpl.java:158)
      	org.apache.tajo.engine.planner.PhysicalPlannerImpl.createPlan(PhysicalPlannerImpl.java:90)
      	org.apache.tajo.worker.TajoQueryEngine.createPlan(TajoQueryEngine.java:41)
      	org.apache.tajo.worker.Task.run(Task.java:417)
      	org.apache.tajo.worker.TaskRunner$1.run(TaskRunner.java:286)
      	java.lang.Thread.run(Thread.java:745)
      

        Activity

        There are no comments yet on this issue.

          People

          • Assignee:
            Unassigned
            Reporter:
            jihoonson Jihoon Son
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development