Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-1954

Fix memory leak in physical operator

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.10.0
    • Fix Version/s: 0.12.0, 0.11.1
    • Component/s: Physical Operator
    • Labels:
      None

      Description

      A physical operator should be closed but some operator does not call to close.

      it's garbage-collected. See http://netty.io/wiki/reference-counted-objects.html for more information.
      Recent access records: 1
      #1:
      	io.netty.buffer.AdvancedLeakAwareByteBuf.nioBuffer(AdvancedLeakAwareByteBuf.java:673)
      	org.apache.tajo.storage.RawFile$RawFileScanner.init(RawFile.java:103)
      	org.apache.tajo.engine.planner.physical.SeqScanExec.initScanner(SeqScanExec.java:286)
      	org.apache.tajo.engine.planner.physical.SeqScanExec.init(SeqScanExec.java:191)
      	org.apache.tajo.engine.planner.physical.UnaryPhysicalExec.init(UnaryPhysicalExec.java:53)
      	org.apache.tajo.engine.planner.physical.ExternalSortExec.init(ExternalSortExec.java:147)
      	org.apache.tajo.engine.planner.physical.UnaryPhysicalExec.init(UnaryPhysicalExec.java:53)
      	org.apache.tajo.engine.planner.physical.ColPartitionStoreExec.init(ColPartitionStoreExec.java:117)
      	org.apache.tajo.worker.TaskImpl.run(TaskImpl.java:403)
      	org.apache.tajo.worker.TaskContainer.run(TaskContainer.java:65)
      	java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
      	java.util.concurrent.FutureTask.run(FutureTask.java:266)
      	java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      	java.lang.Thread.run(Thread.java:745)
      
      2015-10-27 14:10:05,557 ERROR: io.netty.util.ResourceLeakDetector (error(527)) - LEAK: ByteBuf.release() was not called before it's garbage-collected. See http://netty.io/wiki/reference-counted-objects.html for more information.
      Recent access records: 1
      #1:
      	io.netty.buffer.AdvancedLeakAwareByteBuf.nioBuffer(AdvancedLeakAwareByteBuf.java:673)
      	org.apache.tajo.storage.RawFile$RawFileScanner.init(RawFile.java:103)
      	org.apache.tajo.engine.planner.physical.SeqScanExec.initScanner(SeqScanExec.java:286)
      	org.apache.tajo.engine.planner.physical.SeqScanExec.init(SeqScanExec.java:191)
      	org.apache.tajo.engine.planner.physical.UnaryPhysicalExec.init(UnaryPhysicalExec.java:53)
      	org.apache.tajo.engine.planner.physical.ExternalSortExec.init(ExternalSortExec.java:147)
      	org.apache.tajo.engine.planner.physical.UnaryPhysicalExec.init(UnaryPhysicalExec.java:53)
      	org.apache.tajo.engine.planner.physical.AggregationExec.init(AggregationExec.java:53)
      	org.apache.tajo.engine.planner.physical.DistinctGroupbySortAggregationExec.<init>(DistinctGroupbySortAggregationExec.java:73)
      

        Attachments

          Activity

            People

            • Assignee:
              jhkim Jinho Kim
              Reporter:
              jhkim Jinho Kim
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: