Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-4616

Running out of /tmp results in "Memory was leaked by query"

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Duplicate
    • 1.6.0
    • None
    • Server
    • None
    • MapR community cluster v. 5.1.0.37549.GA, 4 nodes Ubuntu 14.04, MapR-FS

      Also Vanilla Hadoop 2.7.0 HDFS

      Each node has Maximum Direct Memory of 25,769,803,776

    Description

      Attempting to convert csv file data to partitioned Parquet files via sqlline with as

      CREATE TABLE () PARTITION BY (date_tm) AS SELECT ...
      
      Error: SYSTEM ERROR: IllegalStateException: Memory was leaked by query. Memory leaked: (523264)
      Allocator(op:1:16:5:ExternalSort) 20000000/523264/1361178240/1431655765 (res/actual/peak/limit)
      
      
      Fragment 1:16
      
      [Error Id: cea4a79d-3e85-4e51-b6c2-1539f40dee10 on es05:31010]
      
        (java.lang.IllegalStateException) Memory was leaked by query. Memory leaked: (523264)
      Allocator(op:1:16:5:ExternalSort) 20000000/523264/1361178240/1431655765 (res/actual/peak/limit)
      
          org.apache.drill.exec.memory.BaseAllocator.close():492
          org.apache.drill.exec.ops.OperatorContextImpl.close():124
          org.apache.drill.exec.ops.FragmentContext.suppressingClose():416
          org.apache.drill.exec.ops.FragmentContext.close():405
          org.apache.drill.exec.work.fragment.FragmentExecutor.closeOutResources():343
          org.apache.drill.exec.work.fragment.FragmentExecutor.cleanup():180
          org.apache.drill.exec.work.fragment.FragmentExecutor.run():287
          org.apache.drill.common.SelfCleaningRunnable.run():38
          java.util.concurrent.ThreadPoolExecutor.runWorker():1145
          java.util.concurrent.ThreadPoolExecutor$Worker.run():615
          java.lang.Thread.run():745 (state=,code=0)
      

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              mattk Matt Keranen
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: