Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-7872

Heap memory within docker container does not get recycled

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Not A Problem
    • Affects Version/s: 1.18.0
    • Fix Version/s: 1.19.0
    • Component/s: None
    • Labels:
      None

      Description

      Hi - I'm running the official Docker container apache/drill:1.18.0. The Heap memory usage keeps increasing after each query until I get a

      "{\n \"errorMessage\" : \"RESOURCE ERROR: There is not enough heap memory to run this query using the web interface. \\n
      nPlease try a query with fewer columns or with a filter or limit condition to limit the data returned.
      nYou can also try an ODBC/JDBC client. \\n\\n[Error Id: d5fef16a-cca7-4ee2-8316-98d510e0f41b ]\"\n}" error.

      I tested it by literally sending the same query over and over and it always does the same - the first few times the queries succeed but at the same time the heap increases until the max heap size is reached and then I just get above error.

      I'm querying parquet files through the REST api.

      I changed the config of the drill-env.sh file but no luck with these either.

      export DRILLBIT_MAX_PROC_MEM=${DRILLBIT_MAX_PROC_MEM:-"20G"}

      export DRILL_HEAP=${DRILL_HEAP:-"8G"}

      export DRILL_MAX_DIRECT_MEMORY=${DRILL_MAX_DIRECT_MEMORY:-"8G"}

       

      export DRILLBIT_CODE_CACHE_SIZE=${DRILLBIT_CODE_CACHE_SIZE:-"2G"}

      Any guidance would be appreciated.

      Regards,

      Christian

       

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                Klar Christian
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: