[DRILL-7872] Heap memory within docker container does not get recycled

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 1.18.0
• Fix Version/s: 1.19.0
• Assignee: Unassigned
• Reporter: Christian
• Created: 01/Mar/21 01:48
• Updated: 01/Jun/21 11:09
• Resolved: 01/Jun/21 11:09

Description

Hi - I'm running the official Docker container apache/drill:1.18.0. The Heap memory usage keeps increasing after each query until I get a

"{\n \"errorMessage\" : \"RESOURCE ERROR: There is not enough heap memory to run this query using the web interface. \\n
nPlease try a query with fewer columns or with a filter or limit condition to limit the data returned.
nYou can also try an ODBC/JDBC client. \\n\\n[Error Id: d5fef16a-cca7-4ee2-8316-98d510e0f41b ]\"\n}" error.

I tested it by literally sending the same query over and over and it always does the same - the first few times the queries succeed but at the same time the heap increases until the max heap size is reached and then I just get above error.

I'm querying parquet files through the REST api.

I changed the config of the drill-env.sh file but no luck with these either.

export DRILLBIT_MAX_PROC_MEM=${DRILLBIT_MAX_PROC_MEM:-"20G"}

export DRILL_HEAP=${DRILL_HEAP:-"8G"}

export DRILL_MAX_DIRECT_MEMORY=${DRILL_MAX_DIRECT_MEMORY:-"8G"}

 

export DRILLBIT_CODE_CACHE_SIZE=${DRILLBIT_CODE_CACHE_SIZE:-"2G"}

Any guidance would be appreciated.

Regards,

Christian

 

Issue Links

• is fixed by: DRILL-7733 Use streaming for REST JSON queries