[DRILL-6076] Reduce the default memory from a total of 13GB to 5GB

• Type: Task
• Status: Closed
• Priority: Critical
• Resolution: Later
• Fix Version/s: 1.21.0
• Assignee: James Turton
• Reporter: Kunal Khatua
• Reviewer: Abhishek Girish
• Created: 08/Jan/18 23:58
• Updated: 06/Jan/22 13:03
• Resolved: 06/Jan/22 13:03

Description

Currently, the default memory requirements for Drill are about 13GB, with the following allocations:

• 4GB Heap
• 8GB Direct Memory
• 1GB CodeCache
• 512MB MaxPermSize

Also, with Drill 1.12.0, the recommendation is to move to JDK8, which makes the MaxPermSize as irrelevant.

With that, the default requirements total to 13GB, which is rather high. This is especially a problem for scenarios where people are trying out Drill and might be using this in a development environment where 13GB is too high.

When using the public test framework for Apache Drill, it was observed that the framework's functional and unit tests passed successfully with memory as little as 5GB; based on the following allocation:

• 1GB Heap
• 3GB Direct Memory
• 512MB CodeCache
• 512MB MaxPermSize

Based on this finding, the proposal is to reduce the defaults from the current settings to the values just mentioned above. The drill-env.sh file already has details in the comments, along with the recommended values that reflect the original 13GB defaults.

Issue Links

• links to: GitHub Pull Request #1086