Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-6076

Reduce the default memory from a total of 13GB to 5GB

    Details

    • Type: Task
    • Status: Open
    • Priority: Critical
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: 1.14.0
    • Component/s: None
    • Labels:
      None

      Description

      Currently, the default memory requirements for Drill are about 13GB, with the following allocations:

      • 4GB Heap
      • 8GB Direct Memory
      • 1GB CodeCache
      • 512MB MaxPermSize

      Also, with Drill 1.12.0, the recommendation is to move to JDK8, which makes the MaxPermSize as irrelevant.

      With that, the default requirements total to 13GB, which is rather high. This is especially a problem for scenarios where people are trying out Drill and might be using this in a development environment where 13GB is too high.

      When using the public test framework for Apache Drill, it was observed that the framework's functional and unit tests passed successfully with memory as little as 5GB; based on the following allocation:

      • 1GB Heap
      • 3GB Direct Memory
      • 512MB CodeCache
      • 512MB MaxPermSize

      Based on this finding, the proposal is to reduce the defaults from the current settings to the values just mentioned above. The drill-env.sh file already has details in the comments, along with the recommended values that reflect the original 13GB defaults.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                kkhatua Kunal Khatua
                Reporter:
                kkhatua Kunal Khatua
                Reviewer:
                Abhishek Girish
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Time Tracking

                  Estimated:
                  Original Estimate - 24h
                  24h
                  Remaining:
                  Remaining Estimate - 24h
                  24h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified