Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-691 Process mem limit should account for the JVM's memory usage
  3. IMPALA-7820

Limit JVM heap size in minicluster

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • Impala 3.0, Impala 2.12.0, Impala 3.1.0
    • None
    • Infrastructure

    Description

      The embedded JVM by default uses 1/4 of system memory, which means potentially up to 3/4 of system memory on a 3 node minicluster. IMPALA-6070 addresses this for the docker case, but in general it would be good to solve this for all miniclusters and ensure that all tests work with a smaller heap size so that memory is not overcommitted in our test environments.

      I tried running end-to-end tests with a 1Gb heap and ran into out-of-memory for test_insert_large_string.

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-4865 Limit size of literal values from constant folding

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              tarmstrong Tim Armstrong
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: