Uploaded image for project: 'Ambari (Retired)'
  1. Ambari (Retired)
  2. AMBARI-19116

Hive2/HiveServer2 (HSI) heap size calculation to be based on LLAP concurrency.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 2.4.1
    • 2.5.0
    • ambari-server
    • None

    Description

      • Currently, hive2/HiveServer2 (HSI) heap size is ket same as that of hive/HiveServer2.

      Required:

      • Hive2/HiveServer2 (HSI) heap size calculations to be based on LLAP concurrency.
       = min(max(2GB, 400*LLAP concurrency (Tez sessions)), 3/8 * <HS2 host total RAM>)
      

      Side fix: Also, updated "hive.llap.daemon.queue.name" and "hive.server2.tez.default.queues" config values to one of the existing leaf queues, in case of HSI being turned on and config values have queue names which no more exist. The scenario can happen when, say :

      • HSI was ON and the above 2 configs has queue name 'XYZ'.
      • HSI was then turned off.
      • Capacity Scheduler queues were changed and 'XYZ' queue was deleted.
      • The above configs without this fix will otherwise show stale/non-existing queue name.

      Attachments

        1. AMBARI-19116.patch
          10 kB
          Swapan Shridhar

        Issue Links

          Activity

            People

              swapanshridhar Swapan Shridhar
              swapanshridhar Swapan Shridhar
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: