[AMBARI-19116] Hive2/HiveServer2 (HSI) heap size calculation to be based on LLAP concurrency.

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 2.4.1
• Fix Version/s: 2.5.0
• Component/s: ambari-server
• Assignee: Swapan Shridhar
• Reporter: Swapan Shridhar
• Due: 07/Dec/16
• Created: 07/Dec/16 00:55
• Updated: 27/Jan/17 20:14
• Resolved: 27/Jan/17 20:14

Description

• Currently, hive2/HiveServer2 (HSI) heap size is ket same as that of hive/HiveServer2.

Required:

• Hive2/HiveServer2 (HSI) heap size calculations to be based on LLAP concurrency.

 = min(max(2GB, 400*LLAP concurrency (Tez sessions)), 3/8 * <HS2 host total RAM>)

Side fix: Also, updated "hive.llap.daemon.queue.name" and "hive.server2.tez.default.queues" config values to one of the existing leaf queues, in case of HSI being turned on and config values have queue names which no more exist. The scenario can happen when, say :

• HSI was ON and the above 2 configs has queue name 'XYZ'.
• HSI was then turned off.
• Capacity Scheduler queues were changed and 'XYZ' queue was deleted.
• The above configs without this fix will otherwise show stale/non-existing queue name.

Issue Links

• is related to: AMBARI-18901 LLAP integration enhancements
• links to: Reviewboard Link