Uploaded image for project: 'Ambari'
  1. Ambari
  2. AMBARI-17331

Determine Tez for Hive2 config 'tez.am.resource.memory.mb' based on cluster capacity.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • None
    • None

    Description

      The current computations done for tez ends up with a large AM size.
      For LLAP, we'd like stack-advisor to change these computations.

      • Total Cluster Memory <=4GB - Tez AM size = 256MB and then normalized based on YARN minimum container size.
      • Total Cluster Memory >4GB && <= 72GB - Tez AM size = 512MB and then normalized based on YARN minimum container size.
      • Total Cluster Memory >72GB - Tez AM size = 1536MB and then normalized based on YARN minimum container size.

      Attachments

        1. AMBARI-17331.patch
          22 kB
          Swapan Shridhar

        Issue Links

          Activity

            People

              swapanshridhar Swapan Shridhar
              swapanshridhar Swapan Shridhar
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: