Uploaded image for project: 'Ambari'
  1. Ambari
  2. AMBARI-15879

HDP 2.3.2.0: Changing hive tez container size (via ambari) should change tez.runtime.io.sort.mb as well

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.4.0
    • None
    • None

    Description

      Observed this in HDP 2.3.2

      Original hive tez container size: 24576
      Original tez.runtime.io.sort.mb: 14950 or around this value

      Changed hive tez container size to 16384. But tez.runtime.io.sort.mb remained
      at 14 GB. Hive queries starts failing due to mem issue.

      Ideally, when hive tez container size is adjusted, tez.runtime.io.sort.mb
      should also be auto-adjusted in ambari (or a warning would be useful).

      Attachments

        1. AMBARI-15879.patch
          2 kB
          Andrew Onischuk

        Issue Links

          Activity

            People

              aonishuk Andrew Onischuk
              aonishuk Andrew Onischuk
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: