Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-8452

Cleanup handling of resource configuration for tez

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.14.0
    • None
    • None

    Description

      Currently there's a way to configure container size for tez as well as java opts to start containers.

      However, if you only set container size and not java opts, we fall back to MR settings for java opts which will likely fail (killed by yarn).

      vcores is always taken from the MR settings. Need to have a way to overwrite that too.

      Tez 0.5 and onwards will automatically generate the right java opts string when the container/cpus are specified. This is preferable to falling back to MR.

      Attachments

        1. HIVE-8452.1.patch
          3 kB
          Gunther Hagleitner

        Activity

          People

            hagleitn Gunther Hagleitner
            hagleitn Gunther Hagleitner
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: