Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-5003

Localize hive exec jar for tez

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • tez-branch
    • None
    • None

    Description

      Tez doesn't expose a distributed cache. JARs are localized via yarn APIs and added to vertices and the dag itself as needed. For hive we need to localize the hive-exec.jar.

      NO PRECOMMIT TESTS (this is wip for the tez branch)

      Attachments

        1. HiveLocalizationDesign.txt
          1 kB
          Vikram Dixit K
        2. HIVE-5003.5.patch.txt
          13 kB
          Vikram Dixit K
        3. HIVE-5003.4.patch.txt
          14 kB
          Vikram Dixit K
        4. HIVE-5003.3.patch.txt
          11 kB
          Vikram Dixit K
        5. HIVE-5003.2.patch.txt
          5 kB
          Vikram Dixit K
        6. HIVE-5003.1.patch.txt
          5 kB
          Vikram Dixit K

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. HIVE-5040 Yarn resource names cannot contain slashes

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HIVE-4660 Let there be Tez

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-6636 /user/hive is a bad default for HDFS jars path for Tez

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              vikram.dixit Vikram Dixit K
              hagleitn Gunther Hagleitner
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: