Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-5003

Localize hive exec jar for tez

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: tez-branch
    • Component/s: None
    • Labels:
      None

      Description

      Tez doesn't expose a distributed cache. JARs are localized via yarn APIs and added to vertices and the dag itself as needed. For hive we need to localize the hive-exec.jar.

      NO PRECOMMIT TESTS (this is wip for the tez branch)

        Attachments

        1. HiveLocalizationDesign.txt
          1 kB
          Vikram Dixit K
        2. HIVE-5003.5.patch.txt
          13 kB
          Vikram Dixit K
        3. HIVE-5003.4.patch.txt
          14 kB
          Vikram Dixit K
        4. HIVE-5003.3.patch.txt
          11 kB
          Vikram Dixit K
        5. HIVE-5003.2.patch.txt
          5 kB
          Vikram Dixit K
        6. HIVE-5003.1.patch.txt
          5 kB
          Vikram Dixit K

          Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. HIVE-5040 Yarn resource names cannot contain slashes

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HIVE-4660 Let there be Tez

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-6636 /user/hive is a bad default for HDFS jars path for Tez

          • Major - Major loss of function.
          • Resolved

            Activity

              People

              • Assignee:
                vikram.dixit Vikram Dixit K
                Reporter:
                hagleitn Gunther Hagleitner
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: