Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-5188

MR job launched through WebHCat fails to find additional jars in classpath

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.12.0
    • None
    • WebHCat
    • None

    Description

      When running MR job using jar (compiled with external dependencies eg. HCatInputFormat, HCatOutputFormat) through WebHCat the job fails complaining about missing HCat classes. I did pass those through the libjars argument but it seems that we run the hadoop jar locally on the tasktracker node and so it doesn't have the additional classes in the HADOOP_CLASSPATH. To get around the problem I had to explicitly add the additional jar dependencies in the hadoop-env.sh.

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-5133 webhcat jobs that need to access metastore fails in secure mode

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-5547 webhcat pig job submission should ship hive tar if -usehcatalog is specified

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              deepesh Deepesh Khandelwal
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: