Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3794

pig -useHCatalog fails using pig command line interface on HDInsight

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.11, 0.12.0, 0.13.0
    • 0.12.1, 0.13.0
    • None
    • None
    • Windows Azure HDINSIGHT
      c:\apps\dist\pig-0.11.0.1.3.2.0-05

    • Reviewed

    Description

      When you connect to an HDP 1.3 version HDINSIGHT cluster with remote desktop, if you try this:

      c:\apps\dist\pig-0.11.0.1.3.2.0-05>bin\pig -useHCatalog

      you get this:

      "HCAT_HOME should be defined"

      but you should not get an error.

      It appears that pig.cmd should use "HCATALOG_HOME" instead of "HCAT_HOME".

      The same problem exists on the 1.3 one-box installation for Windows. A quick look at the source code indicates it is still a problem on trunk.

      In addition, if you set hive.metastore.uris to '', this is supposed to create an embedded metastore instead of going to the metastore service. This fails on Azure HDINSIGHT and Windows because of missing datanucleus and sqljdbc4 jars.

      Finally, if you submit a pig job from WebHCat, due to argument quoting for windows, -useHCatalog comes in as "-useHCatalog" into pig.cmd. This causes -useHCatalog to never work on Windows from WebHCat.

      Attachments

        1. PIG-3794.01.patch
          0.9 kB
          Eric N. Hanson
        2. PIG-3794.02.patch
          2 kB
          Eric N. Hanson
        3. PIG-3794.03.patch
          2 kB
          Eric N. Hanson
        4. PIG-3794.04.patch
          2 kB
          Eric N. Hanson
        5. PIG-3794.05.patch
          2 kB
          Eric N. Hanson

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            ehans Eric N. Hanson
            ehans Eric N. Hanson
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment