Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3794

pig -useHCatalog fails using pig command line interface on HDInsight

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.11, 0.12.0, 0.13.0
    • Fix Version/s: 0.12.1, 0.13.0
    • Component/s: None
    • Labels:
      None
    • Environment:

      Windows Azure HDINSIGHT
      c:\apps\dist\pig-0.11.0.1.3.2.0-05

    • Hadoop Flags:
      Reviewed

      Description

      When you connect to an HDP 1.3 version HDINSIGHT cluster with remote desktop, if you try this:

      c:\apps\dist\pig-0.11.0.1.3.2.0-05>bin\pig -useHCatalog

      you get this:

      "HCAT_HOME should be defined"

      but you should not get an error.

      It appears that pig.cmd should use "HCATALOG_HOME" instead of "HCAT_HOME".

      The same problem exists on the 1.3 one-box installation for Windows. A quick look at the source code indicates it is still a problem on trunk.

      In addition, if you set hive.metastore.uris to '', this is supposed to create an embedded metastore instead of going to the metastore service. This fails on Azure HDINSIGHT and Windows because of missing datanucleus and sqljdbc4 jars.

      Finally, if you submit a pig job from WebHCat, due to argument quoting for windows, -useHCatalog comes in as "-useHCatalog" into pig.cmd. This causes -useHCatalog to never work on Windows from WebHCat.

        Attachments

        1. PIG-3794.05.patch
          2 kB
          Eric N. Hanson
        2. PIG-3794.04.patch
          2 kB
          Eric N. Hanson
        3. PIG-3794.03.patch
          2 kB
          Eric N. Hanson
        4. PIG-3794.02.patch
          2 kB
          Eric N. Hanson
        5. PIG-3794.01.patch
          0.9 kB
          Eric N. Hanson

          Activity

            People

            • Assignee:
              ehans Eric N. Hanson
              Reporter:
              ehans Eric N. Hanson
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: