Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3071

update hcatalog jar and path to hbase storage handler jar in pig script

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.12.0
    • None

    Description

      Due to changes in hcatalog 0.5 packaging we need to update the hcatalog jar name and the path to the hbase storage handler jar. We also need to add the pig storage adapter to the class path

      pig script should be updated to work with either version.

      Attachments

        1. PIG-3071.patch
          2 kB
          Arpit Gupta
        2. PIG-3071.patch
          2 kB
          Arpit Gupta
        3. PIG-3071.patch
          1 kB
          Arpit Gupta

        Activity

          arpitgupta Arpit Gupta added a comment -

          attached is patch that takes a stab at fixing this

          arpitgupta Arpit Gupta added a comment - attached is patch that takes a stab at fixing this
          arpitgupta Arpit Gupta added a comment -

          Updated patch to the jars being added for hbase storage handler, we now need to add all jars in the folder rather than just the hbase storage handler jar.

          arpitgupta Arpit Gupta added a comment - Updated patch to the jars being added for hbase storage handler, we now need to add all jars in the folder rather than just the hbase storage handler jar.
          arpitgupta Arpit Gupta added a comment -

          updated patch just changed var names from hcatVersion to hcatJarPath to reflect what the var is actually used for.

          Similar changes made for pig and hbase jar paths.

          arpitgupta Arpit Gupta added a comment - updated patch just changed var names from hcatVersion to hcatJarPath to reflect what the var is actually used for. Similar changes made for pig and hbase jar paths.
          cheolsoo Cheolsoo Park added a comment -

          +1.

          Tested with HCat 0.5 branch. I will commit it unless anyone has an objection.

          cheolsoo Cheolsoo Park added a comment - +1. Tested with HCat 0.5 branch. I will commit it unless anyone has an objection.
          cheolsoo Cheolsoo Park added a comment -

          Committed to trunk. Thanks Arpit!

          cheolsoo Cheolsoo Park added a comment - Committed to trunk. Thanks Arpit!

          Guys, this is extremely useful! Question though: what's the recommended way of dealing with hive.metastore.uris for a permanent deployment? I am looking at the docs and it feels like that property should just be picked up from Hive configuration. Am I missing anything?

          rvs Roman Shaposhnik added a comment - Guys, this is extremely useful! Question though: what's the recommended way of dealing with hive.metastore.uris for a permanent deployment? I am looking at the docs and it feels like that property should just be picked up from Hive configuration. Am I missing anything?

          Yes it should be picked from hive-site.xml.

          rohini Rohini Palaniswamy added a comment - Yes it should be picked from hive-site.xml.

          People

            arpitgupta Arpit Gupta
            arpitgupta Arpit Gupta
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: