Pig
  1. Pig
  2. PIG-300

Minor Changes to SliceWrapper for Generic Hadoop InputFormat

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.2.0
    • Component/s: None
    • Labels:
      None
    • Environment:

      trunk

    • Patch Info:
      Patch Available

      Description

      I am working on a Load Function that allows to specify any Hadoop FileInputFormat or CompositeInputFormat.

      Because of the nature of PigSlice and PigSlicer such a UDF needs to use a different implementation of Slice and Slicer.

      It turns out that it would be extremely helpful if the SliceWrapper class had a couple of minor changes:

      1) an additional get method to return the 'wrapped' slice.
      2) change to getLocations method to just call the getLocations() method of the wrapped Slice, unless 'wrapped' is a PigSlice (in which case it just does what it does now).

      I will make a patch available shortly.

      1. PIG-300.patch
        2 kB
        Christian Kunz

        Activity

        Hide
        Yiping Han added a comment -

        Is there a plan to commit this patch and port to types branch?

        Show
        Yiping Han added a comment - Is there a plan to commit this patch and port to types branch?
        Hide
        Christian Kunz added a comment -

        This patch has been ported to the 'types' branch and is part of PIG 2.

        Show
        Christian Kunz added a comment - This patch has been ported to the 'types' branch and is part of PIG 2.

          People

          • Assignee:
            Christian Kunz
            Reporter:
            Christian Kunz
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development