Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-300

Minor Changes to SliceWrapper for Generic Hadoop InputFormat

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.2.0
    • Component/s: None
    • Labels:
      None
    • Environment:

      trunk

    • Patch Info:
      Patch Available

      Description

      I am working on a Load Function that allows to specify any Hadoop FileInputFormat or CompositeInputFormat.

      Because of the nature of PigSlice and PigSlicer such a UDF needs to use a different implementation of Slice and Slicer.

      It turns out that it would be extremely helpful if the SliceWrapper class had a couple of minor changes:

      1) an additional get method to return the 'wrapped' slice.
      2) change to getLocations method to just call the getLocations() method of the wrapped Slice, unless 'wrapped' is a PigSlice (in which case it just does what it does now).

      I will make a patch available shortly.

        Attachments

        1. PIG-300.patch
          2 kB
          Christian Kunz

          Activity

            People

            • Assignee:
              ckunz Christian Kunz
              Reporter:
              ckunz Christian Kunz
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: