Pig
  1. Pig
  2. PIG-300

Minor Changes to SliceWrapper for Generic Hadoop InputFormat

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.2.0
    • Component/s: None
    • Labels:
      None
    • Environment:

      trunk

    • Patch Info:
      Patch Available

      Description

      I am working on a Load Function that allows to specify any Hadoop FileInputFormat or CompositeInputFormat.

      Because of the nature of PigSlice and PigSlicer such a UDF needs to use a different implementation of Slice and Slicer.

      It turns out that it would be extremely helpful if the SliceWrapper class had a couple of minor changes:

      1) an additional get method to return the 'wrapped' slice.
      2) change to getLocations method to just call the getLocations() method of the wrapped Slice, unless 'wrapped' is a PigSlice (in which case it just does what it does now).

      I will make a patch available shortly.

      1. PIG-300.patch
        2 kB
        Christian Kunz

        Activity

        Christian Kunz created issue -
        Christian Kunz made changes -
        Field Original Value New Value
        Status Open [ 1 ] Patch Available [ 10002 ]
        Christian Kunz made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Christian Kunz made changes -
        Attachment PIG-300.patch [ 12385695 ]
        Christian Kunz made changes -
        Patch Info [Patch Available]
        Hide
        Yiping Han added a comment -

        Is there a plan to commit this patch and port to types branch?

        Show
        Yiping Han added a comment - Is there a plan to commit this patch and port to types branch?
        Hide
        Christian Kunz added a comment -

        This patch has been ported to the 'types' branch and is part of PIG 2.

        Show
        Christian Kunz added a comment - This patch has been ported to the 'types' branch and is part of PIG 2.
        Christian Kunz made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Fix Version/s types_branch [ 12313288 ]
        Nigel Daley made changes -
        Fix Version/s 0.2.0 [ 12313783 ]
        Fix Version/s 1.0.0 [ 12313288 ]
        Alan Gates made changes -
        Assignee Christian Kunz [ ckunz ]
        Alan Gates made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Patch Available Patch Available
        5m 16s 1 Christian Kunz 10/Jul/08 02:54
        Patch Available Patch Available Open Open
        29s 1 Christian Kunz 10/Jul/08 02:54
        Open Open Resolved Resolved
        118d 18h 49m 1 Christian Kunz 05/Nov/08 20:44
        Resolved Resolved Closed Closed
        504d 1h 19m 1 Alan Gates 24/Mar/10 22:04

          People

          • Assignee:
            Christian Kunz
            Reporter:
            Christian Kunz
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development