Pig
  1. Pig
  2. PIG-2494

Improvement to SequenceFileLoader (NullWritable and Delimiter)

    Details

    • Type: Improvement Improvement
    • Status: Open
    • Priority: Minor Minor
    • Resolution: Unresolved
    • Affects Version/s: 0.9.1
    • Fix Version/s: None
    • Component/s: piggybank
    • Labels:
    • Environment:

      All

    • Release Note:
      Should have no compatible issues
    • Tags:
      SequenceFileLoader NullWritable Delimiter

      Description

      I wanted to add two features to SequenceFileLoader.
      1. I added a delimiter so it will act more like PigStorage, in that it will Split the value if it is a type Text (chararray).
      2. I added the option of the key being a NullWritable. I wanted to be able to process my Hive files in both Hive and Pig, but because my Hive sequence files have a NullWritable key I could not make this work with the current implementation of SequenceFileLoader.

      My change is attached to this Issue.

        Activity

          People

          • Assignee:
            Unassigned
            Reporter:
            Ted Malaska
          • Votes:
            1 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:

              Development