Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-2494

Improvement to SequenceFileLoader (NullWritable and Delimiter)

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 0.9.1
    • Fix Version/s: None
    • Component/s: piggybank
    • Labels:
    • Environment:

      All

    • Release Note:
      Should have no compatible issues
    • Tags:
      SequenceFileLoader NullWritable Delimiter

      Description

      I wanted to add two features to SequenceFileLoader.
      1. I added a delimiter so it will act more like PigStorage, in that it will Split the value if it is a type Text (chararray).
      2. I added the option of the key being a NullWritable. I wanted to be able to process my Hive files in both Hive and Pig, but because my Hive sequence files have a NullWritable key I could not make this work with the current implementation of SequenceFileLoader.

      My change is attached to this Issue.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              malaskat Ted Malaska
            • Votes:
              1 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: