Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-842

PigStorage should support multi-byte delimiters

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.3.0
    • None
    • impl
    • None

    Description

      Currently, PigStorage supports single byte delimiters. Users have requested mult-byte delimiters. There are performance implications with multi-byte delimiters. i.e., instead of looking for a single byte, PigStorage should look for a pattern ala BinStorage.

      Attachments

        1. PigMultiByteTextOutputFormat.java
          4 kB
          Jeff Markham
        2. PigMultiByteStorage.java
          18 kB
          Jeff Markham
        3. PigMultiByteJsonMetadata.java
          3 kB
          Jeff Markham

        Activity

          People

            jamarkha Jeff Markham
            sms Santhosh Muthur Srinivasan
            Votes:
            1 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated: