Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-2187

PigStorage should handle converting Tuple to text

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • None
    • None

    Description

      Currently it is simple for users to use a different TextInputFormat with PigStorage since PigStorage loader just expects one line at a time, takes care of parsing the text into a tuple.

      This is not the case with storage side. PigTextOutputFormat handles the conversion to Text (it actually write UTF8 of each field from tuple directly to output). This implies a different TextOutputFormat can not be used with PigStorage.

      Attachments

        1. PIG-2187.patch
          5 kB
          Raghu Angadi
        2. PIG-2187.patch
          6 kB
          Raghu Angadi

        Activity

          People

            rangadi Raghu Angadi
            rangadi Raghu Angadi
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: