Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-10

reduce encoding of intermediate results

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Invalid
    • None
    • 0.1.0
    • impl
    • None

    Description

      Currently, in intermediate results, the data is written with a marker for every column in every row. For instance if
      we are writing a row that has a schema of bag, atom, we'll write:

      BAGMARKER BAGDATA ATOMMARKER ATOMDATA

      There's no reason to write the markers for every row. Is should be sufficient to write it once at the beginning of the
      file and then remember it for subsequent rows.

      Attachments

        Activity

          People

            Unassigned Unassigned
            olgan Olga Natkovich
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: