Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-901

InputSplit (SliceWrapper) created by Pig is big in size due to serialized PigContext

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.4.0
    • 0.4.0
    • None
    • None
    • Reviewed

    Description

      InputSplit (SliceWrapper) created by Pig is big in size due to serialized PigContext. SliceWrapper only needs ExecType - so the entire PigContext should not be serialized and only the ExecType should be serialized.

      Attachments

        1. PIG-901-trunk.patch
          8 kB
          Pradeep Kamath
        2. PIG-901-branch-0.3.patch
          3 kB
          Pradeep Kamath
        3. PIG-901-1.patch
          5 kB
          Daniel Dai

        Activity

          People

            pkamath Pradeep Kamath
            pkamath Pradeep Kamath
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: