Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-793

Improving memory efficiency of Tuple implementation

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Currently, our tuple is a real pig and uses a lot of extra memory.

      There are several places where we can improve memory efficiency:

      (1) Laying out memory for the fields rather than using java objects since since each object for a numeric field takes 16 bytes
      (2) For the cases where we know the schema using Java arrays rather than ArrayList.

      There might be more.

        Attachments

          Activity

            People

            • Assignee:
              alangates Alan Gates
              Reporter:
              olgan Olga Natkovich
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: