Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-793

Improving memory efficiency of Tuple implementation

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • None
    • None

    Description

      Currently, our tuple is a real pig and uses a lot of extra memory.

      There are several places where we can improve memory efficiency:

      (1) Laying out memory for the fields rather than using java objects since since each object for a numeric field takes 16 bytes
      (2) For the cases where we know the schema using Java arrays rather than ArrayList.

      There might be more.

      Attachments

        Activity

          People

            gates Alan Gates
            olgan Olga Natkovich
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: