Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3446 Umbrella jira for Pig on Tez
  3. PIG-3899

Fix memory leak with PigTezLogger

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: tez-branch
    • Component/s: tez
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      PigTezLogger references TezProcessorContext through TezStatusReporter. PigTezLogger is held in a static variable in DefaultAbstractBag and also can be held in static variables by user UDFs. TezProcessorContext holds references to the Input and its sort buffers causing lot of memory leak.

        Attachments

        1. PIG-3899-1.patch
          4 kB
          Rohini Palaniswamy

          Activity

            People

            • Assignee:
              rohini Rohini Palaniswamy
              Reporter:
              rohini Rohini Palaniswamy
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: