[PIG-3797] Fix some memory leaks affecting container reuse

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: tez-branch
• Component/s: tez
• Hadoop Flags: Reviewed
• Assignee: Rohini Palaniswamy
• Reporter: Rohini Palaniswamy
• Created: 06/Mar/14 05:43
• Updated: 21/Nov/14 05:59
• Resolved: 08/Mar/14 08:41

Description

PigCombiner.sJobContext and PhysicalOperator.reporter hold references to the WrappedReducer$Context which in turn holds TezOutputContextImpl which holds references to the buffers in DefaultSorter. This was causing OOM after the container was reused 2 or 3 times. Debugged this with L17.pig in pigmix.