[HIVE-5345] Operator::close() leaks Operator::out, holding reference to buffers

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.13.0
• Fix Version/s: 0.13.0
• Component/s: Query Processor
• Labels: memory-leak

Environment

Ubuntu, LXC, jdk6-x86_64

• Release Note: Prevent OutputCollector leaks from an Operator by clearing the Operator::out reference on close()
• Assignee: Gopal Vijayaraghavan
• Reporter: Gopal Vijayaraghavan
• Created: 23/Sep/13 19:10
• Updated: 25/Sep/13 18:27
• Resolved: 25/Sep/13 03:40

Description

When processing multiple splits on the same operator pipeline, the output collector in Operator has a held reference, which causes issues.

Operator::close() does not de-reference the OutputCollector object Operator::out held by the object.

This means that trying to allocate space for a new OutputCollector causes an OOM because the old one is still reachable.