[DRILL-6947] RuntimeFilter memory leak due to BF ByteBuf ownership transferring

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.16.0
• Fix Version/s: 1.16.0
• Component/s: Execution - Flow
• Labels: ready-to-commit
• Assignee: Weijie Tong
• Reporter: Weijie Tong
• Reviewer: Sorabh Hamirwasia
• Created: 06/Jan/19 06:40
• Updated: 25/Jan/19 16:53
• Resolved: 25/Jan/19 16:53

Description

RuntimeFilter's BF ByteBuf ownership should be transferred right at broadcast and random hash cases. Currently due to we not treat this transferring reasonable, it caused the memory leak.

To broadcast case,the HashJoin operator's allocator allocated the BF, the allocated BF's ownership should be transferred to its receiver : the FragmentContextImpl or the final RuntimeFilter operator. Otherwise, the OperatorContextImpl's close method will complain about the memory leak when closing the corresponding allocator.

Issue Links

• Blocked: DRILL-6914 Query with RuntimeFilter and SemiJoin fails with IllegalStateException: Memory was leaked by query
• links to: GitHub Pull Request #1600