[IMPALA-2858] Verify that exec nodes delete blocks

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 2.5.0
• Fix Version/s: Impala 2.5.0
• Component/s: Backend
• Labels: query-lifecycle resource-management
• Target Version: Product Backlog
• Assignee: Tim Armstrong
• Reporter: Tim Armstrong
• Created: 15/Jan/16 22:15
• Updated: 28/Jan/16 21:35
• Resolved: 28/Jan/16 21:35

Description

Currently BufferedBlockMgr is a per-query object that automatically cleans up any blocks at the end of the query. Most exec nodes will call Block::Delete() to let BufferedBlockMgr know that the block is finished. However, it's not clear if this is always done because blocks are automatically cleaned up at the end of the query regardless of their state.

This task is to add validation to check whether this invariant is true, and if not, make the appropriate changes so that Block::Delete() is consistently called.

Issue Links

• is a child of: IMPALA-2755 Clean up memory management in backend