[IMPALA-2381] Row batches should count their tuple pointers towards memory limit

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: Impala 2.3.0
• Fix Version/s: Impala 2.3.0
• Target Version: Impala 2.3.0
• Assignee: Tim Armstrong
• Reporter: Tim Armstrong
• Created: 22/Sep/15 00:43
• Updated: 23/Sep/15 20:11
• Resolved: 23/Sep/15 20:11

Description

A recent change to tuple pointer allocation in rowbatch means that the pointers are no longer counted towards the query or impalad memory limit. If there are many row batches in flight in a given query (many nodes, high concurrency, etc), then this may make it possible to overrun the specified memory limit. We should track these allocations with the row batch's memory tracker.

Issue Links

• blocks: IMPALA-2378 Impalad exceeded its mem limit