[IMPALA-657] Join node consumes memory way beyond mem-limit

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: Impala 1.1.1
• Fix Version/s: Impala 1.2.1
• Assignee: Skye Wanderman-Milne
• Reporter: Alan Choi
• Created: 07/Nov/13 00:26
• Updated: 20/Dec/15 00:05
• Resolved: 19/Nov/13 01:41

Description

Mem-limit is set to 2GB. When running this query, Impalad's mem consumption reached 3.7GB.

Query:
select * from just_ids a join just_ids b on a.id=b.id;

Table just_ids is 2.8GB. Text file. Single column bigint.

After sometime, the query is aborted, but top shows that the mem usage is 3.7GB.