[IMPALA-520] Impala continues to allocate more memory even though it has exceed its mem-limit

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 1.0
• Fix Version/s: Impala 1.1.1
• Assignee: Skye Wanderman-Milne
• Reporter: Alan Choi
• Created: 07/Aug/13 20:22
• Updated: 11/Nov/13 21:39
• Resolved: 11/Nov/13 21:39

Description

Here's the log:

impalad.INFO:I0807 15:39:52.391039 12042 mem-limit.h:58] exceeded limit: limit=6291456000 consumption=6291761928
impalad.INFO:I0807 15:39:52.400673 14570 mem-limit.h:58] exceeded limit: limit=6291456000 consumption=6293990808
...
...
impalad.INFO:I0807 15:39:52.402776 14561 mem-limit.h:58] exceeded limit: limit=6291456000 consumption=6296890776
impalad.INFO:I0807 15:39:52.403287 12119 mem-limit.h:58] exceeded limit: limit=6291456000 consumption=6453489048
impalad.INFO:I0807 15:39:52.407752 14623 mem-limit.h:58] exceeded limit: limit=6291456000 consumption=6448000408

It consumes 150MB more than it's allowed. I've also seen cases where it has exceeded 2GB.