[IMPALA-10193] Limit the memory usage of the whole mini-cluster

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: Impala 3.4.0
• Fix Version/s: Impala 4.0.0
• Component/s: Infrastructure
• Epic Color: ghx-label-4
• Assignee: Fifteen
• Reporter: Fifteen
• Created: 28/Sep/20 09:17
• Updated: 12/Oct/20 16:34
• Resolved: 12/Oct/20 03:11

Description

The mini-cluster contains 3 virtual nodes, and all of them runs in a single 'Machine'. By quoting, it implies the machine can be a docker container. If the container is started with `-priviledged` and the actual memory is limited by CGROUPS, then the total memory in `htop` and the actual available memory can be different! 

 

For example, in the container below, `htop` tells us the total memory is 128GB, while the total memory set in CGROUPS is actually 32GB. If the acutal mem usage exceeds 32GB, process (such as impalad, hivemaster2 etc.) get killed.

 

 

So we may need a way to limit the whole mini-cluster's memory usage.