[IMPALA-5301] minicluster kudu needs mem limits set

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 2.8.0
• Fix Version/s: Impala 2.9.0
• Component/s: Infrastructure
• Labels: kudu
• Epic Color: ghx-label-1
• Assignee: Unassigned
• Reporter: Matthew Jacobs
• Created: 11/May/17 01:25
• Updated: 17/May/17 23:51
• Resolved: 17/May/17 23:51

Description

The minicluster runs Kudu without an explicit memory limit, and Kudu defaults to assuming it can use 80% of system memory. We should set a limit to avoid overcommitting system memory.

We need to keep the value low because aws test nodes (jenkins.impala.io) are small, see IMPALA-5297. I tested a limit of 1gb but that wasn't enough – TestKuduMemLimits failed. We may try something a bit larger, or perhaps find other ways to reduce the requirements of minicluster tests.