[IMPALA-7941] Determine process memory limit from cgroups limit, if set

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 3.2.0
• Component/s: Backend
• Labels: admission-control resource-management
• Epic Link: Auto proc mem limit
• Target Version: Impala 3.2.0
• Epic Color: ghx-label-5
• Assignee: Tim Armstrong
• Reporter: Tim Armstrong
• Created: 06/Dec/18 23:25
• Updated: 29/Jan/19 09:57
• Resolved: 27/Jan/19 16:38

Description

We currently take the hardcoded config value, or the system physical memory if that is not set. We could be smarter when running in a container by sniffing out the cgroups setting.

Java did something along this lines: https://www.opsian.com/blog/java-on-docker/

Issue Links

• is duplicated by: IMPALA-7940 Automatically set process memory limit to a good value when running in a container

Sub-Tasks

• Update docs to reflect CGroups memory limit changes: Closed