[YARN-4553] Add cgroups support for docker containers

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.9.0, 3.0.0-alpha1
• Component/s: yarn
• Labels: Docker
• Assignee: Sidharta Seethana
• Reporter: Sidharta Seethana
• Created: 07/Jan/16 02:22
• Updated: 02/May/18 22:34
• Resolved: 14/Jan/16 09:03

Description

Currently, cgroups-based resource isolation does not work with docker containers under YARN. The processes in these containers are launched by the docker daemon and they are not children of a container-executor process. Docker supports a --cgroup-parent flag which can be used to point to the container-specific cgroups that are created by the nodemanager. This will allow the Nodemanager to manage cgroups (as it does today) while allowing resource isolation to work with docker containers.

Issue Links

• breaks: YARN-4762 NMs failing on DelegatingLinuxContainerRuntime init with LCE on
• is duplicated by: YARN-5827 DockerLinuxContainer can't limit the cpu usage