[YARN-8141] YARN Native Service: Respect YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS specified in service spec

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 3.2.0, 3.1.1
• Component/s: yarn-native-services
• Labels: Docker
• Target Version/s: 3.2.0, 3.1.1
• Assignee: Chandni Singh
• Reporter: Wangda Tan
• Created: 10/Apr/18 21:59
• Updated: 18/May/18 01:18
• Resolved: 17/May/18 21:35

Description

Existing YARN native service overwrites YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS regardless if user specified this in service spec or not. It is important to allow user to mount local folders like /etc/passwd, etc.

Following logic overwrites the YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS environment:

StringBuilder sb = new StringBuilder();
for (Entry<String,String> mount : mountPaths.entrySet()) {
  if (sb.length() > 0) {
    sb.append(",");
  }
  sb.append(mount.getKey());
  sb.append(":");
  sb.append(mount.getValue());
}
env.put("YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS", sb.toString());

Inside AbstractLauncher.java