[YARN-8029] YARN_CONTAINER_RUNTIME_DOCKER_MOUNTS should not use commas as separators

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 3.0.0
• Component/s: yarn
• Labels: Docker
• Assignee: Jim Brennan
• Reporter: Jim Brennan
• Created: 14/Mar/18 18:01
• Updated: 02/May/18 22:34
• Resolved: 29/Mar/18 17:37

Description

The following docker-related environment variables specify a comma-separated list of mounts:

YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS
YARN_CONTAINER_RUNTIME_DOCKER_MOUNTS

This is a problem because hadoop -Dmapreduce.map.env and related options use comma as a delimiter. So if I put more than one mount in YARN_CONTAINER_RUNTIME_DOCKER_MOUNTS the comma in the variable will be treated as a delimiter for the hadoop command line option and all but the first mount will be ignored.

Issue Links

• is related to: YARN-8071 Add ability to specify nodemanager environment variables individually
• relates to: YARN-5534 Allow user provided Docker volume mount list
• relates to: YARN-6830 Support quoted strings for environment variables
• relates to: YARN-6434 When setting environment variables, can't use comma for a list of value in key = value pairs.
• relates to: HADOOP-11640 add user defined delimiter support to Configuration