[YARN-5428] Allow for specifying the docker client configuration directory

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.1.0
• Component/s: yarn
• Labels: Docker oct16-medium
• Target Version/s: 3.1.0
• Hadoop Flags: Reviewed
• Assignee: Shane Kumpf Assign to me
• Reporter: Shane Kumpf
• Due: 31/Aug/16
• Created: 25/Jul/16 18:34
• Updated: 26/Aug/20 09:50
• Resolved: 08/Feb/18 19:37

Description

The docker client allows for specifying a configuration directory that contains the docker client's configuration. It is common to store "docker login" credentials in this config, to avoid the need to docker login on each cluster member.

By default the docker client config is $HOME/.docker/config.json on Linux. However, this does not work with the current container executor user switching and it may also be desirable to centralize this configuration beyond the single user's home directory.

Note that the command line arg is for the configuration directory NOT the configuration file.

This change will be needed to allow YARN to automatically pull images at localization time or within container executor.

Issue Links

• relates to: YARN-10410 Does not work specifying the docker client configuration in distributed shell