[YARN-8927] Support trust top-level image like "centos" when "library" is configured in "docker.trusted.registries"

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.3.0
• Labels: Docker
• Assignee: Zhankun Tang
• Reporter: Zhankun Tang
• Created: 22/Oct/18 14:10
• Updated: 16/Feb/19 00:36
• Resolved: 15/Feb/19 16:20

Description

There are some missing cases that we need to catch when handling "docker.trusted.registries".

The container-executor.cfg configuration is as follows:

docker.trusted.registries=tangzhankun,ubuntu,centos

It works if run DistrubutedShell with "tangzhankun/tensorflow"

"yarn ... -shell_env YARN_CONTAINER_RUNTIME_TYPE=docker -shell_env YARN_CONTAINER_RUNTIME_DOCKER_IMAGE=tangzhankun/tensorflow

But run a DistrubutedShell job with "centos", "centos[:tagName]", "ubuntu" and "ubuntu[:tagName]" fails:
The error message is like:

"image: centos is not trusted"

We need better handling the above cases.

Issue Links

• is related to: YARN-3854 Add localization support for docker images

Sub-Tasks

• Document usage of "library" in "docker.trusted.repositories" to trust local image: Open