[YARN-3854] Add localization support for docker images

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: yarn
• Labels: Docker
• Assignee: Chandni Singh
• Reporter: Sidharta Seethana
• Created: 25/Jun/15 21:44
• Updated: 29/Jan/19 19:29

Description

We need the ability to localize docker images when those images aren't already available locally. There are various approaches that could be used here with different trade-offs/issues : image archives on HDFS + docker load , docker pull during the localization phase or (automatic) docker pull during the run/launch phase.

We also need the ability to clean-up old/stale, unused images.

Issue Links

• is duplicated by: YARN-3289 Docker images should be downloaded during localization
• relates to: YARN-8955 Add a flag to use local docker image instead of getting latest from registry
• relates to: YARN-8927 Support trust top-level image like "centos" when "library" is configured in "docker.trusted.registries"

Sub-Tasks

• Retrieve the status of resource localization: Resolved
• Add support for Docker image clean up: Open
• Add support for Docker Images command: Resolved
• Add support for docker image localization: Resolved
• Detect docker image existence during container launch: Open
• Create Image Localizer: Open