[YARN-9228] [Umbrella] Docker image life cycle management on HDFS

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.3.0
• Labels: docker
• Assignee: Eric Yang
• Reporter: Eric Yang
• Created: 23/Jan/19 21:42
• Updated: 08/Mar/19 16:49
• Resolved: 08/Mar/19 16:47

Description

This story describe the research and development work items related to manage docker images via Docker Registry and store in HDFS.

The list of work items to try:
1. Document existing procedure to mount Docker Registry via NFS Gateway.
2. Write a storage driver for Docker Registry to pull Docker image layers from HDFS.
3. Test squashFS layer with Modified Docker registry and loading image from HDFS.
4. Write YARN auxiliary service plugin to start up Docker registry.

Issue Links

• is cloned by: YARN-8643 Docker image life cycle management on HDFS

Sub-Tasks

• Document docker registry deployment with NFS Gateway: Resolved
• Write a go hdfs driver for Docker Registry: Resolved
• Document docker registry deployment with Ozone CSI driver: Resolved
• Document docker registry deployment with direct S3 driver: Resolved