Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-8472 YARN Container Phase 2
  3. YARN-8643

Docker image life cycle management on HDFS

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.3.0
    • Component/s: yarn
    • Labels:
    • Target Version/s:

      Description

      This JIRA is forking an idea proposed in YARN-3854 to manage trusted docker images on HDFS. YARN-3854 is going to focus on rearranging the node manager and container-executor logic to download docker image during file localization phase for better error handling and reporting. The new proposal is to create a docker container which host Docker registry and NFS gateway, and configure docker images to store on HDFS. The docker container can run in YARN framework to serve as privileged or trusted registries.

      HDFS_Docker_registry_design.png describes the components required to create a docker image that can store docker images on HDFS.

      Deploy_HDFS_Docker_registry_workflow.png describes the operation to perform to setup a trusted docker registry that write to HDFS.

        Attachments

        1. HDFS_Docker_registry_design.png
          23 kB
          Eric Yang
        2. Deploy_HDFS_Docker_registry_workflow.png
          38 kB
          Eric Yang

          Issue Links

            Activity

              People

              • Assignee:
                eyang Eric Yang
                Reporter:
                eyang Eric Yang
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: