Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9228 [Umbrella] Docker image life cycle management on HDFS
  3. YARN-9244

Document docker registry deployment with direct S3 driver

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.3.0
    • None
    • None

    Description

      On Amazon, it would be possible to deploy docker registry in YARN using Docker's own S3 driver. The same micro-benchmark can also be applied to show the docker registry performance difference. The sample YARN service configuration looks like this:

      {
        "name": "docker-registry",
        "version": "1.0",
        "kerberos_principal" : {
          "principal_name" : "hbase/_HOST@EXAMPLE.COM",
          "keytab" : "file:///etc/security/keytabs/hbase.service.keytab"
        },
        "components" :
        [
          {
            "name": "registry",
            "number_of_containers": 1,
            "artifact": {
              "id": "registry:latest",
              "type": "DOCKER"
            },
            "resource": {
              "cpus": 1,
              "memory": "256"
            },
            "run_privileged_container": true,
            "configuration": {
              "env": {
                "YARN_CONTAINER_RUNTIME_DOCKER_RUN_OVERRIDE_DISABLE":"true",
                "YARN_CONTAINER_RUNTIME_DOCKER_MOUNTS":"/path/to/config.yml:/etc/docker/registry/config.yml"
              },
              "properties": {
                "docker.network": "host"
              }
            }
          }
        ]
      }
      

      Where /path/to/config.yml maps to a Docker S3 storage option config.

      Attachments

        1. YARN-9244.1.patch
          1 kB
          Suma Shivaprasad
        2. YARN-9244.2.patch
          3 kB
          Suma Shivaprasad

        Activity

          People

            suma.shivaprasad Suma Shivaprasad
            eyang Eric Yang
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: