Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9228 [Umbrella] Docker image life cycle management on HDFS
  3. YARN-9244

Document docker registry deployment with direct S3 driver

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.3.0
    • Component/s: None
    • Labels:
      None

      Description

      On Amazon, it would be possible to deploy docker registry in YARN using Docker's own S3 driver. The same micro-benchmark can also be applied to show the docker registry performance difference. The sample YARN service configuration looks like this:

      {
        "name": "docker-registry",
        "version": "1.0",
        "kerberos_principal" : {
          "principal_name" : "hbase/_HOST@EXAMPLE.COM",
          "keytab" : "file:///etc/security/keytabs/hbase.service.keytab"
        },
        "components" :
        [
          {
            "name": "registry",
            "number_of_containers": 1,
            "artifact": {
              "id": "registry:latest",
              "type": "DOCKER"
            },
            "resource": {
              "cpus": 1,
              "memory": "256"
            },
            "run_privileged_container": true,
            "configuration": {
              "env": {
                "YARN_CONTAINER_RUNTIME_DOCKER_RUN_OVERRIDE_DISABLE":"true",
                "YARN_CONTAINER_RUNTIME_DOCKER_MOUNTS":"/path/to/config.yml:/etc/docker/registry/config.yml"
              },
              "properties": {
                "docker.network": "host"
              }
            }
          }
        ]
      }
      

      Where /path/to/config.yml maps to a Docker S3 storage option config.

        Attachments

        1. YARN-9244.1.patch
          1 kB
          Suma Shivaprasad
        2. YARN-9244.2.patch
          3 kB
          Suma Shivaprasad

          Activity

            People

            • Assignee:
              suma.shivaprasad Suma Shivaprasad
              Reporter:
              eyang Eric Yang
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: