[YARN-9244] Document docker registry deployment with direct S3 driver

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.3.0
• Assignee: Suma Shivaprasad
• Reporter: Eric Yang
• Created: 28/Jan/19 19:36
• Updated: 23/Feb/19 00:34
• Resolved: 23/Feb/19 00:15

Description

On Amazon, it would be possible to deploy docker registry in YARN using Docker's own S3 driver. The same micro-benchmark can also be applied to show the docker registry performance difference. The sample YARN service configuration looks like this:

{
  "name": "docker-registry",
  "version": "1.0",
  "kerberos_principal" : {
    "principal_name" : "hbase/[e-mail]",
    "keytab" : "file:///etc/security/keytabs/hbase.service.keytab"
  },
  "components" :
  [
    {
      "name": "registry",
      "number_of_containers": 1,
      "artifact": {
        "id": "registry:latest",
        "type": "DOCKER"
      },
      "resource": {
        "cpus": 1,
        "memory": "256"
      },
      "run_privileged_container": true,
      "configuration": {
        "env": {
          "YARN_CONTAINER_RUNTIME_DOCKER_RUN_OVERRIDE_DISABLE":"true",
          "YARN_CONTAINER_RUNTIME_DOCKER_MOUNTS":"/path/to/config.yml:/etc/docker/registry/config.yml"
        },
        "properties": {
          "docker.network": "host"
        }
      }
    }
  ]
}

Where /path/to/config.yml maps to a Docker S3 storage option config.