Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-913 Umbrella: Add a way to register long-lived services in a YARN cluster
  3. YARN-2948

Provide Read Write REST view of YARN registry and client compatible with existing Registry API

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.6.0
    • Fix Version/s: None
    • Component/s: resourcemanager
    • Labels:
      None

      Description

      The YARN registry implementation in hadoop 2.6 implemented the core ZK client of the registry API; a client library needing no servers other than the ZK quorum. This has good availability, but does not work outside the cluster (unless ZK is accessible). It also uses ZK's SASL client which is somewhat fiddly (you need to set system properties for it to work)

      For remote/long haul access we need a REST equivalent, one that proxies. This REST service is also needed to work with clients in other languages.

      This issue proposes

      1. implementing a web application to offer read access to the registry to all
      2. to support write access to authenticated users (with access restricted to their part of the /users tree)
      3. providing an implementation of RegistryOperations which uses this API, offering authenticated and unauthenticated access to the REST service.
      4. extending the RM to optionally support this.

      The registry client API has been designed from the outset to work with REST APIs: a potentially connectionless Yarn service with simple put/get/delete operations; the naming scheme also chosen for REST paths as well as DNS.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                stevel@apache.org Steve Loughran
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated: