[YARN-2948] Provide Read Write REST view of YARN registry and client compatible with existing Registry API

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.6.0
• Component/s: resourcemanager
• Assignee: Unassigned
• Reporter: Steve Loughran
• Created: 10/Dec/14 15:38
• Updated: 10/Dec/14 15:38

Description

The YARN registry implementation in hadoop 2.6 implemented the core ZK client of the registry API; a client library needing no servers other than the ZK quorum. This has good availability, but does not work outside the cluster (unless ZK is accessible). It also uses ZK's SASL client which is somewhat fiddly (you need to set system properties for it to work)

For remote/long haul access we need a REST equivalent, one that proxies. This REST service is also needed to work with clients in other languages.

This issue proposes

1. implementing a web application to offer read access to the registry to all
2. to support write access to authenticated users (with access restricted to their part of the /users tree)
3. providing an implementation of RegistryOperations which uses this API, offering authenticated and unauthenticated access to the REST service.
4. extending the RM to optionally support this.

The registry client API has been designed from the outset to work with REST APIs: a potentially connectionless Yarn service with simple put/get/delete operations; the naming scheme also chosen for REST paths as well as DNS.

Issue Links

• is depended upon by: SLIDER-151 Implement full slider API in REST and switch client to it