[SLIDER-149] Support a YARN service registry

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Slider 0.60
• Sprint: Slider August #1, Slider August #2, Slider September #1, Slider October #1, Slider October #2, Slider November #2
• Assignee: Steve Loughran
• Reporter: Steve Loughran
• Created: 18/Jun/14 20:17
• Updated: 24/Nov/14 17:08
• Resolved: 24/Nov/14 17:08

Description

YARN-913 proposes a YARN-wide service registry; we must integrate with this as it is implemented.

Issue Links

• depends upon: YARN-2571 RM to support YARN registry
• depends upon: YARN-2677 registry punycoding of usernames doesn't fix all usernames to be DNS-valid
• depends upon: YARN-913 Umbrella: Add a way to register long-lived services in a YARN cluster
• is depended upon by: SLIDER-365 slider "resolve" command to retrieve service record
• is depended upon by: SLIDER-61 Add functional test for agent provider publishing registry info
• is depended upon by: SLIDER-482 accumulo funtest to include registry retrieval
• is depended upon by: SLIDER-483 HBase funtest to include registry retrieval

Sub-Tasks

• AppState RoleInstances to store endpoint details: Closed
• Enhance registry command with --out option: Resolved
• slider "resolve" command to retrieve service record: Resolved
• agent ZK bindings to move to YARN registry: Resolved
• Get Curator & Guava in Hadoop consistent: Resolved
• registration failing if username isn't valid DNS entry: Resolved
• update src & docs to new registry keys; deprecate old ones: Resolved
• slider "resolve" command to support ~ to mean "home dir of current user": Resolved
• Add/extend funtests to use registry (and resolve command): Resolved
• allow slider registry command to take a user: Resolved
• adopt gour's' suggested improvements to registry: Resolved
• AgentRegistryIT-testAgentRegistry failing: ~ passdown: Resolved
• AM to only register service record at app level: Resolved