[SLIDER-151] Implement full slider API in REST and switch client to it

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: Slider 0.60
• Fix Version/s: Slider 2.0.0
• Component/s: client, Web & REST
• Sprint: Slider December #1
• Assignee: Steve Loughran
• Reporter: Steve Loughran
• Created: 19/Jun/14 00:49
• Updated: 04/Nov/15 18:59

Issue Links

• depends upon: SLIDER-170 switch to YARN Rest API for App creation
• depends upon: YARN-2947 Provide RESTful equivalent of YarnClientImpl
• depends upon: YARN-2948 Provide Read Write REST view of YARN registry and client compatible with existing Registry API
• depends upon: SLIDER-782 Implement SLIDER RPC Client API in sync with REST API
• depends upon: YARN-2605 [RM HA] Rest api endpoints doing redirect incorrectly
• depends upon: YARN-2031 YARN Proxy model doesn't support REST APIs in AMs
• depends upon: SLIDER-797 AppsThroughAgentIT test failing as registry call receiving text/plain from RM HA
• depends upon: YARN-2425 When Application submitted by via Yarn RM WS, log aggregation does not happens
• depends upon: YARN-3526 ApplicationMaster tracking URL is incorrectly redirected on a QJM cluster
• depends upon: YARN-1695 Implement the rest (writable APIs) of RM web-services
• depends upon: YARN-2084 YARN to support REST APIs in AMs
• depends upon: HADOOP-11822 mark org.apache.hadoop.security.ssl.SSLFactory as @Public
• depends upon: SLIDER-747 Expose component specific information through Slider AM Web Service
• is depended upon by: SLIDER-103 SliderClient action methods need to be refactored to be API friendly

Sub-Tasks

• Document existing (read-only) REST APIs: Resolved
• Draft new REST API with use cases: Resolved
• Restore insecure WS "back door" for REST dev: Resolved
• Implement initial read-only view of live REST resources: Resolved
• Implement REST app setup resources: Open
• Implement the cluster flex operation via REST: Open
• Expose REST view of containers/component instances with DELETE operation: Open
• expose REST operation to stop the AM/application: Resolved
• Offer REST upgrade operation: Open
• Migrate slider client to slider REST API: Open
• Slider client to support remote file operations via WebHDFS: Open
• Create slider REST client library: Resolved
• switch to YARN Rest API for App creation: Open
• Slider client to switch to YARN Registry IPC/REST API: Open
• don't serve web content until AM is fully configured: Resolved
• slider REST services to offer text/html views for browsers: Open
• (protototype) Registry REST API to serve up 302 redirects to service endpoints: Open
• expose raw/resolved views of app configurations: Resolved
• close WS/ back door for REST resources: Open
• add metering/counter of REST operations: Resolved
• disable WS back door for 0.70 release: Resolved
• Add API-level slider REST client: Resolved
• root slider pages to link to new App view: Resolved
• Implement SLIDER RPC Client API in sync with REST API: Resolved
• clean up some of the REST client code: Resolved
• REST clients to react to text/plain & text/html responses with meaningful errors: Open