[YARN-3030] [Collector wireup] Set up timeline collector with basic request serving structure and lifecycle

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.9.0, 3.0.0-alpha1
• Component/s: timelineserver
• Target Version/s: YARN-2928
• Hadoop Flags: Reviewed
• Assignee: Sangjin Lee
• Reporter: Sangjin Lee
• Created: 13/Jan/15 00:20
• Updated: 21/Oct/17 06:05
• Resolved: 27/Jan/15 18:45

Description

Per design in YARN-2928, create an ATS writer as a service, and implement the basic service structure including the lifecycle management.

Also, as part of this JIRA, we should come up with the ATS client API for sending requests to this ATS writer.

Issue Links

• is depended upon by: MAPREDUCE-6327 [Event producers] Implement MapReduce AM writing MR events/counters to v2 ATS
• is depended upon by: YARN-3032 [Collector implementation] Implement timeline collector functionality to serve ATS readers' requests for live apps
• is depended upon by: YARN-3044 [Event producers] Implement RM writing app lifecycle events to ATS
• is depended upon by: YARN-3045 [Event producers] Implement NM writing container lifecycle events to ATS
• is related to: YARN-3115 [Collector wireup] Work-preserving restarting of per-node timeline collector
• is related to: YARN-3116 [Collector wireup] We need an assured way to determine if a container is an AM container on NM
• relates to: YARN-3087 [Collector implementation] the REST server (web server) for per-node collector does not work if it runs inside node manager