[YARN-3033] [Collector wireup] Implement NM starting the standalone timeline collector daemon

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Component/s: timelineserver
• Labels: YARN-5355
• Assignee: Li Lu
• Reporter: Sangjin Lee
• Created: 13/Jan/15 00:33
• Updated: 25/Oct/19 20:26
• Resolved: 30/Aug/19 05:44

Description

Per design in YARN-2928, implement node managers starting the ATS writer companion. In YARN-2928, we already have an auxiliary service based solution. Per discussion below, the bulk of that approach has actually been done as part of YARN-3030. In this ticket we can work on the remaining tasks, for example:

1. any needed change for configuration, esp. running it inside the NM (e.g. the number of servlet threads)
2. set up a start script that starts the per-node aggregator as a standalone daemon
3. for the standalone mode, implement a service that receives requests to set up and tear down the app-level data

Issue Links

• is blocked by: YARN-3210 [Source organization] Refactor timeline collector according to new code organization
• is depended upon by: YARN-3038 [Collector wireup] Handle timeline collector failure scenarios
• is depended upon by: YARN-3115 [Collector wireup] Work-preserving restarting of per-node timeline collector
• is related to: YARN-2141 [Umbrella] Capture container and node resource consumption
• relates to: YARN-3087 [Collector implementation] the REST server (web server) for per-node collector does not work if it runs inside node manager