[MAPREDUCE-6331] [Umbrella] Make MapReduce work with Timeline Service Nextgen (YARN-2928)

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.9.0, 3.0.0-alpha1
• Hadoop Flags: Reviewed
• Assignee: Sangjin Lee
• Reporter: Vinod Kumar Vavilapalli
• Created: 22/Apr/15 17:08
• Updated: 25/Oct/19 20:24
• Resolved: 11/Jul/16 03:46

Description

Tracking umbrella for all MR changes to make it work with Timeline Service Nextgen - YARN-2928.

Issue Links

• is part of: YARN-2928 YARN Timeline Service v.2: alpha 1
• is related to: MAPREDUCE-5858 [Umbrella] MR should make use of the timeline server
• relates to: MAPREDUCE-6732 mapreduce tasks for YARN Timeline Service v.2: alpha 2

Sub-Tasks

• [Event producers] Implement MapReduce AM writing MR events/counters to v2 ATS: Resolved
• convert load test driver to timeline service v.2: Resolved
• add a mode to replay MR job history files to the timeline service: Resolved
• Timeline service v2 load generator needs to write event id: Resolved
• clean up several issues with TimelineServicePerformance: Resolved
• Store MR counters as timeline metrics instead of event: Resolved
• reconcile the two versions of the timeline service performance tests: Resolved
• Store job configurations in Timeline Service v2: Resolved
• Inconsistent values of counters across tasks and job reported to timeline service.: Resolved