Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6331 [Umbrella] Make MapReduce work with Timeline Service Nextgen (YARN-2928)
  3. MAPREDUCE-6327

[Event producers] Implement MapReduce AM writing MR events/counters to v2 ATS

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.9.0, 3.0.0-alpha1
    • None
    • None
    • Reviewed

    Description

      Per design in YARN-2928, select a handful of MR metrics (e.g. HDFS bytes written) and have the MR AM write the framework-specific metrics to ATS.

      Attachments

        1. YARN-3046-v6.patch
          78 kB
          Junping Du
        2. YARN-3046-v5.patch
          78 kB
          Junping Du
        3. YARN-3046-v4.patch
          76 kB
          Junping Du
        4. YARN-3046-v3.patch
          78 kB
          Junping Du
        5. YARN-3046-v2.patch
          76 kB
          Junping Du
        6. YARN-3046-v1-rebase.patch
          77 kB
          Junping Du
        7. YARN-3046-v1.patch
          76 kB
          Junping Du
        8. YARN-3046-no-test-v2.patch
          62 kB
          Junping Du
        9. YARN-3046-no-test.patch
          54 kB
          Junping Du

        Issue Links

          depends upon

          Sub-task - The sub-task of the issue YARN-3030 [Collector wireup] Set up timeline collector with basic request serving structure and lifecycle

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue YARN-3039 [Collector wireup] Implement timeline app-level collector service discovery

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue YARN-3040 [Data Model] Make putEntities operation be aware of the app's context

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue YARN-3041 [Data Model] create overall data objects of TS next gen

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue YARN-3042 [Data Model] Create ATS metrics API

          • Major - Major loss of function.
          • Resolved
          is blocked by

          Test - A new unit, integration or system test. MAPREDUCE-6189 TestMRTimelineEventHandling fails in trunk

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue MAPREDUCE-6318 Refactor JobHistoryEventHandler for handling events in ATS v1

          • Major - Major loss of function.
          • Open

          Sub-task - The sub-task of the issue YARN-3334 [Event Producers] NM TimelineClient container metrics posting to new timeline service.

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue YARN-3488 AM get timeline service info from RM rather than Application specific configuration.

          • Major - Major loss of function.
          • Patch Available

          Activity

            People

              junping_du Junping Du
              sjlee0 Sangjin Lee
              Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: