Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6331 [Umbrella] Make MapReduce work with Timeline Service Nextgen (YARN-2928)
  3. MAPREDUCE-6424

Store MR counters as timeline metrics instead of event

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      In MAPREDUCE-6327, we make map/reduce counters get encoded from JobFinishedEvent as timeline events with counters details in JSON format.
      We need to store framework specific counters as metrics in timeline service to support query, aggregation, etc.

      Attachments

        1. MAPREDUCE-6424-YARN-2928.v1.005.patch
          50 kB
          Naganarasimha G R
        2. MAPREDUCE-6424-YARN-2928.v1.004.patch
          50 kB
          Naganarasimha G R
        3. MAPREDUCE-6424-YARN-2928.v1.003.patch
          50 kB
          Naganarasimha G R
        4. MAPREDUCE-6424-YARN-2928.v1.002.patch
          49 kB
          Naganarasimha G R
        5. MAPREDUCE-6424-YARN-2928.v1.001.patch
          46 kB
          Naganarasimha G R

        Issue Links

          is related to

          Sub-task - The sub-task of the issue YARN-4173 Ensure the final values for metrics/events are emitted/stored at APP completion time

          • Major - Major loss of function.
          • Open
          relates to

          Sub-task - The sub-task of the issue YARN-3401 [Security] users should not be able to create a generic TimelineEntity and associate arbitrary type

          • Major - Major loss of function.
          • Open

          Activity

            People

              Naganarasimha Naganarasimha G R
              junping_du Junping Du
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: