Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1739

Collecting CPU and memory usage for MapReduce jobs

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      MAPREDUCE-220 collects CPU and memory usage for each task.
      We can aggregate them to get the information per job. Such information can be used for scheduling, profiling or charging the users based on the resource they consumed.

      Here are some information that should be useful:
      1. Total CPU cycles (# of giga-cycles)
      2. Total Memory occupied time (GB-sec)
      3. Maximum peak memory on one task (GB)
      4. Maximum peak CPU on one task (GHz)

      Thoughts?

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                schen Scott Chen
                Reporter:
                schen Scott Chen
              • Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated: