Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-220

Collecting cpu and memory usage for MapReduce tasks

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.22.0
    • task, tasktracker
    • None
    • Reviewed
    • Collect cpu and memory statistics per task.

    Description

      It would be nice for TaskTracker to collect cpu and memory usage for individual Map or Reduce tasks over time.

      Attachments

        1. ant-test.log
          48 kB
          Scott Chen
        2. ant-test-patch.log
          2 kB
          Scott Chen
        3. MAPREDUCE-220.txt
          15 kB
          Scott Chen
        4. MAPREDUCE-220-20100616.txt
          12 kB
          Scott Chen
        5. MAPREDUCE-220-20100804.txt
          12 kB
          Scott Chen
        6. MAPREDUCE-220-20100806.txt
          12 kB
          Scott Chen
        7. MAPREDUCE-220-20100809.txt
          12 kB
          Scott Chen
        8. MAPREDUCE-220-20100811.txt
          14 kB
          Scott Chen
        9. MAPREDUCE-220-20100812.txt
          14 kB
          Scott Chen
        10. MAPREDUCE-220-20100817.txt
          13 kB
          Scott Chen
        11. MAPREDUCE-220-20100818.txt
          13 kB
          Scott Chen
        12. MAPREDUCE-220-v1.txt
          15 kB
          Scott Chen

        Issue Links

          incorporates

          New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-1167 Make ProcfsBasedProcessTree collect rss memory information

          • Major - Major loss of function.
          • Closed
          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-901 Move Framework Counters into a TaskMetric structure

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-1762 Add a setValue() method in Counter

          • Major - Major loss of function.
          • Closed
          is depended upon by

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-2104 Rumen TraceBuilder Does Not Emit CPU/Memory Usage Details in Traces

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-1739 Collecting CPU and memory usage for MapReduce jobs

          • Major - Major loss of function.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-2037 Capturing interim progress times, CPU usage, and memory usage, when tasks reach certain progress thresholds

          • Major - Major loss of function.
          • Closed
          relates to

          New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-2777 Backport MAPREDUCE-220 to Hadoop 20 security branch

          • Major - Major loss of function.
          • Closed

          Activity

            People

              schen Scott Chen
              hong.tang Hong Tang
              Votes:
              0 Vote for this issue
              Watchers:
              28 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: