Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-7025

Avg and Max of memory could be record in TaskCount

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • None
    • None
    • None

    Description

      MapReduce Counter is very helpful tool to do statistics, analysis and tuning in industry. One popular way is analysing job historical status of running to optimise continuously. But when the job completed, the memory usage in counter is a snapshot value PHYSICAL_MEMORY_BYTES. So if we can also record the average value and the max value instead of only the last snapshot value, it could be much helpful.

      If you think it' ok. I will contribute the code.

      Attachments

        Activity

          People

            cltlfcjin Lantao Jin
            cltlfcjin Lantao Jin
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: