Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2545

[Rumen] Rumen incorrectly emits memory usages of map/reduce tasks

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • tools/rumen
    • None

    Description

      Rumen emits job and task (map/reduce) level heap settings (i.e values of mapred.child.java.opts, mapreduce.map.java.opts and mapreduce.reduce.java.opts). It also emits cluster and task (map/reduce) level memory configurations (e.g mapreduce.cluster.mapmemory.mb, mapreduce.cluster.reducememory.mb, mapreduce.map.memory.mb and mapreduce.reduce.memory.mb). Currently, it incorrectly sets map/reduce task level memory usage to the max heap values obtained from mapreduce.map.java.opts and mapreduce.reduce.java.opts. Note that HadoopLogsAnalyzer correctly sets it.

      Also the cluster level task level (map/reduce) memory configurations are missing.

      Attachments

        Activity

          People

            Unassigned Unassigned
            amar_kamat Amar Kamat
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: