Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
Rumen emits job and task (map/reduce) level heap settings (i.e values of mapred.child.java.opts, mapreduce.map.java.opts and mapreduce.reduce.java.opts). It also emits cluster and task (map/reduce) level memory configurations (e.g mapreduce.cluster.mapmemory.mb, mapreduce.cluster.reducememory.mb, mapreduce.map.memory.mb and mapreduce.reduce.memory.mb). Currently, it incorrectly sets map/reduce task level memory usage to the max heap values obtained from mapreduce.map.java.opts and mapreduce.reduce.java.opts. Note that HadoopLogsAnalyzer correctly sets it.
Also the cluster level task level (map/reduce) memory configurations are missing.