[YARN-5482] ContainerMetric Lead to memory leaks

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 2.7.1
• Assignee: Wally Tang
• Reporter: Wally Tang
• Created: 08/Aug/16 06:10
• Updated: 08/Aug/16 15:21
• Resolved: 08/Aug/16 09:59

Description

In our cluster, I often find NodeManager OOM, I dump the heap file and found ContainerMetric takes up a lot of memory

export YARN_NODEMANAGER_OPTS="-Xmx2g -Xms2g -Xmn1g -XX:PermSize=128M -XX:MaxPermSize=128M -XX:+DisableExplicitGC -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/data1/yarn-logs/nm_dump.log -Dcom.sun.management.jmxremote -Xloggc:/data1/yarn-logs/nm_gc.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCApplicationStoppedTime -XX:+PrintGCApplicationConcurrentTime -XX:+PrintTenuringDistribution -XX:ErrorFile=/data1/yarn-logs/nm_err_pid"

Issue Links

• duplicates: HADOOP-13362 DefaultMetricsSystem leaks the source name when a source unregisters