[HADOOP-6728] Overhaul metrics framework

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.20.2, 0.21.0
• Hadoop Flags: Incompatible change
• Tags: metrics
• Assignee: Luke Lu
• Reporter: Luke Lu
• Created: 28/Apr/10 02:09
• Updated: 30/Jul/14 18:28
• Resolved: 30/Jul/14 18:28

Description

Per discussions with Arun, Chris, Hong and Rajiv, et al, we concluded that the current metrics framework needs an overhaul to:

• Allow multiple plugins for different monitoring systems simultaneously (see also: HADOOP-6508).
• Refresh metrics plugin config without server restart.
  • Including filtering of metrics per plugin.
• Support metrics schema for plugins.

The jira will be resolved when core hadoop components (hdfs, mapreduce) are updated to use the new framework . Updates to external components that use the existing metrics framework will be tracked by different issues.

The current design wiki.

Issue Links

• incorporates: HDFS-1386 TestJMXGet fails in jdk7
• is blocked by: HADOOP-6787 Factor out glob pattern code from FileContext and Filesystem
• is blocked by: HDFS-1117 HDFS portion of HADOOP-6728 (ovehaul metrics framework)
• is blocked by: MAPREDUCE-1738 MapReduce portion of HADOOP-6728 (ovehaul metrics framework)
• relates to: HBASE-4050 Update HBase metrics framework to metrics2 framework

Sub-Tasks

• Metrics2: metrics framework: Closed
• Metrics2: metrics instrumentation: Closed
• metrics2: metrics plugins: Closed