[HIVE-1818] Call frequency and duration metrics for HiveMetaStore via jmx

• Type: New Feature
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 0.7.0
• Component/s: Metastore
• Hadoop Flags: Reviewed
• Release Note: jmx instrumentation for HiveMetaStore call frequency and duration
• Assignee: Sushanth Sowmyan
• Reporter: Sushanth Sowmyan
• Created: 30/Nov/10 23:24
• Updated: 16/Dec/11 23:59
• Resolved: 09/Feb/11 04:19

Description

As recently brought up in the hive-dev mailing list, it'd be useful if the HiveMetaStore had some sort of instrumentation capability so as to measure frequency of calls to various calls on the HiveMetaStore and the duration of time spent in these calls.

There are already incrementCounter() and logStartFunction() / logStartTableFunction() ,etc calls in HiveMetaStore, and they could be refactored/repurposed to make calls that expose JMX MBeans as well. Or, a Metrics subsystem could be introduced which made calls to incrementCounter()/etc as a refactor.

It might also be possible to specify a -D parameter that the Metrics subsystem could use to determine whether or not to be enabled, and if so, on to what port. And once we have the capability to instrument and expose MBeans, it might also be possible for other subsystems to also adopt and use this system.