[SPARK-33942] Wrong metrics information in Spark Monitoring Documentation

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.0.0, 3.0.1
• Fix Version/s: 3.0.2, 3.1.0
• Component/s: Documentation
• Labels: bug documentation starter
• Assignee: Pradyumn Agrawal
• Reporter: Pradyumn Agrawal
• Created: 30/Dec/20 10:46
• Updated: 31/Dec/20 01:28
• Resolved: 31/Dec/20 01:28

Description

I recently integrated the spark executor metrics documented in Spark Monitoring into our Graphite based monitoring system. I see

Executor and latest one too

namespace=CodeGenerator

• note:: these metrics are conditional to a configuration parameter: spark.metrics.staticSources.enabled (default is true)
• compilationTime (histogram)
• generatedClassSize (histogram)
• generatedMethodSize (histogram)
• hiveClientCalls.count - irrelevant and metric not present in metric registery too
• sourceCodeSize (histogram)

It is just a minor bug on documentation side. I am raising a PR for this.

Issue Links

• links to: [Github] Pull Request #30976 (coderbond007)
• links to: [Github] Pull Request #30976 (coderbond007)