Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-33942

Wrong metrics information in Spark Monitoring Documentation

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

      Description

      I recently integrated the spark executor metrics documented inĀ Spark Monitoring into our Graphite based monitoring system. I see

      Executor and latest one too

      namespace=CodeGenerator

      • note:: these metrics are conditional to a configuration parameter: spark.metrics.staticSources.enabled (default is true)
      • compilationTime (histogram)
      • generatedClassSize (histogram)
      • generatedMethodSize (histogram)
      • hiveClientCalls.count - irrelevant and metric not present in metric registery too
      • sourceCodeSize (histogram)

      It is just a minor bug on documentation side. I am raising a PR for this.

        Attachments

          Activity

            People

            • Assignee:
              coderbond007 Pradyumn Agrawal
              Reporter:
              coderbond007 Pradyumn Agrawal

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment