Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-44741

Support regex-based MetricFilter in StatsdSink

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 4.0.0
    • 4.0.0
    • Spark Core
    • Important

    Description

      Spark statsd metrics sink in the current state does not support metrics filtering option. 

      Though this option is available in the reporters it is not exposed in the statsD sink. An example of this can be looked at https://github.com/apache/spark/blob/be9ffb37585fe421705ceaa52fe49b89c50703a3/core/src/main/scala/org/apache/spark/metrics/sink/GraphiteSink.scala#L76

       

      This is a critical option to have when teams does not want all the metrics that are exposed by spark in the metrics monitoring platforms and switch to detailed metrics as and when needed. 

       

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            ramkrish1489 rameshkrishnan muthusamy
            ramkrish1489 rameshkrishnan muthusamy
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment