Details
-
Improvement
-
Status: Resolved
-
Minor
-
Resolution: Fixed
-
4.0.0
-
Important
Description
Spark statsd metrics sink in the current state does not support metrics filtering option.
Though this option is available in the reporters it is not exposed in the statsD sink. An example of this can be looked at https://github.com/apache/spark/blob/be9ffb37585fe421705ceaa52fe49b89c50703a3/core/src/main/scala/org/apache/spark/metrics/sink/GraphiteSink.scala#L76
This is a critical option to have when teams does not want all the metrics that are exposed by spark in the metrics monitoring platforms and switch to detailed metrics as and when needed.