[SPARK-5847] Allow for configuring MetricsSystem's use of app ID to namespace all metrics

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.2.1
• Fix Version/s: 2.1.0
• Component/s: Spark Core
• Assignee: Mark Grover
• Reporter: Ryan Williams
• Created: 16/Feb/15 21:41
• Updated: 11/Jul/17 22:31
• Resolved: 27/Jul/16 17:13

Description

MetricsSystem currently prepends the app ID to all metrics.

When reading Spark metrics in Graphite, I've found this to not always be desirable. Graphite is designed to track a mostly-unchanging set of metrics over time; it allocates large zeroed-out files for each metric it sees, and by default rate-limits itself from creating many of these.

App-ID namespacing means that Graphite is allocating disk-space for every "metric" for every job it sees, when in reality some metrics may correspond to others across jobs (e.g. driver JVM stats).

Some common Spark usage flows would be better modeled by e.g. namespacing metrics by spark.app.name, so that successive runs of a given job would share "metrics", from a storage perspective as well as allowing for monitoring aspects of a job's performance over time / many runs.

There's not likely a one-size-fits-all solution here, so I'd propose allowing the metrics config file to allow users to specify whether they'd like metrics namespaced by spark.app.id, spark.app.name, or some other config param.

Issue Links

• is duplicated by: SPARK-4544 Spark JVM Metrics doesn't have context.
• is duplicated by: SPARK-10610 Using AppName instead of AppId in the name of all metrics
• links to: [Github] Pull Request #4632 (ryan-williams)
• links to: [Github] Pull Request #14270 (markgrover)
• links to: [Github] Pull Request #15023 (AnthonyTruchet)