Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-4544

Spark JVM Metrics doesn't have context.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 1.1.0
    • None
    • Spark Core
    • None

    Description

      If we enable jvm metrics for executor, master, worker, driver instances, we don't have context where they are coming from ?

      This can be a issue if we are collecting all the metrics from different instances are storing into common datastore.

      This is mainly running Spark on Yarn but i believe Spark standalone has also this problems.

      It would be good if we attach some context for jvm metrics.

      Attachments

        Issue Links

          duplicates

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-5847 Allow for configuring MetricsSystem's use of app ID to namespace all metrics

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              sree2k Sreepathi Prasanna
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: