Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-20863

Add metrics/instrumentation to LiveListenerBus

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.2.0
    • 2.3.0
    • Spark Core
    • None

    Description

      I think that we should add Coda Hale metrics to the LiveListenerBus in order to count the number of queued, processed, and dropped events, as well as a timer tracking per-event processing times.

      Attachments

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-18838 High latency of event processing for large jobs

          • Major - Major loss of function.
          • Resolved
          links to

          Pull request #18083 [Github] Pull Request #18083 (JoshRosen)

          Activity

            People

              joshrosen Josh Rosen
              joshrosen Josh Rosen
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: