Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-9036

SparkListenerExecutorMetricsUpdate messages not included in JsonProtocol

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 1.4.0, 1.4.1
    • 1.5.0
    • Spark Core
    • None

    Description

      The JsonProtocol added in SPARK-3454 doesn't include code for ser/de of SparkListenerExecutorMetricsUpdate messages.

      The comment notes that they are "not used", which presumably refers to the fact that the EventLoggingListener doesn't write these events.

      However, individual listeners can and should make that determination for themselves; I have recently written custom listeners that would like to consume metrics-update messages as JSON, so it would be nice to round out the JsonProtocol implementation by supporting them.

      Attachments

        Activity

          People

            rdub Ryan Williams
            rdub Ryan Williams
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: