Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-2845

Add timestamp to BlockManager events

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 1.1.0
    • 1.2.0
    • Spark Core
    • None

    Description

      BlockManager events in SparkListener.scala do not have a timestamp; while not necessary for rendering the Spark UI, the extra information might be interesting for other tools that use the event data.

      Note that the same applies to lots of other events; it would be nice, at some point, to have all of them have a timestamp assigned at the point of creation of the event, so that network traffic / event queueing in the driver do not affect that information. But right now, I'm more interested in those particular events.

      Attachments

        Activity

          People

            vanzin Marcelo Masiero Vanzin
            vanzin Marcelo Masiero Vanzin
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: