Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-25683

Updated the log for the firstTime event Drop occurs.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Trivial
    • Resolution: Fixed
    • 2.3.2
    • 3.0.0
    • Spark Core
    • None

    Description

      18/10/08 17:51:40 ERROR AsyncEventQueue: Dropping event from queue eventLog. This likely means one of the listeners is too slow and cannot keep up with the rate at which tasks are being started by the scheduler.
      18/10/08 17:51:40 WARN AsyncEventQueue: Dropped 1 events from eventLog since Wed Dec 31 16:00:00 PST 1969.
      18/10/08 17:52:40 WARN AsyncEventQueue: Dropped 144853 events from eventLog since Mon Oct 08 17:51:40 PDT 2018.
      

      Here it shows the time as Wed Dec 31 16:00:00 PST 1969 for the first log,
      log should updated as "... since start of the application" if 'lastReportTimestamp' == 0.
      when the first dropEvent occurs.

      Attachments

        Activity

          People

            shivusondur@gmail.com Shivu Sondur
            devaraj Devaraj Kavali
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: