Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-36664

Log time spent waiting for cluster resources

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: In Progress
    • Major
    • Resolution: Unresolved
    • 3.2.0, 3.3.0
    • None
    • Spark Core
    • None

    Description

      To provide better visibility into why jobs might be running slow it would be useful to log when we are waiting for resources and how long we are waiting for resources so if there is an underlying cluster issue the user can be aware.

      Attachments

        Activity

          People

            Unassigned Unassigned
            holden Holden Karau
            Holden Karau Holden Karau
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated: