Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-27228

Spark long delay on close, possible problem with killing executors

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Reopened
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.3.0
    • Fix Version/s: None
    • Component/s: Block Manager, Spark Core
    • Labels:
      None

      Description

      When using dynamic allocations after all jobs finishes spark delays for several minutes before finally finishes. Log suggest that executors are not cleared up properly.

      See the attachment for log

       

        Attachments

        1. log.html
          57 kB
          Lukas Waldmann

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              luky Lukas Waldmann
            • Votes:
              1 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated: