Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-9103 Tracking spark's memory usage
  3. SPARK-9111

Dumping the memory info when an executor dies abnormally

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Incomplete
    • None
    • None
    • Spark Core

    Description

      When an executor is not normally finished, we shall give out it's memory dump info right before the JVM shutting down. So that if the executor is killed because of OOM, we can easily checkout how is the memory used and which part cause the OOM.

      Attachments

        Activity

          People

            Unassigned Unassigned
            liyezhang556520 Zhang, Liye
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: