Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-22256

Introduce spark.mesos.driver.memoryOverhead

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: In Progress
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 2.2.0, 2.3.0
    • Fix Version/s: None
    • Component/s: Mesos
    • Labels:

      Description

      When running spark driver in a container such as when using the Mesos dispatcher service, we need to apply the same rules as for executors in order to avoid the JVM going over the allotted limit and then killed.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              clehene Cosmin Lehene
            • Votes:
              1 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:

                Time Tracking

                Estimated:
                Original Estimate - 24h
                24h
                Remaining:
                Remaining Estimate - 24h
                24h
                Logged:
                Time Spent - Not Specified
                Not Specified