Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-12248

Make Spark Coarse Mesos Scheduler obey limits on memory/cpu ratios

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Not A Problem
    • None
    • 2.0.0
    • Mesos
    • None

    Description

      It is possible to have spark apps that work best with either more memory or more CPU.

      In a multi-tenant environment (such as Mesos) it can be very beneficial to be able to limit the Coarse scheduler to guarantee an executor doesn't subscribe to too many cpus or too much memory.

      This ask is to add functionality to the Coarse Mesos Scheduler to have basic limits to the ratio of memory to cpu, which default to the current behavior of soaking up whatever resources it can.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              drcrallen Charles R Allen
              Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: