Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-5336

spark.executor.cores must not be less than spark.task.cpus

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.3.0
    • YARN
    • None

    Description

      If user set spark.executor.cores to be less than spark.task.cpus, task scheduler will fall in infinite loop, we should throw an exception.in that case.

      In standalone and mesos mode, we should respect spark.task.cpus too, and I will file another JIRA to solve that.

      Attachments

        Issue Links

          Activity

            People

              WangTaoTheTonic Tao Wang (Inactive)
              WangTaoTheTonic Tao Wang (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: