[SPARK-5337] respect spark.task.cpus when launch executors

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Auto Closed
• Affects Version/s: 1.0.0
• Component/s: Scheduler, Spark Core
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: Tao Wang (Inactive)
• Created: 20/Jan/15 17:12
• Updated: 17/May/20 17:48
• Resolved: 06/Jun/19 13:57

Description

In standalone mode, we did not respect spark.task.cpus when luanch executors. Some executors would have not enough cores to launch a single task.

Issue Links

• relates to: SPARK-5336 spark.executor.cores must not be less than spark.task.cpus
• links to: [Github] Pull Request #4129 (CodingCat)
• links to: [Github] Pull Request #8610 (CodingCat)