[SPARK-30942] Fix the warning for requiring cores to be limiting resource

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.1.0
• Component/s: Spark Core
• Assignee: Thomas Graves
• Reporter: Thomas Graves
• Created: 24/Feb/20 20:06
• Updated: 26/Feb/20 02:50
• Resolved: 25/Feb/20 16:57

Description

https://github.com/apache/spark/pull/27615

Changed a warning to only show when dynamic allocation enabled. In reality other things rely on the "slots", so the warning should always be present if custom resources are specified.

Issue Links

• relates to: SPARK-29148 Modify dynamic allocation manager for stage level scheduling
• links to: GitHub Pull Request #27686