[SPARK-2475] Check whether #cores > #receivers in local mode

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Auto Closed
• Component/s: DStreams
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: Tathagata Das
• Created: 14/Jul/14 19:57
• Updated: 06/Jun/19 13:57
• Resolved: 06/Jun/19 13:57

Description

When the number of slots in local mode is not more than the number of receivers, then the system should throw an error. Otherwise the system just keeps waiting for resources to process the received data.

Issue Links

• relates to: SPARK-4381 User should get warned when set spark.master with local in Spark Streaming
• links to: [Github] Pull Request #5212 (ArcherShao)