[SPARK-9933] Test the new receiver scheduling

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Component/s: DStreams
• Target Version/s: 1.5.0
• Assignee: Shixiong Zhu
• Reporter: Shixiong Zhu
• Created: 13/Aug/15 07:48
• Updated: 04/Sep/15 02:01
• Resolved: 04/Sep/15 02:01

Description

1. Test if receivers are load balanced in the beginning by running the app many times and verifying whether they are load balanced. Maybe tweak the minRegistered.
2. Implement and test a timeout after which if all the receivers have not started, it should fail.
3. Test whether receivers are restarted after any failure, independent of the max task attempts.

Issue Links

• relates to: SPARK-10137 Avoid to restart receivers if scheduleReceivers returns balanced results