[SPARK-10825] Flaky test: StandaloneDynamicAllocationSuite

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 1.5.2, 1.6.0
• Component/s: Spark Core, Tests
• Labels: flaky-test
• Target Version/s: 1.5.2, 1.6.0
• Assignee: Shixiong Zhu
• Reporter: Shixiong Zhu
• Created: 25/Sep/15 03:03
• Updated: 30/Sep/15 02:57
• Resolved: 29/Sep/15 18:54

Description

There are some race conditions in StandaloneDynamicAllocationSuite.
1. It should not assume master and workers start in order.
2. It should not assume master and workers get ready at once
3. It should not assume the application is already registered with master after creating SparkContext.
4. It should not access Master.app which is not thread safe.

Issue Links

• is duplicated by: SPARK-10800 Flaky test: org.apache.spark.deploy.StandaloneDynamicAllocationSuite
• links to: [Github] Pull Request #8914 (zsxwing)