[SPARK-1600] flaky "recovery with file input stream" test in streaming.CheckpointSuite

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.9.0, 0.9.1, 1.0.0, 1.2.0
• Fix Version/s: 1.2.2, 1.3.0
• Component/s: DStreams
• Labels: flaky-test
• Target Version/s: 1.2.2, 1.3.0
• Assignee: Josh Rosen
• Reporter: Nan Zhu
• Created: 23/Apr/14 23:29
• Updated: 16/Feb/15 23:42
• Resolved: 06/Jan/15 08:35

Description

the case "recovery with file input stream.recovery with file input stream " sometimes fails when the Jenkins is very busy with an unrelated change

I have met it for 3 times, I also saw it in other places,

the latest example is in

https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14397/

where the modification is just in YARN related files....

I once reported in dev mail list: http://apache-spark-developers-list.1001551.n3.nabble.com/a-weird-test-case-in-Streaming-td6116.html

Issue Links

• links to: [Github] Pull Request #3801 (JoshRosen)
• links to: [Github] Pull Request #4633 (JoshRosen)