[SPARK-13693] Flaky test: o.a.s.streaming.MapWithStateSuite

• Type: Test
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Component/s: Tests
• Assignee: Josh Rosen
• Reporter: Shixiong Zhu
• Created: 04/Mar/16 23:48
• Updated: 28/Apr/16 12:25
• Resolved: 28/Apr/16 12:25

Description

Fixed the following flaky test:

https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-sbt-hadoop-2.7/256/testReport/junit/org.apache.spark.streaming/MapWithStateSuite/_It_is_not_a_test_/

sbt.ForkMain$ForkError: java.io.IOException: Failed to delete: /home/jenkins/workspace/spark-master-test-sbt-hadoop-2.7/streaming/checkpoint/spark-e97794a8-b940-4b21-8685-bf1221f9444d
	at org.apache.spark.util.Utils$.deleteRecursively(Utils.scala:934)
	at org.apache.spark.streaming.MapWithStateSuite$$anonfun$2.apply$mcV$sp(MapWithStateSuite.scala:47)
	at org.apache.spark.streaming.MapWithStateSuite$$anonfun$2.apply(MapWithStateSuite.scala:45)
	at org.apache.spark.streaming.MapWithStateSuite$$anonfun$2.apply(MapWithStateSuite.scala:45)

Issue Links

• is related to: SPARK-14930 Race condition in CheckpointWriter.stop()
• links to: [Github] Pull Request #11531 (zsxwing)
• links to: [Github] Pull Request #12712 (JoshRosen)