[SPARK-25792] Flaky test: BarrierStageOnSubmittedSuite."submit a barrier ResultStage that requires more slots than current total under local-cluster mode"

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Affects Version/s: 2.4.0
• Component/s: Spark Core, Tests
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: Dongjoon Hyun
• Created: 21/Oct/18 00:54
• Updated: 25/May/21 01:55
• Resolved: 25/May/21 01:41

Description

[info] - submit a barrier ResultStage that requires more slots than current total under local-cluster mode *** FAILED *** (5 seconds, 303 milliseconds)
[info]   Expected exception org.apache.spark.SparkException to be thrown, but java.util.concurrent.TimeoutException was thrown (BarrierStageOnSubmittedSuite.scala:54)
[info]   org.scalatest.exceptions.TestFailedException:
[info]   at org.scalatest.Assertions$class.newAssertionFailedException(Assertions.scala:528)
[info]   at org.scalatest.FunSuite.newAssertionFailedException(FunSuite.scala:1560)
[info]   at org.scalatest.Assertions$class.intercept(Assertions.scala:812)
[info]   at org.scalatest.FunSuite.intercept(FunSuite.scala:1560)
[info]   at org.apache.spark.BarrierStageOnSubmittedSuite.org$apache$spark$BarrierStageOnSubmittedSuite$$testSubmitJob(BarrierStageOnSubmittedSuite.scala:54)
[info]   at org.apache.spark.BarrierStageOnSubmittedSuite$$anonfun$18.apply$mcV$sp(BarrierStageOnSubmittedSuite.scala:240)
[info]   at org.apache.spark.BarrierStageOnSubmittedSuite$$anonfun$18.apply(BarrierStageOnSubmittedSuite.scala:227)
[info]   at org.apache.spark.BarrierStageOnSubmittedSuite$$anonfun$18.apply(BarrierStageOnSubmittedSuite.scala:227)

• https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-branch-2.4-test-sbt-hadoop-2.7/153/testReport
• https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-branch-2.4-test-sbt-hadoop-2.7/151/testReport
• https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-branch-2.4-test-sbt-hadoop-2.7/144/testReport
• https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-branch-2.4-test-sbt-hadoop-2.7/133/testReport
• https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-branch-2.4-test-sbt-hadoop-2.7/132/testReport
• https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-branch-2.4-test-sbt-hadoop-2.7/125/testReport
• https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-branch-2.4-test-sbt-hadoop-2.7/123/testReport

Issue Links

• blocks: SPARK-24139 Fix Flaky Tests