Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-28584

Flaky test: org.apache.spark.scheduler.TaskSchedulerImplSuite

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 3.0.0
    • Fix Version/s: 3.0.0
    • Component/s: Tests
    • Labels:
      None

      Description

      This is another of those tests that don't seem to fail in PRs here, but fail more often than we'd like in our build machines. In this case it fails in several different ways, e.g.:

      org.scalatest.exceptions.TestFailedException: Map(org.apache.spark.scheduler.TaskSetManager$$EnhancerByMockitoWithCGLIB$$c676cf51@412f9d43 -> 1550579875956) did not contain key org.apache.spark.scheduler.TaskSetManager$$EnhancerByMockitoWithCGLIB$$c676cf51@1945f15f
            at org.scalatest.Assertions$class.newAssertionFailedException(Assertions.scala:528)
            at org.scalatest.FunSuite.newAssertionFailedException(FunSuite.scala:1560)
            at org.scalatest.Assertions$AssertionsHelper.macroAssert(Assertions.scala:501)
            at org.apache.spark.scheduler.TaskSchedulerImplSuite$$anonfun$21.apply(TaskSchedulerImplSuite.scala:635)
            at org.apache.spark.scheduler.TaskSchedulerImplSuite$$anonfun$21.apply(TaskSchedulerImplSuite.scala:591)
      

      Or:

      The code passed to eventually never returned normally. Attempted 40 times over 503.217543 milliseconds. Last failure message: tsm.isZombie was false.
      
      Error message:
      org.scalatest.exceptions.TestFailedDueToTimeoutException: The code passed to eventually never returned normally. Attempted 40 times over 503.217543 milliseconds. Last failure message: tsm.isZombie was false.
            at org.scalatest.concurrent.Eventually$class.tryTryAgain$1(Eventually.scala:421)
            at org.scalatest.concurrent.Eventually$class.eventually(Eventually.scala:439)
            at org.apache.spark.scheduler.TaskSchedulerImplSuite.eventually(TaskSchedulerImplSuite.scala:44)
            at org.scalatest.concurrent.Eventually$class.eventually(Eventually.scala:337)
            at org.apache.spark.scheduler.TaskSchedulerImplSuite.eventually(TaskSchedulerImplSuite.scala:44)
            at org.apache.spark.scheduler.TaskSchedulerImplSuite$$anonfun$18.apply(TaskSchedulerImplSuite.scala:543)
            at org.apache.spark.scheduler.TaskSchedulerImplSuite$$anonfun$18.apply(TaskSchedulerImplSuite.scala:511)
      

      There's a race condition in the test that can cause these different failures.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                vanzin Marcelo Masiero Vanzin
                Reporter:
                vanzin Marcelo Masiero Vanzin
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: