[SPARK-33173] Fix Flaky Test "SPARK-33088: executor failed tasks trigger plugin calls"

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.1.0
• Component/s: Spark Core, Tests
• Assignee: Dongjoon Hyun
• Reporter: Dongjoon Hyun
• Created: 17/Oct/20 00:36
• Updated: 17/Dec/20 13:40
• Resolved: 17/Oct/20 04:23

Description

• https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-master-test-maven-hadoop-3.2-hive-2.3-jdk-11/lastCompletedBuild/testReport/org.apache.spark.internal.plugin/PluginContainerSuite/SPARK_33088__executor_failed_tasks_trigger_plugin_calls/

sbt.ForkMain$ForkError: org.scalatest.exceptions.TestFailedException: 1 did not equal 2
	at org.scalatest.Assertions.newAssertionFailedException(Assertions.scala:472)
	at org.scalatest.Assertions.newAssertionFailedException$(Assertions.scala:471)
	at org.scalatest.Assertions$.newAssertionFailedException(Assertions.scala:1231)
	at org.scalatest.Assertions$AssertionsHelper.macroAssert(Assertions.scala:1295)
	at org.apache.spark.internal.plugin.PluginContainerSuite.$anonfun$new$8(PluginContainerSuite.scala:161)

Issue Links

• is caused by: SPARK-33088 Enhance ExecutorPlugin API to include methods for task start and end events
• links to: [Github] Pull Request #30072 (dongjoon-hyun)
• links to: [Github] Pull Request #30823 (Ngone51)
• links to: [Github] Pull Request #30823 (Ngone51)