[SPARK-37985] Fix flaky test SPARK-37578

• Type: Task
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.3.0
• Component/s: SQL, Tests
• Assignee: angerszhu
• Reporter: angerszhu
• Created: 22/Jan/22 07:09
• Updated: 12/Dec/22 18:11
• Resolved: 23/Jan/22 23:54

Description

2022-01-22T01:58:29.8444339Z [info] - SPARK-36030: Report metrics from Datasource v2 write (90 milliseconds)
2022-01-22T01:58:29.9427049Z [info] - SPARK-37578: Update output metrics from Datasource v2 *** FAILED *** (65 milliseconds)
2022-01-22T01:58:29.9428038Z [info]  123 did not equal 246 (SQLAppStatusListenerSuite.scala:936)
2022-01-22T01:58:29.9428531Z [info]  org.scalatest.exceptions.TestFailedException:
2022-01-22T01:58:29.9429101Z [info]  at org.scalatest.Assertions.newAssertionFailedException(Assertions.scala:472)
2022-01-22T01:58:29.9429717Z [info]  at org.scalatest.Assertions.newAssertionFailedException$(Assertions.scala:471)
2022-01-22T01:58:29.9430298Z [info]  at org.scalatest.Assertions$.newAssertionFailedException(Assertions.scala:1231)
2022-01-22T01:58:29.9430840Z [info]  at org.scalatest.Assertions$AssertionsHelper.macroAssert(Assertions.scala:1295)
2022-01-22T01:58:29.9431512Z [info]  at org.apache.spark.sql.execution.ui.SQLAppStatusListenerSuite.$anonfun$new$61(SQLAppStatusListenerSuite.scala:936)
2022-01-22T01:58:29.9432305Z [info]  at org.apache.spark.sql.execution.ui.SQLAppStatusListenerSuite.$anonfun$new$61$adapted(SQLAppStatusListenerSuite.scala:905)
2022-01-22T01:58:29.9432982Z [info]  at org.apache.spark.sql.test.SQLTestUtils.$anonfun$withTempDir$1(SQLTestUtils.scala:79)
2022-01-22T01:58:29.9433695Z [info]  at org.apache.spark.sql.test.SQLTestUtils.$anonfun$withTempDir$1$adapted(SQLTestUtils.scala:78)
2022-01-22T01:58:29.9434276Z [info]  at org.apache.spark.SparkFunSuite.withTempDir(SparkFunSuite.scala:221)
2022-01-22T01:58:29.9435040Z [info]  at org.apache.spark.sql.execution.ui.SQLAppStatusListenerSuite.org$apache$spark$sql$test$SQLTestUtils$$super$withTempDir(SQLAppStatusListenerSuite.scala:63)
2022-01-22T01:58:29.9435764Z [info]  at org.apache.spark.sql.test.SQLTestUtils.withTempDir(SQLTestUtils.scala:78)
2022-01-22T01:58:29.9436354Z [info]  at org.apache.spark.sql.test.SQLTestUtils.withTempDir$(SQLTestUtils.scala:77)
2022-01-22T01:58:29.9437063Z [info]  at org.apache.spark.sql.execution.ui.SQLAppStatusListenerSuite.withTempDir(SQLAppStatusListenerSuite.scala:63)
2022-01-22T01:58:29.9437851Z [info]  at org.apache.spark.sql.execution.ui.SQLAppStatusListenerSuite.$anonfun$new$60(SQLAppStatusListenerSuite.scala:905)

Issue Links

• links to: [Github] Pull Request #35277 (AngersZhuuuu)