[SPARK-36281] Re-enable the test of external listerners in SparkSQLEnvSuite

• Type: Test
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 3.0.3
• Component/s: SQL
• Assignee: Unassigned
• Reporter: L. C. Hsieh
• Created: 25/Jul/21 06:28
• Updated: 26/Jul/21 19:59
• Resolved: 26/Jul/21 19:59

Description

While we're trying to recover GA in branch 3.0 (https://github.com/apache/spark/pull/33502), org.apache.spark.sql.hive.thriftserver.SparkSQLEnvSuite continues to fail in GA:

 

[info] - SPARK-29604 external listeners should be initialized with Spark classloader *** FAILED *** (34 seconds, 465 milliseconds)
[info] scala.Predef.refArrayOps[org.apache.spark.sql.util.QueryExecutionListener](session.get.listenerManager.listListeners()).exists(((x$1: org.apache.spark.sql.util.QueryExecutionListener) => x$1.isInstanceOf[test.custom.listener.DummyQueryExecutionListener])) was false (SparkSQLEnvSuite.scala:57)

 

It looks not a memory issue. I also ran it locally and it passed. Not sure why GA is special for the test.

 

Ignored the test for now to recover GA. We need to investigate why the test fails and recover it.