Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-36281

Re-enable the test of external listerners in SparkSQLEnvSuite

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Test
    • Status: Resolved
    • Priority: Major
    • Resolution: Invalid
    • Affects Version/s: 3.0.3
    • Fix Version/s: None
    • Component/s: SQL
    • Labels:
      None

      Description

      While we're trying to recover GA in branch 3.0 (https://github.com/apache/spark/pull/33502), org.apache.spark.sql.hive.thriftserver.SparkSQLEnvSuite continues to fail in GA:

       

      [info] - SPARK-29604 external listeners should be initialized with Spark classloader *** FAILED *** (34 seconds, 465 milliseconds)
      [info] scala.Predef.refArrayOps[org.apache.spark.sql.util.QueryExecutionListener](session.get.listenerManager.listListeners()).exists(((x$1: org.apache.spark.sql.util.QueryExecutionListener) => x$1.isInstanceOf[test.custom.listener.DummyQueryExecutionListener])) was false (SparkSQLEnvSuite.scala:57)

       

      It looks not a memory issue. I also ran it locally and it passed. Not sure why GA is special for the test.

       

      Ignored the test for now to recover GA. We need to investigate why the test fails and recover it.

       

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              viirya L. C. Hsieh

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment