[HUDI-1211] Test failures w/ some index tests (TestHoodieIndex)

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 0.8.0
• Component/s: Testing, tests-ci
• Labels: pull-request-available sev:high
• Assignee: Raymond Xu
• Reporter: sivabalan narayanan
• Created: 21/Aug/20 19:47
• Updated: 27/Mar/22 15:00
• Resolved: 28/Jun/21 01:43

Description

When I was running tests for all of index package, tests fails with connection issue following which all tests start to fail. Once the connection issue starts, I see below errors for successive tests.

 

Command  : "mvn '-Dtest=org.apache.hudi.index.**' -DfailIfNoTests=false test"

<<< ERROR!

org.apache.spark.SparkException:

Only one SparkContext may be running in this JVM (see SPARK-2243). To ignore this error, set spark.driver.allowMultipleContexts = true. The currently running SparkContext was created at:

org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)

org.apache.hudi.testutils.FunctionalTestHarness.runBeforeEach(FunctionalTestHarness.java:132)

sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

 

Here is the full stack trace: https://gist.github.com/nsivabalan/0643202bf1af2d85cdc0d35dd6a68d36

Issue Links

• links to: GitHub Pull Request #2697