Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.0.0
    • Component/s: Spark
    • Labels:
      None
    • Target Version/s:

      Description

      Looks like there is a race condition in TestSparkClient#runTest. The test creates a RemoteDriver in memory, which creates a JavaSparkContext. A new JavaSparkContext is created for each test that is run. There is a race condition where the RemoteDriver isn't given enough time to shutdown, so when the next test starts running it creates another JavaSparkContext which causes an exception like org.apache.spark.SparkException: Only one SparkContext may be running in this JVM (see SPARK-2243).

        Attachments

        1. HIVE-18214.2.patch
          32 kB
          Sahil Takiar
        2. HIVE-18214.1.patch
          3 kB
          Sahil Takiar

          Issue Links

            Activity

              People

              • Assignee:
                stakiar Sahil Takiar
                Reporter:
                stakiar Sahil Takiar
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: