Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersConvert to IssueMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0
    • Spark
    • None

    Description

      Looks like there is a race condition in TestSparkClient#runTest. The test creates a RemoteDriver in memory, which creates a JavaSparkContext. A new JavaSparkContext is created for each test that is run. There is a race condition where the RemoteDriver isn't given enough time to shutdown, so when the next test starts running it creates another JavaSparkContext which causes an exception like org.apache.spark.SparkException: Only one SparkContext may be running in this JVM (see SPARK-2243).

      Attachments

        1. HIVE-18214.2.patch
          32 kB
          Sahil Takiar
        2. HIVE-18214.1.patch
          3 kB
          Sahil Takiar

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            stakiar Sahil Takiar Assign to me
            stakiar Sahil Takiar
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment