Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-10611

Configuration object thread safety issue in NewHadoopRDD

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 1.4.1
    • 1.5.1, 1.6.0
    • Spark Core
    • None

    Description

      SPARK-2546 fixed the issue for HadoopRDD, but the fix is not ported over to NewHadoopRDD. The screenshot of the stacktrace is attached, and it's very similar to what's reported in SPARK-2546.

      Attachments

        Issue Links

        is related to

        Bug - A problem which impairs or prevents the functions of the product. SPARK-2546 Configuration object thread safety issue

        • Critical - Crashes, loss of data, severe memory leak.
        • Resolved
        links to

        Pull request #8763 [Github] Pull Request #8763 (mingyukim)

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            mkim Mingyu Kim
            mkim Mingyu Kim
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment