Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-21078

JobHistory applications synchronized is invalid

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 2.1.1
    • None
    • Spark Core
    • None

    Description

      FsHistoryProvider has some threads to mergeApplicationListing.
      mergeApplicationListing function has code like this:
      applications.synchronized {
      ...
      applications = mergedApps
      ...
      }

      applications object is changed, so the synchronized do not work.

      Attachments

        Issue Links

          Is contained by

          Sub-task - The sub-task of the issue SPARK-20642 Use key-value store to keep History Server application listing

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. SPARK-21223 Thread-safety issue in FsHistoryProvider

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          links to

          Pull request #18497 [Github] Pull Request #18497 (srowen)

          Activity

            People

              Unassigned Unassigned
              ffbin fangfengbin
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: