Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4233 YARN Timeline Service plugin: ATS v1.5
  3. YARN-4987

Read cache concurrency issue between read and evict in EntityGroupFS timeline store

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • 2.8.0, 3.0.0-alpha1
    • None
    • None
    • Reviewed

    Description

      To handle concurrency issues, key value based timeline storage may return null on reads that are concurrent to service stop. This is actually caused by a concurrency issue between cache reads and evicts. Specifically, if the storage is being read when it gets evicted, the storage may turn into null. EntityGroupFS timeline store needs to handle this case gracefully.

      Attachments

        1. YARN-4987-trunk.001.patch
          18 kB
          Li Lu
        2. YARN-4987-trunk.002.patch
          37 kB
          Li Lu
        3. YARN-4987-trunk.003.patch
          37 kB
          Li Lu
        4. YARN-4987-trunk.004.patch
          38 kB
          Li Lu

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            gtcarrera9 Li Lu
            gtcarrera9 Li Lu
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment