Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1336 [Umbrella] Work-preserving nodemanager restart
  3. YARN-1338

Recover localized resource cache state upon nodemanager restart

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotVotersWatch issueWatchersConvert to IssueMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.3.0
    • Fix Version/s: 2.5.0
    • Component/s: nodemanager
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Today when node manager restarts we clean up all the distributed cache files from disk. This is definitely not ideal from 2 aspects.

      • For work preserving restart we definitely want them as running containers are using them
      • For even non work preserving restart this will be useful in the sense that we don't have to download them again if needed by future tasks.

        Attachments

        1. YARN-1338v6.patch
          165 kB
          Jason Darrell Lowe
        2. YARN-1338v5.patch
          157 kB
          Jason Darrell Lowe
        3. YARN-1338v4.patch
          156 kB
          Jason Darrell Lowe
        4. YARN-1338v3-and-YARN-1987.patch
          163 kB
          Jason Darrell Lowe
        5. YARN-1338v2.patch
          156 kB
          Jason Darrell Lowe
        6. YARN-1338.patch
          156 kB
          Jason Darrell Lowe

        Issue Links

          Activity

          $i18n.getText('security.level.explanation', $currentSelection) Viewable by All Users
          Cancel

            People

            • Assignee:
              jlowe Jason Darrell Lowe Assign to me
              Reporter:
              jlowe Jason Darrell Lowe

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment