Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5597 YARN Federation improvements
  3. YARN-6704

Add support for work preserving NM restart when FederationInterceptor is enabled in AMRMProxyService

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersConvert to IssueMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.1.0, 2.10.0, 2.9.1
    • None
    • None
    • Reviewed

    Description

      YARN-1336 added the ability to restart NM without loosing any running containers. AMRMProxy restart is added in YARN-6127. In a Federated YARN environment, there's additional state in the FederationInterceptor to allow for spanning across multiple sub-clusters, so we need to enhance FederationInterceptor to support work-preserving restart.

      Attachments

        1. YARN-6704-YARN-2915.v1.patch
          47 kB
          Botong Huang
        2. YARN-6704-YARN-2915.v2.patch
          58 kB
          Botong Huang
        3. YARN-6704.v3.patch
          67 kB
          Botong Huang
        4. YARN-6704.v4.patch
          69 kB
          Botong Huang
        5. YARN-6704.v5.patch
          24 kB
          Botong Huang
        6. YARN-6704.v6.patch
          33 kB
          Botong Huang
        7. YARN-6704.v7.patch
          33 kB
          Botong Huang
        8. YARN-6704.v8.patch
          33 kB
          Botong Huang
        9. YARN-6704.v9.patch
          33 kB
          Botong Huang

        Issue Links

        depends upon

        Sub-task - The sub-task of the issue YARN-6128 Add support for AMRMProxy HA

        • Major - Major loss of function.
        • Resolved
        is blocked by

        Sub-task - The sub-task of the issue YARN-6127 Add support for work preserving NM restart when AMRMProxy is enabled

        • Major - Major loss of function.
        • Resolved
        requires

        New Feature - A new feature of the product, which has yet to be developed. YARN-1336 [Umbrella] Work-preserving nodemanager restart

        • Major - Major loss of function.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            botong Botong Huang Assign to me
            botong Botong Huang
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment