Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1489 [Umbrella] Work-preserving ApplicationMaster restart
  3. YARN-1041

Protocol changes for RM to bind and notify a restarted AM of existing containers

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.0.0-alpha1
    • 2.4.0
    • resourcemanager
    • None
    • Reviewed

    Description

      For long lived containers we don't want the AM to be a SPOF.

      When the RM restarts a (failed) AM, it should be given the list of containers it had already been allocated. the AM should then be able to contact the NMs to get details on them. NMs would also need to do any binding of the containers needed to handle a moved/restarted AM.

      Attachments

        1. YARN-1041.1.patch
          21 kB
          Jian He
        2. YARN-1041.2.patch
          29 kB
          Jian He
        3. YARN-1041.3.patch
          29 kB
          Jian He
        4. YARN-1041.4.patch
          29 kB
          Jian He
        5. YARN-1041.5.patch
          32 kB
          Jian He
        6. YARN-1041.6.patch
          32 kB
          Jian He
        7. YARN-1041.7.patch
          32 kB
          Jian He

        Issue Links

        blocks

        New Feature - A new feature of the product, which has yet to be developed. YARN-896 Roll up for long-lived services in YARN

        • Major - Major loss of function.
        • Open
        breaks

        Test - A new unit, integration or system test. MAPREDUCE-5726 TestRMContainerAllocator#testCompletedTasksRecalculateSchedule fails

        • Major - Major loss of function.
        • Resolved
        is related to

        Sub-task - The sub-task of the issue YARN-1588 Rebind NM tokens for previous attempt's running containers to the new attempt

        • Major - Major loss of function.
        • Closed

        Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-5743 TestRMContainerAllocator is failing

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            jianhe Jian He
            stevel@apache.org Steve Loughran
            Votes:
            0 Vote for this issue
            Watchers:
            19 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment