Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-556 [Umbrella] RM Restart phase 2 - Work preserving restart
  3. YARN-1366

AM should implement Resync with the ApplicationMasterService instead of shutting down

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.5.0
    • Component/s: resourcemanager
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      The ApplicationMasterService currently sends a resync response to which the AM responds by shutting down. The AM behavior is expected to change to calling resyncing with the RM. Resync means resetting the allocate RPC sequence number to 0 and the AM should send its entire outstanding request to the RM. Note that if the AM is making its first allocate call to the RM then things should proceed like normal without needing a resync. The RM will return all containers that have completed since the RM last synced with the AM. Some container completions may be reported more than once.

        Attachments

        1. YARN-1366.1.patch
          5 kB
          Rohith Sharma K S
        2. YARN-1366.10.patch
          32 kB
          Rohith Sharma K S
        3. YARN-1366.11.patch
          32 kB
          Rohith Sharma K S
        4. YARN-1366.12.patch
          33 kB
          Rohith Sharma K S
        5. YARN-1366.13.patch
          34 kB
          Rohith Sharma K S
        6. YARN-1366.2.patch
          13 kB
          Rohith Sharma K S
        7. YARN-1366.3.patch
          30 kB
          Rohith Sharma K S
        8. YARN-1366.4.patch
          27 kB
          Rohith Sharma K S
        9. YARN-1366.5.patch
          34 kB
          Rohith Sharma K S
        10. YARN-1366.6.patch
          32 kB
          Rohith Sharma K S
        11. YARN-1366.7.patch
          33 kB
          Rohith Sharma K S
        12. YARN-1366.8.patch
          33 kB
          Rohith Sharma K S
        13. YARN-1366.9.patch
          32 kB
          Rohith Sharma K S
        14. YARN-1366.patch
          5 kB
          Rohith Sharma K S
        15. YARN-1366.prototype.patch
          5 kB
          Anubhav Dhoot
        16. YARN-1366.prototype.patch
          5 kB
          Anubhav Dhoot

          Issue Links

            Activity

              People

              • Assignee:
                rohithsharma Rohith Sharma K S
                Reporter:
                bikassaha Bikas Saha
              • Votes:
                0 Vote for this issue
                Watchers:
                13 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: