Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5597 YARN Federation improvements
  3. YARN-6704

Add support for work preserving NM restart when FederationInterceptor is enabled in AMRMProxyService

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.1.0, 2.10.0, 2.9.1
    • None
    • None
    • Reviewed

    Description

      YARN-1336 added the ability to restart NM without loosing any running containers. AMRMProxy restart is added in YARN-6127. In a Federated YARN environment, there's additional state in the FederationInterceptor to allow for spanning across multiple sub-clusters, so we need to enhance FederationInterceptor to support work-preserving restart.

      Attachments

        1. YARN-6704.v3.patch
          67 kB
          Botong Huang
        2. YARN-6704.v4.patch
          69 kB
          Botong Huang
        3. YARN-6704.v5.patch
          24 kB
          Botong Huang
        4. YARN-6704.v6.patch
          33 kB
          Botong Huang
        5. YARN-6704.v7.patch
          33 kB
          Botong Huang
        6. YARN-6704.v8.patch
          33 kB
          Botong Huang
        7. YARN-6704.v9.patch
          33 kB
          Botong Huang
        8. YARN-6704-YARN-2915.v1.patch
          47 kB
          Botong Huang
        9. YARN-6704-YARN-2915.v2.patch
          58 kB
          Botong Huang

        Issue Links

          depends upon

          Sub-task - The sub-task of the issue YARN-6128 Add support for AMRMProxy HA

          • Major - Major loss of function.
          • Resolved
          is blocked by

          Sub-task - The sub-task of the issue YARN-6127 Add support for work preserving NM restart when AMRMProxy is enabled

          • Major - Major loss of function.
          • Resolved
          requires

          New Feature - A new feature of the product, which has yet to be developed. YARN-1336 [Umbrella] Work-preserving nodemanager restart

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              botong Botong Huang
              botong Botong Huang
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: