Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-666

[Umbrella] Support rolling upgrades in YARN

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.0.4-alpha
    • 2.6.0
    • graceful, rolling upgrade
    • None

    Description

      Jira to track changes required in YARN to allow rolling upgrades, including documentation and possible upgrade routes.

      Attachments

        1. YARN_Rolling_Upgrades_v2.pdf
          73 kB
          Siddharth Seth
        2. YARN_Rolling_Upgrades.pdf
          73 kB
          Siddharth Seth

        Issue Links

          depends upon

          New Feature - A new feature of the product, which has yet to be developed. YARN-556 [Umbrella] RM Restart phase 2 - Work preserving restart

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. YARN-1336 [Umbrella] Work-preserving nodemanager restart

          • Major - Major loss of function.
          • Resolved
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-4150 Versioning and rolling upgrades for MR2

          • Major - Major loss of function.
          • Open
          relates to

          Sub-task - The sub-task of the issue MAPREDUCE-4421 Run MapReduce framework via the distributed cache

          • Major - Major loss of function.
          • Closed

          Sub-task - The sub-task of the issue MAPREDUCE-5891 Improved shuffle error handling across NM restarts

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. YARN-3292 [Umbrella] Tests/documentation and/or tools for YARN rolling upgrades backwards/forward compatibility verification

          • Major - Major loss of function.
          • Open
          1.
          		 Data persisted in RM should be versioned Sub-task Resolved Junping Du
          2.
          		 TokenIdentifier serialization should consider Unknown fields Sub-task Closed Junping Du
          3.
          		 ContainerTokens sent from the RM to NM via the AM should be a byte field Sub-task Resolved Vinod Kumar Vavilapalli
          4.
          		 Add an Exception to indicate 'Maintenance' for NMs and add this to the JavaDoc for appropriate protocols Sub-task Resolved Unassigned
          5.
          		 Add an interface on the RM to move NMs into a maintenance state Sub-task Resolved Unassigned
          6.
          		 Add an option to drain the ResourceManager of all apps for upgrades Sub-task Resolved Arun Murthy
          7.
          		 ResourceManager and NodeManager should check for a minimum allowed version Sub-task Closed Robert Parker
          8.
          		 Data persisted in NM should be versioned Sub-task Closed Junping Du
          9.
          		 Move containerMgrProxy from RM's AMLaunch to get rid of issues that new client talking with old server Sub-task Open Junping Du
          10.
          		 YARN RPC should support Protocol Version in client/server Sub-task Resolved Junping Du
          11.
          		 Data persistent in timelinestore should be versioned Sub-task Closed Junping Du
          12.
          		 ApplicationHistoryStore should be versioned Sub-task Resolved Junping Du
          13.
          		 Consolidate RMStateVersion and NMDBSchemaVersion into StateVersion in yarn-server-common Sub-task Closed Junping Du
          14.
          		 MR job client cannot reconnect to AM after NM restart. Sub-task Closed Junping Du
          15.
          		 Provide Hadoop as a local resource (on HDFS) which can be used by other projects Sub-task Open Junping Du
          16.
          		 NMClient doesn't have retries for supporting rolling-upgrades Sub-task Resolved Jian He
          17.
          		 ClientToAMTokenIdentifier and DelegationTokenIdentifier should allow extended fields Sub-task Closed Junping Du

          Activity

            People

              Unassigned Unassigned
              sseth Siddharth Seth
              Votes:
              0 Vote for this issue
              Watchers:
              34 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: