Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-128 [Umbrella] RM Restart Phase 1: State storage and non-work-preserving recovery
  3. YARN-891

Store completed application information in RM state store

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.3.0
    • resourcemanager
    • None
    • Reviewed

    Description

      Store completed application/attempt info in RMStateStore when application/attempt completes. This solves some problems like finished application get lost after RM restart and some other races like YARN-1195

      Attachments

        1. YARN-891.1.patch
          110 kB
          Jian He
        2. YARN-891.10.patch
          215 kB
          Jian He
        3. YARN-891.2.patch
          136 kB
          Jian He
        4. YARN-891.3.patch
          183 kB
          Jian He
        5. YARN-891.4.patch
          184 kB
          Jian He
        6. YARN-891.5.patch
          187 kB
          Jian He
        7. YARN-891.6.patch
          187 kB
          Jian He
        8. YARN-891.7.patch
          210 kB
          Jian He
        9. YARN-891.7.patch
          206 kB
          Jian He
        10. YARN-891.8.patch
          215 kB
          Jian He
        11. YARN-891.9.patch
          215 kB
          Jian He
        12. YARN-891.patch
          112 kB
          Jian He
        13. YARN-891.patch
          111 kB
          Jian He
        14. YARN-891.patch
          108 kB
          Jian He
        15. YARN-891.patch
          109 kB
          Jian He
        16. YARN-891.patch
          108 kB
          Jian He
        17. YARN-891.patch
          90 kB
          Jian He

        Issue Links

          blocks

          Sub-task - The sub-task of the issue YARN-1210 During RM restart, RM should start a new attempt only when previous attempt exits for real

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. YARN-261 Ability to fail AM attempts

          • Major - Major loss of function.
          • Resolved
          duplicates

          Sub-task - The sub-task of the issue YARN-1195 RM may relaunch already KILLED / FAILED jobs after RM restarts

          • Major - Major loss of function.
          • Resolved
          is depended upon by

          Sub-task - The sub-task of the issue YARN-1345 Removing FINAL_SAVING from YarnApplicationAttemptState

          • Major - Major loss of function.
          • Closed
          relates to

          Sub-task - The sub-task of the issue YARN-1671 Revisit RMApp transitions from NEW on RECOVER

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. YARN-614 Separate AM failures from hardware failure or YARN error and do not count them to AM retry count

          • Major - Major loss of function.
          • Closed

          Activity

            People

              jianhe Jian He
              bikassaha Bikas Saha
              Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: