Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-128 [Umbrella] RM Restart Phase 1: State storage and non-work-preserving recovery
  3. YARN-1618

Fix invalid RMApp transition from NEW to FINAL_SAVING

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 2.2.0
    • 2.3.0
    • resourcemanager
    • None

    Description

      YARN-891 augments the RMStateStore to store information on completed applications. In the process, it adds transitions from NEW to FINAL_SAVING. This leads to the RM trying to update entries in the state-store that do not exist. On ZKRMStateStore, this leads to the RM crashing.

      Previous description:
      ZKRMStateStore fails to handle updates to znodes that don't exist. For instance, this can happen when an app transitions from NEW to FINAL_SAVING. In these cases, the store should create the missing znode and handle the update.

      Attachments

        1. yarn-1618-1.patch
          5 kB
          Karthik Kambatla
        2. yarn-1618-2.patch
          6 kB
          Karthik Kambatla
        3. yarn-1618-3.patch
          7 kB
          Karthik Kambatla
        4. yarn-1618-branch-2.3.patch
          7 kB
          Karthik Kambatla

        Issue Links

          relates to

          Sub-task - The sub-task of the issue YARN-1671 Revisit RMApp transitions from NEW on RECOVER

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              kasha Karthik Kambatla
              kasha Karthik Kambatla
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: