Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-128 [Umbrella] RM Restart Phase 1: State storage and non-work-preserving recovery
  3. YARN-1815

Work preserving recovery of Unmanged AMs

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 2.3.0
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: resourcemanager
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently work preserving RM restart recovers unmanaged AMs but it has a couple of shortcomings - all running containers are killed and completed unmanaged AMs are also recovered as we do not record final state for unmanaged AMs in the RM StateStore. This JIRA proposes to address both the shortcomings so that work preserving unmanaged AM recovery works exactly like with managed AMs

        Attachments

        1. yarn-1815-1.patch
          3 kB
          Karthik Kambatla
        2. yarn-1815-2.patch
          3 kB
          Karthik Kambatla
        3. Unmanaged AM recovery.png
          149 kB
          Karthik Kambatla
        4. yarn-1815-2.patch
          4 kB
          Karthik Kambatla
        5. YARN-1815-v3.patch
          9 kB
          Subramaniam Krishnan
        6. YARN-1815-v4.patch
          10 kB
          Subramaniam Krishnan
        7. YARN-1815-v5.patch
          11 kB
          Subramaniam Krishnan
        8. YARN-1815-v6.patch
          13 kB
          Subramaniam Krishnan

          Issue Links

          is related to

          Sub-task - The sub-task of the issue YARN-1823 Recover Unmanaged AMs

          • Major - Major loss of function.
          • Resolved

            Activity

              People

              • Assignee:
                subru Subramaniam Krishnan
                Reporter:
                kasha Karthik Kambatla
              • Votes:
                0 Vote for this issue
                Watchers:
                16 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: