Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1336 [Umbrella] Work-preserving nodemanager restart
  3. YARN-1337

Recover containers upon nodemanager restart

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.3.0
    • 2.6.0
    • nodemanager
    • None

    Description

      To support work-preserving NM restart we need to recover the state of the containers when the nodemanager went down. This includes informing the RM of containers that have exited in the interim and a strategy for dealing with the exit codes from those containers along with how to reacquire the active containers and determine their exit codes when they terminate. The state of finished containers also needs to be recovered.

      Attachments

        1. YARN-1337-v1.patch
          99 kB
          Jason Darrell Lowe
        2. YARN-1337-v2.patch
          112 kB
          Jason Darrell Lowe
        3. YARN-1337-v3.patch
          118 kB
          Jason Darrell Lowe

        Issue Links

          contains

          Sub-task - The sub-task of the issue YARN-1352 Recover LogAggregationService upon nodemanager restart

          • Major - Major loss of function.
          • Resolved
          is blocked by

          Sub-task - The sub-task of the issue YARN-1338 Recover localized resource cache state upon nodemanager restart

          • Major - Major loss of function.
          • Closed

          Sub-task - The sub-task of the issue YARN-1354 Recover applications upon nodemanager restart

          • Major - Major loss of function.
          • Closed
          is duplicated by

          Sub-task - The sub-task of the issue YARN-2040 Recover information about finished containers

          • Major - Major loss of function.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue YARN-2402 NM restart: Container recovery for Windows

          • Major - Major loss of function.
          • In Progress

          Sub-task - The sub-task of the issue YARN-2561 MR job client cannot reconnect to AM after NM restart.

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Activity

            People

              jlowe Jason Darrell Lowe
              jlowe Jason Darrell Lowe
              Votes:
              0 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: