Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-45 [Preemption] Scheduler feedback to AM to release containers
  3. YARN-2074

Preemption of AM containers shouldn't count towards AM failures

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.5.0
    • resourcemanager
    • None
    • Reviewed

    Description

      One orthogonal concern with issues like YARN-2055 and YARN-2022 is that AM containers getting preempted shouldn't count towards AM failures and thus shouldn't eventually fail applications.

      We should explicitly handle AM container preemption/kill as a separate issue and not count it towards the limit on AM failures.

      Attachments

        1. YARN-2074.1.patch
          14 kB
          Jian He
        2. YARN-2074.2.patch
          18 kB
          Jian He
        3. YARN-2074.3.patch
          37 kB
          Jian He
        4. YARN-2074.4.patch
          38 kB
          Jian He
        5. YARN-2074.5.patch
          38 kB
          Jian He
        6. YARN-2074.6.patch
          39 kB
          Jian He
        7. YARN-2074.6.patch
          40 kB
          Jian He
        8. YARN-2074.7.patch
          40 kB
          Jian He
        9. YARN-2074.7.patch
          40 kB
          Jian He
        10. YARN-2074.8.patch
          42 kB
          Jian He

        Issue Links

          is related to

          Sub-task - The sub-task of the issue MAPREDUCE-5956 MapReduce AM should not use maxAttempts to determine if this is the last retry

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. YARN-2355 MAX_APP_ATTEMPTS_ENV may no longer be a useful env var for a container

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue YARN-2055 Preemption: Jobs are failing due to AMs are getting launched and killed multiple times

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue YARN-611 Add an AM retry count reset window to YARN RM

          • Major - Major loss of function.
          • Closed

          Sub-task - The sub-task of the issue YARN-2022 Preempting an Application Master container can be kept as least priority when multiple applications are marked for preemption by ProportionalCapacityPreemptionPolicy

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. YARN-614 Separate AM failures from hardware failure or YARN error and do not count them to AM retry count

          • Major - Major loss of function.
          • Closed

          Activity

            People

              jianhe Jian He
              vinodkv Vinod Kumar Vavilapalli
              Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: