Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1489 [Umbrella] Work-preserving ApplicationMaster restart
  3. YARN-1493

Schedulers don't recognize apps separately from app-attempts

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.4.0
    • None
    • None
    • Reviewed

    Description

      Today, scheduler is tied to attempt only.

      We need to separate app-level handling logic in scheduler. We can add new app-level events to the scheduler and separate the app-level logic out. This is good for work-preserving AM restart, RM restart, and also needed for differentiating app-level metrics and attempt-level metrics.

      Attachments

        1. YARN-1493.1.patch
          163 kB
          Jian He
        2. YARN-1493.2.patch
          163 kB
          Jian He
        3. YARN-1493.3.patch
          164 kB
          Jian He
        4. YARN-1493.4.patch
          203 kB
          Jian He
        5. YARN-1493.5.patch
          275 kB
          Jian He
        6. YARN-1493.6.patch
          282 kB
          Jian He
        7. YARN-1493.7.patch
          208 kB
          Jian He
        8. YARN-1493.8.patch
          210 kB
          Jian He
        9. YARN-1493.9.patch
          211 kB
          Jian He

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. YARN-1166 YARN 'appsFailed' metric should be of type 'counter'

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed
          breaks

          Sub-task - The sub-task of the issue YARN-1577 Unmanaged AM is broken because of YARN-1493

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. YARN-1689 RMAppAttempt is not killed when RMApp is at ACCEPTED

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          is blocked by

          Sub-task - The sub-task of the issue YARN-1446 Change killing application to wait until state store is done

          • Major - Major loss of function.
          • Closed

          Activity

            People

              jianhe Jian He
              jianhe Jian He
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: