Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5139 [Umbrella] Move YARN scheduler towards global scheduler
  3. YARN-6040

Introduce api independent PendingAsk to replace usage of ResourceRequest within Scheduler classes

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.9.0, 3.0.0-alpha2
    • None
    • None
    • Reviewed

    Description

      As mentioned by YARN-5906, currently schedulers are using ResourceRequest heavily so it will be very hard to adopt the new PowerfulResourceRequest (YARN-4902).

      This JIRA is the 2nd step of refactoring, which remove usage of ResourceRequest from AppSchedulingInfo / SchedulerApplicationAttempt. Instead of returning ResourceRequest, it returns a lightweight and API-independent object - PendingAsk.

      The only remained ResourceRequest API of AppSchedulingInfo will be used by web service to get list of ResourceRequests.

      So after this patch, usage of ResourceRequest will be isolated inside AppSchedulingInfo, so it will be more flexible to update internal data structure and upgrade old ResourceRequest API to new.

      Attachments

        1. YARN-6040.branch-2.009.patch
          149 kB
          Wangda Tan
        2. YARN-6040.branch-2.008.patch
          144 kB
          Wangda Tan
        3. YARN-6040.branch-2.007.patch
          144 kB
          Wangda Tan
        4. YARN-6040.007.patch
          144 kB
          Wangda Tan
        5. YARN-6040.006.patch
          144 kB
          Wangda Tan
        6. YARN-6040.005.patch
          144 kB
          Wangda Tan
        7. YARN-6040.004.patch
          143 kB
          Wangda Tan
        8. YARN-6040.003.patch
          143 kB
          Wangda Tan
        9. YARN-6040.002.patch
          143 kB
          Wangda Tan
        10. YARN-6040.001.patch
          143 kB
          Wangda Tan

        Issue Links

          breaks

          Bug - A problem which impairs or prevents the functions of the product. YARN-8462 Resource Manager shutdown with FATAL Exception

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue YARN-6065 Update javadocs of new added APIs / classes of scheduler/AppSchedulingInfo

          • Major - Major loss of function.
          • Open

          Activity

            People

              leftnoteasy Wangda Tan
              leftnoteasy Wangda Tan
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: