Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5139 [Umbrella] Move YARN scheduler towards global scheduler
  3. YARN-6040

Introduce api independent PendingAsk to replace usage of ResourceRequest within Scheduler classes

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.9.0, 3.0.0-alpha2
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      As mentioned by YARN-5906, currently schedulers are using ResourceRequest heavily so it will be very hard to adopt the new PowerfulResourceRequest (YARN-4902).

      This JIRA is the 2nd step of refactoring, which remove usage of ResourceRequest from AppSchedulingInfo / SchedulerApplicationAttempt. Instead of returning ResourceRequest, it returns a lightweight and API-independent object - PendingAsk.

      The only remained ResourceRequest API of AppSchedulingInfo will be used by web service to get list of ResourceRequests.

      So after this patch, usage of ResourceRequest will be isolated inside AppSchedulingInfo, so it will be more flexible to update internal data structure and upgrade old ResourceRequest API to new.

        Attachments

        1. YARN-6040.001.patch
          143 kB
          Wangda Tan
        2. YARN-6040.002.patch
          143 kB
          Wangda Tan
        3. YARN-6040.003.patch
          143 kB
          Wangda Tan
        4. YARN-6040.004.patch
          143 kB
          Wangda Tan
        5. YARN-6040.005.patch
          144 kB
          Wangda Tan
        6. YARN-6040.006.patch
          144 kB
          Wangda Tan
        7. YARN-6040.007.patch
          144 kB
          Wangda Tan
        8. YARN-6040.branch-2.007.patch
          144 kB
          Wangda Tan
        9. YARN-6040.branch-2.008.patch
          144 kB
          Wangda Tan
        10. YARN-6040.branch-2.009.patch
          149 kB
          Wangda Tan

          Issue Links

            Activity

              People

              • Assignee:
                leftnoteasy Wangda Tan
                Reporter:
                leftnoteasy Wangda Tan
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: