Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3489

RMServerUtils.validateResourceRequests should only obtain queue info once

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      Since the label support was added we now get the queue info for each request being validated in SchedulerUtils.validateResourceRequest. If validateResourceRequests needs to validate a lot of requests at a time (e.g.: large cluster with lots of varied locality in the requests) then it will get the queue info for each request. Since we build the queue info this generates a lot of unnecessary garbage, as the queue isn't changing between requests. We should grab the queue info once and pass it down rather than building it again for each request.

      Attachments

        1. YARN-3489.01.patch
          6 kB
          Varun Saxena
        2. YARN-3489.02.patch
          3 kB
          Varun Saxena
        3. YARN-3489.03.patch
          5 kB
          Varun Saxena
        4. YARN-3489-branch-2.7.patch
          5 kB
          Wangda Tan
        5. YARN-3489-branch-2.7.02.patch
          4 kB
          Varun Saxena
        6. YARN-3489-branch-2.7.03.patch
          4 kB
          Varun Saxena
        7. YARN-3489-branch-2.7.04.patch
          5 kB
          Varun Saxena

        Activity

          People

            varun_saxena Varun Saxena
            jlowe Jason Darrell Lowe
            Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: