Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9041

Performance Optimization of method FSPreemptionThread#identifyContainersToPreempt

    XMLWordPrintableJSON

    Details

    • Hadoop Flags:
      Reviewed

      Description

      In FSPreemptionThread#identifyContainersToPreempt method, I suggest if AM preemption, and locality relaxation is allowed, then the search space is expanded to all nodes changed to the remaining nodes. The remaining nodes are equal to all nodes minus the potential nodes.

      Judging condition changed to:

      1. rr.getRelaxLocality()
      2. !ResourceRequest.isAnyLocation(rr.getResourceName())
      3. bestContainers != null
      4. bestContainers.numAMContainers > 0

      If I understand the deviation, please criticize me. thx~

        Attachments

        1. YARN-9041.001.patch
          2 kB
          Wanqiang Ji
        2. YARN-9041.002.patch
          3 kB
          Wanqiang Ji
        3. YARN-9041.003.patch
          9 kB
          Wanqiang Ji
        4. YARN-9041.004.patch
          11 kB
          Wanqiang Ji
        5. YARN-9041.005.patch
          9 kB
          Wanqiang Ji
        6. YARN-9041.006.patch
          12 kB
          Wanqiang Ji
        7. YARN-9041.007.patch
          12 kB
          Wanqiang Ji

          Activity

            People

            • Assignee:
              jiwq Wanqiang Ji
              Reporter:
              jiwq Wanqiang Ji
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: